-- Logs begin at Fri 2021-10-29 00:32:16 UTC, end at Fri 2021-10-29 01:56:57 UTC. -- Oct 29 01:04:19.339058 dv-cinder-815582-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 29 01:04:19.346411 dv-cinder-815582-5-iscsi devstack@n-api.service[100790]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 29 01:04:19.348437 dv-cinder-815582-5-iscsi devstack@n-api.service[100790]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 29 01:04:19 2021] *** Oct 29 01:04:19.348437 dv-cinder-815582-5-iscsi devstack@n-api.service[100790]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 29 01:04:19.348437 dv-cinder-815582-5-iscsi devstack@n-api.service[100790]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 29 01:04:19.348437 dv-cinder-815582-5-iscsi devstack@n-api.service[100790]: nodename: dv-cinder-815582-5-iscsi Oct 29 01:04:19.348437 dv-cinder-815582-5-iscsi devstack@n-api.service[100790]: machine: x86_64 Oct 29 01:04:19.348437 dv-cinder-815582-5-iscsi devstack@n-api.service[100790]: clock source: unix Oct 29 01:04:19.348437 dv-cinder-815582-5-iscsi devstack@n-api.service[100790]: pcre jit disabled Oct 29 01:04:19.348930 dv-cinder-815582-5-iscsi devstack@n-api.service[100790]: detected number of CPU cores: 4 Oct 29 01:04:19.348930 dv-cinder-815582-5-iscsi devstack@n-api.service[100790]: current working directory: / Oct 29 01:04:19.348930 dv-cinder-815582-5-iscsi devstack@n-api.service[100790]: detected binary path: /usr/bin/uwsgi-core Oct 29 01:04:19.348930 dv-cinder-815582-5-iscsi devstack@n-api.service[100790]: your processes number limit is 47680 Oct 29 01:04:19.348930 dv-cinder-815582-5-iscsi devstack@n-api.service[100790]: your memory page size is 4096 bytes Oct 29 01:04:19.348930 dv-cinder-815582-5-iscsi devstack@n-api.service[100790]: detected max file descriptor number: 2048 Oct 29 01:04:19.348930 dv-cinder-815582-5-iscsi devstack@n-api.service[100790]: lock engine: pthread robust mutexes Oct 29 01:04:19.348930 dv-cinder-815582-5-iscsi devstack@n-api.service[100790]: thunder lock: enabled Oct 29 01:04:19.348930 dv-cinder-815582-5-iscsi devstack@n-api.service[100790]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 29 01:04:19.348930 dv-cinder-815582-5-iscsi devstack@n-api.service[100790]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 29 01:04:19.394291 dv-cinder-815582-5-iscsi devstack@n-api.service[100790]: Python main interpreter initialized at 0x5647874c89c0 Oct 29 01:04:19.394291 dv-cinder-815582-5-iscsi devstack@n-api.service[100790]: python threads support enabled Oct 29 01:04:19.394291 dv-cinder-815582-5-iscsi devstack@n-api.service[100790]: your server socket listen backlog is limited to 100 connections Oct 29 01:04:19.394291 dv-cinder-815582-5-iscsi devstack@n-api.service[100790]: your mercy for graceful operations on workers is 90 seconds Oct 29 01:04:19.394717 dv-cinder-815582-5-iscsi devstack@n-api.service[100790]: mapped 403077 bytes (393 KB) for 2 cores Oct 29 01:04:19.394797 dv-cinder-815582-5-iscsi devstack@n-api.service[100790]: *** Operational MODE: preforking *** Oct 29 01:04:19.395029 dv-cinder-815582-5-iscsi devstack@n-api.service[100790]: *** uWSGI is running in multiple interpreter mode *** Oct 29 01:04:19.395029 dv-cinder-815582-5-iscsi devstack@n-api.service[100790]: spawned uWSGI master process (pid: 100790) Oct 29 01:04:19.395227 dv-cinder-815582-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 29 01:04:19.396593 dv-cinder-815582-5-iscsi devstack@n-api.service[100790]: spawned uWSGI worker 1 (pid: 100791, cores: 1) Oct 29 01:04:19.396593 dv-cinder-815582-5-iscsi devstack@n-api.service[100790]: spawned uWSGI worker 2 (pid: 100792, cores: 1) Oct 29 01:04:19.396593 dv-cinder-815582-5-iscsi devstack@n-api.service[100790]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 29 01:04:21.032926 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 01:04:21.032926 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: from cryptography.utils import int_from_bytes Oct 29 01:04:21.033509 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 01:04:21.033509 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: from cryptography.utils import int_from_bytes Oct 29 01:04:21.048293 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 01:04:21.048293 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: from cryptography.utils import int_from_bytes Oct 29 01:04:21.048804 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 01:04:21.048804 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: from cryptography.utils import int_from_bytes Oct 29 01:04:23.657352 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 29 01:04:23.658014 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 29 01:04:23.658140 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 29 01:04:23.658431 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 29 01:04:23.659213 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 29 01:04:23.659602 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.659932 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.660255 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.660577 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.660909 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.661222 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.661544 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.661867 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.662198 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.662484 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.662802 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.662896 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 29 01:04:23.663254 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815582-5-iscsi {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.663351 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 29 01:04:23.663430 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.663606 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 29 01:04:23.663735 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.663965 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 29 01:04:23.664056 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.664219 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 29 01:04:23.664353 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.664601 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.664690 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.664923 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.665013 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.665242 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.665325 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.665557 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.665754 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.665995 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.666193 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.666303 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.666527 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.666651 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.666847 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.666966 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.667194 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.667328 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.667496 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.667770 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.667901 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.668020 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.668148 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.668257 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815582-5-iscsi {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.668414 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.668546 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.668714 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.668837 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.669022 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.669147 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.669334 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.669467 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815582-5-iscsi {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.669634 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.669757 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.669966 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.670154 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.670276 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.670413 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.671090 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.671228 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.671228 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.671487 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.671606 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.671724 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.671839 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.671959 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.672078 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.672197 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.672315 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.672432 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.672613 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.672749 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.672930 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.673055 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.673234 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.673357 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.673548 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.673681 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.673850 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.673980 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.674228 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.674890 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815582-5-iscsi {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.675060 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.675185 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.675386 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.675523 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.675696 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.675820 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.676004 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.676257 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.676379 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.676567 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.676690 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.676875 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.676999 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.677211 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.677357 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.677538 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.677696 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.677785 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.678004 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.678090 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.678338 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.678456 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.678689 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.678776 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.679001 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.679100 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.679313 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.679406 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.679623 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.679715 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.679931 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.680028 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.680240 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.680334 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.680544 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.680630 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.680848 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.680942 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.681152 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.681245 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.681402 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.681494 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.681709 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.681815 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.682025 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.682123 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.682347 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.682475 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.682688 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.682779 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.682936 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.683085 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.90 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.683178 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.683338 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.90 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.683480 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.683649 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.683797 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.683989 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.684102 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.684312 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.684406 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.684626 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.684805 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.684945 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.685109 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.685268 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.685412 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.685578 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.685714 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.685889 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.686010 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.686197 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.686312 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.686540 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.686661 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.686884 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.686971 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.687191 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.687290 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.687443 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.687560 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.687748 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.687877 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.688055 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.688267 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.90 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.688360 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.688514 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.90 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.688671 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.688817 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.688980 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.689224 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.689315 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.689541 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.689631 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.689880 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.689972 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.690203 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.690288 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.690538 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.690633 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.690850 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.690938 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.691150 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.691235 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.691452 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.691543 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.691760 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.691948 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.692189 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.692334 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.692478 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.692765 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.692765 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.693077 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.693213 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.693347 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.693480 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.693707 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.693864 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.694001 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.694135 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.694268 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.694460 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.694639 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.694820 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.694974 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.695110 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.695250 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.695383 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.695523 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.695657 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.695790 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.695922 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.696056 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.696056 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.696319 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.696454 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.696586 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.696736 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.696870 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.697009 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.697153 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.697287 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.697444 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.697582 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.697716 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.697860 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.697995 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.698130 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.698264 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.698421 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.698570 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.698737 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.698992 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.699144 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.699288 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.699429 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.699564 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.699713 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.699863 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.700006 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.700147 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.700282 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.700425 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.700568 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.700702 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.700835 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.700968 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.701101 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.701233 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.701375 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.701532 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.701679 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.701814 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.701946 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.702079 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.702229 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.702372 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.702589 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.702730 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.702920 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.703076 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.703254 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.703394 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.703601 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.703741 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.703917 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.704065 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.704201 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.704345 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.704481 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.704621 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.704764 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.704977 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.705114 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.705248 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.705395 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.705541 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.705681 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.705827 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.705969 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.706147 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.706284 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.706442 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.706596 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.706740 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.706880 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.707053 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.707200 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.707374 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.707523 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.707708 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.707861 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:04:23.708082 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.708268 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.708404 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.708551 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.708688 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.708821 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.708955 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.709096 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.709268 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.709417 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.709601 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.709742 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.709926 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.710065 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.710245 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.710442 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.710598 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.710741 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.710919 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.711068 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.711227 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.711381 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.711538 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.711686 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.711850 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.711992 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.712165 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.712308 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.712475 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.712620 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.712791 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.712933 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.713106 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.713248 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.713435 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.713605 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.713746 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.713922 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.714073 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.714316 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.714601 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.714748 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.714883 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.715018 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.715162 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.715319 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.715460 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.715628 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.715768 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.715936 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.716078 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.716250 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.716405 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.716565 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.716706 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.716885 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.717027 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.717216 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.717364 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.717530 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.717678 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.717822 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.717955 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.718132 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.718290 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.718461 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.718603 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.718782 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.718923 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.719091 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.719230 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.719397 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.719550 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.719709 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.719848 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.720019 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.720166 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.720340 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.720495 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.720638 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.720779 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.720946 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.721584 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.721801 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.721951 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.722115 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.722256 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.722430 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.722572 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.722793 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.722991 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.723139 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.723281 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.723416 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.723807 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.723956 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.724097 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.724233 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.724366 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.724529 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.724670 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.724853 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.725007 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.725144 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.725278 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.725419 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.725553 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.725717 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.725858 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.726020 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.726166 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.726445 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.726633 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.726874 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.727026 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.727173 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.727307 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.727447 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.727593 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.727729 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.727863 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.727997 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.728137 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.728272 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.728482 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.728621 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.728756 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.728889 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.729039 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.729182 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.729325 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.729466 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.729602 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.729736 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.729870 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.730003 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.730261 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.730428 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.730569 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.730715 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.730848 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.731008 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.731145 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.731278 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.731411 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.731557 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.731692 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.731834 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.731969 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.732138 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.732279 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.732484 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.732633 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.732827 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.733063 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.733200 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.733340 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.733481 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.733651 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.733801 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.733964 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.734112 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.734324 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.734512 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.734663 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.734808 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.734960 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.735107 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.735242 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.735382 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.735525 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.735659 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.735836 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.735977 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.736146 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.736287 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.736451 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.736592 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.737431 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.737593 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.737730 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.737863 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.738007 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.738144 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.738277 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.738441 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.738592 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.738741 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.738899 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.739040 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.739217 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.739366 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.739541 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.739690 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.739853 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.739994 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.740166 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.740306 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.740481 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.740633 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.740798 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.740938 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.741114 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.741255 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.741429 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.741593 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.741730 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.741983 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.742128 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.742265 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.742456 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.742611 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.742747 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.742881 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.743023 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.743158 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.743305 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.743483 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.743640 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.743775 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.743908 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.744040 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.744180 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.744315 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.744495 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.744637 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.744828 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.744969 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.745167 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.745390 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.745595 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.745733 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.745867 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.746000 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.746142 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.746278 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.746442 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.746618 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.746756 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.746901 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.747073 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.747211 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.747345 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.747490 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.747624 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.747772 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.747914 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.748055 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.748193 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.748331 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.748500 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.748658 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.748807 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.748946 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.749086 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.749226 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.749408 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.749566 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.749709 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.749863 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.750012 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.750152 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.750300 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.750474 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.750624 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.750879 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.751027 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.751180 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.751338 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.751549 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.751696 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.751875 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.752022 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.752185 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.752342 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.752518 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.752666 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.752849 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.752996 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.753164 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.753357 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.753509 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.753661 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.753802 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.753942 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.754082 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.754230 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.754380 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.754591 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.754742 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.754885 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.755034 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.755175 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.755316 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.755466 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.755607 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.755753 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.755904 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.756045 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.756190 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.756332 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.756479 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.756620 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.756769 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.756920 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.757060 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.757200 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.757349 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.757496 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.757713 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.757856 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.757997 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.758136 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.758348 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.758543 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.758688 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.758829 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.758969 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.759116 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.759279 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.759444 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.759587 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.759733 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.759881 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.760023 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.760193 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.760347 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.760490 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.760629 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.760775 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.760916 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.761091 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.761288 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.761568 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.761719 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.761862 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.762002 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.762152 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.762294 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.762473 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.762622 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.762762 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.762924 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.763179 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.763378 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.763533 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.763675 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.763815 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.763954 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.764102 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.764260 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.764400 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.764540 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.764680 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.764869 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.765024 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.765165 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.765313 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.765464 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.765612 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.765760 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.765902 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.766048 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.766189 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.766336 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.766508 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.766662 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.766804 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.766944 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.767083 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.767229 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.767380 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.767530 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.767678 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.767865 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.768113 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.768272 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.768428 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.768569 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.768717 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.768858 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.769033 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.769181 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.769344 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.769536 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.769693 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.769922 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.770070 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.770235 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.770419 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.770581 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.770730 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.770871 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.771012 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.771213 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.771359 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.771539 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.771684 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.771831 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.772019 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.772167 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.772307 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.772456 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.772599 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.772747 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.772889 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.773029 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.773169 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.773317 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.773468 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.773609 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.773750 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.773890 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.774038 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.774181 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.774335 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.774523 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.774666 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.774815 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.774956 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.775096 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.775245 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.775396 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.775543 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.775691 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.775834 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.776023 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.776171 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.776311 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.776452 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.776614 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.776760 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.776911 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.777171 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.777321 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.777474 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.777614 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.777763 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.777914 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.778057 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.778197 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.778336 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.778542 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.778694 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.778856 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.779019 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.779160 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.779310 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.779451 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.779601 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.779743 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.779882 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.780022 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.780168 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.780317 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.780478 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.780627 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.780837 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.781042 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.781187 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.781338 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.781565 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.781718 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.781861 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.782002 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.782142 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.782290 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.782454 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.782602 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.782744 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.782744 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.783009 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.783160 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.783314 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.783454 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.784105 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.784248 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.784388 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.784535 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.784677 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.784855 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.784996 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.785135 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.785277 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.785428 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.785577 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.785736 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.785884 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.786026 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.786174 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.786174 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.786479 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.786626 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.786767 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.786914 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.787068 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.787211 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.787352 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.787503 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.787644 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.787785 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.787933 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.788075 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.788215 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.788364 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.788506 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.788653 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.788806 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.788948 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.789137 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.789291 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.789446 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.789592 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.789742 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.789890 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.790038 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.790180 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.790326 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.790513 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.790657 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.790797 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.790944 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.791085 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.791226 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.791387 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.791530 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.791671 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.791821 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.791963 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.792103 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.792255 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.792397 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.792554 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.792814 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.793019 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.793161 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.793310 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.793469 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.793612 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.793752 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.793893 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.794045 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.794194 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.794335 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.794558 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.794702 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.794849 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.795013 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.795156 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.795305 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.795457 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.795598 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.795739 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.795888 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.796030 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.796170 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.796310 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.796450 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.796590 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.796739 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.796881 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.797021 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.797198 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.797351 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.797501 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.797643 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.797792 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.797933 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.798073 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.798213 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.798361 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.798530 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.798671 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.798812 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.798952 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.799204 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.799933 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.800082 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.800223 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.800363 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.800504 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.800644 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.800792 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.800936 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.801084 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.801224 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.801364 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.801512 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.801672 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.801824 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.801966 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.802107 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.802247 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.802420 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.802569 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.802710 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.802861 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.803004 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.803145 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.803303 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.803445 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.803596 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.803737 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.803886 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.804034 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.804185 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.804431 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.804580 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.804749 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.804896 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.805068 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.805216 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.805379 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.805566 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.805713 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.805861 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.806011 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.806254 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.806436 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.806604 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.806753 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.806952 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.807108 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.807259 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.807462 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.807610 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.807784 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.807940 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.808091 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.808353 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.808505 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.808647 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.808787 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.808936 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.809078 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.809218 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.809359 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.809499 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.809639 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.809798 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.809941 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.810082 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.810222 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.810363 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.810546 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.810767 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.810912 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.811053 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.811194 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.811334 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.811482 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.811636 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.811829 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.811978 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.812128 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.812268 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.812416 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.812561 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.812728 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.812874 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.813145 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.813290 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.813446 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.813594 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.813774 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.813921 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.814101 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.814250 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.814450 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.814603 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.814766 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.815416 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.815580 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.815728 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.815880 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.816022 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.816171 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.816369 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.816525 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.816688 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.816832 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.816972 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.817112 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.817252 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.817392 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.817544 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.817687 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.817834 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.818001 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.818431 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.818619 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.818775 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.818775 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.819051 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.819051 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.819325 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.819465 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.819614 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.819756 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.819911 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.820053 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.820192 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.820354 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.820505 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.820646 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.820786 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.820927 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.821066 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.821214 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.821355 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.821522 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.821668 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.821831 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.821977 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.822130 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.822281 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.822507 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.822677 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.822828 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.823008 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.823164 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.823314 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.823464 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.823606 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.823746 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.824009 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.824168 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.824320 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.824483 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.824633 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.824774 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.824914 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.825055 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.825203 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.825203 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.825470 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.825617 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.825758 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.825906 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.826059 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.826202 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.826351 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.826565 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.826716 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.826859 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.827008 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.827151 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.827291 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.827431 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.827571 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.827711 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.827860 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.828002 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.828151 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.828300 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.828442 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.828589 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.828732 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.828871 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.829012 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.829158 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.829300 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.829448 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.829598 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.829745 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.829887 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.830038 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.830185 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.830355 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.831041 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.831224 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.831382 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.831550 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.831697 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.831847 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.831990 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.832170 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.832317 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.832489 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.832656 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.832799 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.832948 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.833091 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.833230 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.833394 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.833554 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.833697 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.833837 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.834047 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.834190 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.834331 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.834567 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.834722 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.834869 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.835011 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.835150 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.835328 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.835480 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.835624 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.835765 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.835905 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.836044 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.836193 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.836334 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.836492 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.836635 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.836777 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.837526 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.837683 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.837847 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.838001 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.838151 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.838151 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.838442 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.838603 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.838747 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.838888 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.839040 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.839203 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.839352 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.839618 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.839771 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.839913 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.840056 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.840196 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.840350 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.840492 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.840634 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.840775 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.840916 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.841074 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.841229 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.841379 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.841527 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.841668 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.841811 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.841958 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.842108 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.842250 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.842429 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.842580 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.842721 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.842880 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.843049 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.843192 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.843339 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.843481 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.843481 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.843772 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.843916 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.844062 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.844204 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.844351 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.844492 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.844645 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.844813 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.844965 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.845105 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.845244 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.845385 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.845533 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.845675 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.845815 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.845973 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.846125 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.846267 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.846440 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.846599 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.846751 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.846892 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.847033 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.847186 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.847335 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.847478 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.847618 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.847759 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.847759 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.848033 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.848184 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.848325 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.848482 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.848888 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.849029 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.849179 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.849179 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.849456 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.849597 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.849741 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.849890 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.850041 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.850190 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.850333 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.850552 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.850696 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.850885 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.851029 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.851177 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.851319 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.851466 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.851607 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.851757 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.851899 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.852040 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.852192 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.852345 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.852495 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.852637 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.852791 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.852937 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.853078 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.853219 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.853393 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.853538 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.853679 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.853819 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.853959 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.854109 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.854262 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.854426 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.854575 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.854716 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.854856 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.855016 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.855276 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.855430 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.855573 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.855573 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.855846 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.856010 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.856159 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.856309 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.856450 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.856591 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.856740 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.856882 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.857022 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.857163 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.857303 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.857443 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.857656 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.857800 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.857951 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.858091 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.858233 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.858380 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.858595 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.858754 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.858904 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.859045 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.859186 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.859335 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.859478 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.859618 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.859769 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.859910 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.860051 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.860199 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.860341 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.860480 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.860621 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.860761 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.860901 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.861104 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.861330 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.861485 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.862214 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.862383 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.862568 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.862719 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.862870 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.863021 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.863196 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.863344 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.863518 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.863674 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.863816 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.863958 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.864145 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.864301 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.864466 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.864608 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.864749 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.864889 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.865030 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.865170 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.865388 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.865539 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.865680 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.865820 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.865967 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.866115 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.866268 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.866455 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.866604 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.866755 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.866903 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.867054 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.867197 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.867336 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.867477 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.867656 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.867804 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.867953 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.868105 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.868281 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.868430 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.868604 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.868751 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.868901 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.869044 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.869206 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.869354 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.869527 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.869674 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.869823 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.869965 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.870113 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.870264 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.870439 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.870604 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.870869 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.871015 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.871156 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.871298 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.871439 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.871592 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.871741 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.871884 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.872030 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.872172 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.872324 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.872477 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.872619 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.872760 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.872901 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.873058 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.873201 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.873351 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.873492 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.873633 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.873773 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.873913 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.874061 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.874213 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.874369 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.874539 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.874680 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.874821 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.874972 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.875121 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.875263 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.875405 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.875553 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.875695 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.875844 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.875997 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.876138 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.876280 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.876503 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.876658 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.876831 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.876980 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.877122 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.877318 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.878036 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.878193 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.878336 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.878543 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.878698 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.878846 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.878988 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.879138 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.879300 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.879454 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.879599 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.879739 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.879879 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.880031 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.880181 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.880322 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.880463 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.880616 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.880757 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.880905 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.881075 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.881223 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.881370 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.881518 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.881672 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.881907 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.882056 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.882289 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.882460 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.882617 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.882771 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.882945 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.883091 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.883266 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.883413 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.883555 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.883703 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.883847 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.883987 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.884152 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.884306 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.884458 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.884619 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.884761 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.884910 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.885051 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.885192 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.885345 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.885495 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.885638 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.885778 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.885940 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.886088 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.886238 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.886555 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.886701 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.886842 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.886983 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.887134 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.887289 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.887432 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.887572 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.887720 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.887862 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.888015 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.888158 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.888297 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.888452 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.888593 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.888742 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.888914 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.889064 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.889230 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.889378 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.889554 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.889707 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.889858 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.890001 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.890166 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.890323 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.890502 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.890618 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.890819 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.890912 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.891123 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.891215 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.891448 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.891546 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.891764 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.891852 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.892103 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.892191 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.892425 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.892533 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.892742 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.892849 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.893081 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.893175 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.893400 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.893487 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.893711 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.893815 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.894034 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.894132 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.894343 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.894463 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.894722 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.894819 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.895048 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.895132 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.895374 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.895461 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.895689 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.895775 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.895992 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.896086 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.896298 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.896384 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.896605 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.896765 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.896909 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.897060 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.897221 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.897362 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.897521 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.897688 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.897832 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.897989 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.898132 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.898291 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.898455 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.898603 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.898744 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.898896 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.899065 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.899213 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.899392 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.899540 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.899711 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.899861 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.900004 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.900145 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.900319 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.900468 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.900619 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.900762 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.900928 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.901075 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.901224 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.901366 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.901537 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.901712 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.901864 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.902126 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.902288 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.902487 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.902645 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.902789 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.902930 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.903071 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.903211 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.903364 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.903507 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.903648 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.903813 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.903987 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.904135 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.904296 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.904452 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.904601 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.904745 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.904885 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 29 01:04:23.905036 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.905178 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.905483 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.905794 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.906101 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.906430 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.906751 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.907075 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.907444 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.907726 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.908050 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.908391 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.908728 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.909076 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.909403 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:04:23.909657 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 29 01:04:23.927268 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG oslo_db.sqlalchemy.engines [None req-2517cf6f-fe7b-46cc-bb83-f843d52bc634 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100791) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 01:04:23.931796 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG oslo_db.sqlalchemy.engines [None req-acb5c75a-319a-4ce6-bc85-3777a5fb66ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100792) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 01:04:24.101735 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.context [None req-2517cf6f-fe7b-46cc-bb83-f843d52bc634 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6(cell1) {{(pid=100791) load_cells /opt/stack/nova/nova/context.py:464}} Oct 29 01:04:24.105757 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.context [None req-acb5c75a-319a-4ce6-bc85-3777a5fb66ee None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6(cell1) {{(pid=100792) load_cells /opt/stack/nova/nova/context.py:464}} Oct 29 01:04:24.106138 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG oslo_concurrency.lockutils [None req-2517cf6f-fe7b-46cc-bb83-f843d52bc634 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:04:24.107754 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG oslo_concurrency.lockutils [None req-2517cf6f-fe7b-46cc-bb83-f843d52bc634 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:04:24.108561 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG oslo_concurrency.lockutils [None req-2517cf6f-fe7b-46cc-bb83-f843d52bc634 None None] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:04:24.110080 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG oslo_concurrency.lockutils [None req-acb5c75a-319a-4ce6-bc85-3777a5fb66ee None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:04:24.110506 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG oslo_concurrency.lockutils [None req-2517cf6f-fe7b-46cc-bb83-f843d52bc634 None None] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:04:24.111691 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG oslo_concurrency.lockutils [None req-acb5c75a-319a-4ce6-bc85-3777a5fb66ee None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:04:24.112477 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG oslo_concurrency.lockutils [None req-acb5c75a-319a-4ce6-bc85-3777a5fb66ee None None] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:04:24.114368 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG oslo_concurrency.lockutils [None req-acb5c75a-319a-4ce6-bc85-3777a5fb66ee None None] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:04:24.120727 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG oslo_db.sqlalchemy.engines [None req-2517cf6f-fe7b-46cc-bb83-f843d52bc634 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100791) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 01:04:24.123540 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG oslo_db.sqlalchemy.engines [None req-2517cf6f-fe7b-46cc-bb83-f843d52bc634 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100791) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 01:04:24.127592 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG oslo_db.sqlalchemy.engines [None req-acb5c75a-319a-4ce6-bc85-3777a5fb66ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100792) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 01:04:24.130878 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG oslo_db.sqlalchemy.engines [None req-acb5c75a-319a-4ce6-bc85-3777a5fb66ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100792) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 01:04:24.389156 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG oslo_db.sqlalchemy.engines [None req-2517cf6f-fe7b-46cc-bb83-f843d52bc634 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100791) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 01:04:24.396258 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG oslo_db.sqlalchemy.engines [None req-acb5c75a-319a-4ce6-bc85-3777a5fb66ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100792) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 01:04:24.733113 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: WARNING keystonemiddleware.auth_token [None req-2517cf6f-fe7b-46cc-bb83-f843d52bc634 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 01:04:24.733682 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: WARNING keystonemiddleware.auth_token [None req-acb5c75a-319a-4ce6-bc85-3777a5fb66ee None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 01:04:24.739589 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: WARNING keystonemiddleware.auth_token [None req-2517cf6f-fe7b-46cc-bb83-f843d52bc634 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 01:04:24.740125 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: WARNING keystonemiddleware.auth_token [None req-acb5c75a-319a-4ce6-bc85-3777a5fb66ee None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 01:04:25.084773 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: WARNING keystonemiddleware.auth_token [None req-2517cf6f-fe7b-46cc-bb83-f843d52bc634 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 01:04:25.088641 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: WARNING keystonemiddleware.auth_token [None req-acb5c75a-319a-4ce6-bc85-3777a5fb66ee None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 01:04:25.089890 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: WARNING keystonemiddleware.auth_token [None req-2517cf6f-fe7b-46cc-bb83-f843d52bc634 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 01:04:25.093817 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: WARNING keystonemiddleware.auth_token [None req-acb5c75a-319a-4ce6-bc85-3777a5fb66ee None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 01:04:25.096384 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5647874c89c0 pid: 100791 (default app) Oct 29 01:04:25.098760 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi [None req-2517cf6f-fe7b-46cc-bb83-f843d52bc634 None None] Calling method '>' {{(pid=100791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:25.099937 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: INFO nova.api.openstack.requestlog [None req-2517cf6f-fe7b-46cc-bb83-f843d52bc634 None None] 10.222.0.90 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002038 Oct 29 01:04:25.100257 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5647874c89c0 pid: 100792 (default app) Oct 29 01:04:25.100354 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: [pid: 100791|app: 0|req: 1/1] 10.222.0.90 () {50 vars in 788 bytes} [Fri Oct 29 01:04:25 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:46.262931 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi [None req-acb5c75a-319a-4ce6-bc85-3777a5fb66ee None None] Calling method '>' {{(pid=100792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:46.264723 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: INFO nova.api.openstack.requestlog [None req-acb5c75a-319a-4ce6-bc85-3777a5fb66ee None None] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002561 Oct 29 01:05:46.271020 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: [pid: 100792|app: 0|req: 1/2] 10.222.0.90 () {54 vars in 930 bytes} [Fri Oct 29 01:05:46 2021] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:46.724374 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi [None req-e8e8c416-74d5-4334-a196-64f33c002685 admin admin] Calling method '>' {{(pid=100791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:46.757426 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: INFO nova.api.openstack.requestlog [None req-e8e8c416-74d5-4334-a196-64f33c002685 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.485085 Oct 29 01:05:46.758284 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: [pid: 100791|app: 0|req: 2/3] 10.222.0.90 () {60 vars in 1291 bytes} [Fri Oct 29 01:05:46 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:49.083089 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi [None req-acb5c75a-319a-4ce6-bc85-3777a5fb66ee None None] Calling method '>' {{(pid=100792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:49.084588 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: INFO nova.api.openstack.requestlog [None req-acb5c75a-319a-4ce6-bc85-3777a5fb66ee None None] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002391 Oct 29 01:05:49.090744 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: [pid: 100792|app: 0|req: 2/4] 10.222.0.90 () {54 vars in 930 bytes} [Fri Oct 29 01:05:49 2021] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:49.151273 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi [None req-0fe843c8-04c1-4900-a5b0-f47e3ecdb553 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 256, "name": "cirros256", "vcpus": 1, "id": "c1", "disk": 1, "rxtx_factor": 1.0, "swap": 0}} {{(pid=100791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:49.171910 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:05:49.171910 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: warnings.warn(msg) Oct 29 01:05:49.203530 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: INFO nova.api.openstack.requestlog [None req-0fe843c8-04c1-4900-a5b0-f47e3ecdb553 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.111689 Oct 29 01:05:49.204554 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: [pid: 100791|app: 0|req: 3/5] 10.222.0.90 () {64 vars in 1282 bytes} [Fri Oct 29 01:05:49 2021] POST /compute/v2.1/flavors => generated 407 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:05:49.426154 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi [None req-a30ff38d-4825-44e4-8e1e-97c29d2e36a3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:49.428512 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:05:49.428512 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: warnings.warn(msg) Oct 29 01:05:49.481920 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: INFO nova.api.openstack.requestlog [None req-a30ff38d-4825-44e4-8e1e-97c29d2e36a3 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.268663 Oct 29 01:05:49.495187 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: [pid: 100792|app: 0|req: 3/6] 10.222.0.90 () {64 vars in 1335 bytes} [Fri Oct 29 01:05:49 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:05:51.800988 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi [None req-0fe843c8-04c1-4900-a5b0-f47e3ecdb553 admin admin] Calling method '>' {{(pid=100791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:51.801903 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: INFO nova.api.openstack.requestlog [None req-0fe843c8-04c1-4900-a5b0-f47e3ecdb553 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Oct 29 01:05:51.802623 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: [pid: 100791|app: 0|req: 4/7] 10.222.0.90 () {54 vars in 930 bytes} [Fri Oct 29 01:05:51 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:51.924189 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi [None req-998573e6-b6be-44f4-bd51-d9590e055eb9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "swap": 0, "ram": 512, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "name": "ds512M", "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=100792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:51.944035 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:05:51.944035 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: warnings.warn(msg) Oct 29 01:05:51.973585 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: INFO nova.api.openstack.requestlog [None req-998573e6-b6be-44f4-bd51-d9590e055eb9 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.163329 Oct 29 01:05:51.974376 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: [pid: 100792|app: 0|req: 4/8] 10.222.0.90 () {64 vars in 1282 bytes} [Fri Oct 29 01:05:51 2021] POST /compute/v2.1/flavors => generated 404 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:05:51.988527 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi [None req-d2bf4da7-df72-4d63-827d-c66071f10185 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:51.989915 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:05:51.989915 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: warnings.warn(msg) Oct 29 01:05:52.030887 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: INFO nova.api.openstack.requestlog [None req-d2bf4da7-df72-4d63-827d-c66071f10185 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047443 Oct 29 01:05:52.031643 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: [pid: 100791|app: 0|req: 5/9] 10.222.0.90 () {64 vars in 1335 bytes} [Fri Oct 29 01:05:51 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:05:54.398861 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi [None req-998573e6-b6be-44f4-bd51-d9590e055eb9 admin admin] Calling method '>' {{(pid=100792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:54.400188 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: INFO nova.api.openstack.requestlog [None req-998573e6-b6be-44f4-bd51-d9590e055eb9 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001803 Oct 29 01:05:54.400691 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: [pid: 100792|app: 0|req: 5/10] 10.222.0.90 () {54 vars in 930 bytes} [Fri Oct 29 01:05:54 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:54.461817 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi [None req-764b259c-10c0-43f4-8c38-a2a9c860be0a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "name": "ds1G", "os-flavor-access:is_public": true, "disk": 10, "vcpus": 1, "ram": 1024}} {{(pid=100791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:54.481306 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: INFO nova.api.openstack.requestlog [None req-764b259c-10c0-43f4-8c38-a2a9c860be0a admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074140 Oct 29 01:05:54.481840 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: [pid: 100791|app: 0|req: 6/11] 10.222.0.90 () {64 vars in 1282 bytes} [Fri Oct 29 01:05:54 2021] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:05:54.494031 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi [None req-80f9b141-5420-46d7-8584-b406a3214651 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:54.522722 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: INFO nova.api.openstack.requestlog [None req-80f9b141-5420-46d7-8584-b406a3214651 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032224 Oct 29 01:05:54.523979 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: [pid: 100792|app: 0|req: 6/12] 10.222.0.90 () {64 vars in 1335 bytes} [Fri Oct 29 01:05:54 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:56.863697 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi [None req-764b259c-10c0-43f4-8c38-a2a9c860be0a admin admin] Calling method '>' {{(pid=100791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:56.864774 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: INFO nova.api.openstack.requestlog [None req-764b259c-10c0-43f4-8c38-a2a9c860be0a admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Oct 29 01:05:56.865177 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: [pid: 100791|app: 0|req: 7/13] 10.222.0.90 () {54 vars in 930 bytes} [Fri Oct 29 01:05:56 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:56.926005 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi [None req-ca529471-c5e2-4c6e-bb67-13ffe58e096e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 2048, "disk": 10, "id": "d3", "vcpus": 2, "name": "ds2G", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=100792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:56.944989 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: INFO nova.api.openstack.requestlog [None req-ca529471-c5e2-4c6e-bb67-13ffe58e096e admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073080 Oct 29 01:05:56.945530 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: [pid: 100792|app: 0|req: 7/14] 10.222.0.90 () {64 vars in 1282 bytes} [Fri Oct 29 01:05:56 2021] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:05:56.967973 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi [None req-3221cc6d-6657-43eb-b7fb-4e77e1053daa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:57.012407 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: INFO nova.api.openstack.requestlog [None req-3221cc6d-6657-43eb-b7fb-4e77e1053daa admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.055764 Oct 29 01:05:57.012980 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: [pid: 100791|app: 0|req: 8/15] 10.222.0.90 () {64 vars in 1335 bytes} [Fri Oct 29 01:05:56 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:59.313735 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi [None req-ca529471-c5e2-4c6e-bb67-13ffe58e096e admin admin] Calling method '>' {{(pid=100792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:59.314873 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: INFO nova.api.openstack.requestlog [None req-ca529471-c5e2-4c6e-bb67-13ffe58e096e admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Oct 29 01:05:59.315280 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: [pid: 100792|app: 0|req: 8/16] 10.222.0.90 () {54 vars in 930 bytes} [Fri Oct 29 01:05:59 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:59.377492 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi [None req-6034cf51-3f8d-4224-89b0-6f81b9ab504d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "d4", "name": "ds4G", "vcpus": 4, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=100791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:59.397576 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: INFO nova.api.openstack.requestlog [None req-6034cf51-3f8d-4224-89b0-6f81b9ab504d admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075091 Oct 29 01:05:59.398913 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: [pid: 100791|app: 0|req: 9/17] 10.222.0.90 () {64 vars in 1282 bytes} [Fri Oct 29 01:05:59 2021] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:05:59.411175 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi [None req-dffbd4a1-ca5c-4f2e-8bbd-4995a57bbcb3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:59.434359 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: INFO nova.api.openstack.requestlog [None req-dffbd4a1-ca5c-4f2e-8bbd-4995a57bbcb3 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027279 Oct 29 01:05:59.434954 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: [pid: 100792|app: 0|req: 9/18] 10.222.0.90 () {64 vars in 1335 bytes} [Fri Oct 29 01:05:59 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:01.754755 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi [None req-6034cf51-3f8d-4224-89b0-6f81b9ab504d admin admin] Calling method '>' {{(pid=100791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:01.755755 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: INFO nova.api.openstack.requestlog [None req-6034cf51-3f8d-4224-89b0-6f81b9ab504d admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Oct 29 01:06:01.756159 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: [pid: 100791|app: 0|req: 10/19] 10.222.0.90 () {54 vars in 930 bytes} [Fri Oct 29 01:06:01 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:06:01.816831 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi [None req-68df7ca3-31db-4bd4-8e9c-43a188637553 admin admin] Calling method '>' {{(pid=100792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:01.839905 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: INFO nova.api.openstack.requestlog [None req-68df7ca3-31db-4bd4-8e9c-43a188637553 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.077081 Oct 29 01:06:01.840445 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: [pid: 100792|app: 0|req: 10/20] 10.222.0.90 () {60 vars in 1291 bytes} [Fri Oct 29 01:06:01 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:06:04.131153 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi [None req-6034cf51-3f8d-4224-89b0-6f81b9ab504d admin admin] Calling method '>' {{(pid=100791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:04.132184 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: INFO nova.api.openstack.requestlog [None req-6034cf51-3f8d-4224-89b0-6f81b9ab504d admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Oct 29 01:06:04.132573 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: [pid: 100791|app: 0|req: 11/21] 10.222.0.90 () {54 vars in 930 bytes} [Fri Oct 29 01:06:04 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:06:04.190563 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi [None req-671be89f-89a9-4ed5-8773-11198eb2e653 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.tiny", "id": "1", "ram": 512}} {{(pid=100792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:06:04.209392 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: INFO nova.api.openstack.requestlog [None req-671be89f-89a9-4ed5-8773-11198eb2e653 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.070326 Oct 29 01:06:04.210169 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: [pid: 100792|app: 0|req: 11/22] 10.222.0.90 () {64 vars in 1282 bytes} [Fri Oct 29 01:06:04 2021] POST /compute/v2.1/flavors => generated 402 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:06:04.222719 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi [None req-47e7d0c9-929e-4ad0-8636-3eabc7967233 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:06:04.245507 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: INFO nova.api.openstack.requestlog [None req-47e7d0c9-929e-4ad0-8636-3eabc7967233 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026900 Oct 29 01:06:04.246071 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: [pid: 100791|app: 0|req: 12/23] 10.222.0.90 () {64 vars in 1332 bytes} [Fri Oct 29 01:06:04 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:06.541880 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi [None req-671be89f-89a9-4ed5-8773-11198eb2e653 admin admin] Calling method '>' {{(pid=100792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:06.542944 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: INFO nova.api.openstack.requestlog [None req-671be89f-89a9-4ed5-8773-11198eb2e653 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Oct 29 01:06:06.543344 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: [pid: 100792|app: 0|req: 12/24] 10.222.0.90 () {54 vars in 930 bytes} [Fri Oct 29 01:06:06 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:06:06.605456 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi [None req-d78b5336-ab3d-4518-9a6d-e909e28d4254 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "vcpus": 1, "rxtx_factor": 1.0, "disk": 20, "os-flavor-access:is_public": true, "id": "2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small"}} {{(pid=100791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:06:06.622903 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: INFO nova.api.openstack.requestlog [None req-d78b5336-ab3d-4518-9a6d-e909e28d4254 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071326 Oct 29 01:06:06.623455 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: [pid: 100791|app: 0|req: 13/25] 10.222.0.90 () {64 vars in 1282 bytes} [Fri Oct 29 01:06:06 2021] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:06:06.637188 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi [None req-c80da4a3-708d-452e-a528-bad9d2305601 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:06:06.664456 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: INFO nova.api.openstack.requestlog [None req-c80da4a3-708d-452e-a528-bad9d2305601 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032068 Oct 29 01:06:06.665365 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: [pid: 100792|app: 0|req: 13/26] 10.222.0.90 () {64 vars in 1332 bytes} [Fri Oct 29 01:06:06 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:09.016920 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi [None req-d78b5336-ab3d-4518-9a6d-e909e28d4254 admin admin] Calling method '>' {{(pid=100791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:09.017914 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: INFO nova.api.openstack.requestlog [None req-d78b5336-ab3d-4518-9a6d-e909e28d4254 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Oct 29 01:06:09.018309 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: [pid: 100791|app: 0|req: 14/27] 10.222.0.90 () {54 vars in 930 bytes} [Fri Oct 29 01:06:09 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:06:09.083142 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi [None req-43bcc8ca-a1e8-4626-89aa-1d0940925d8f admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 2, "ram": 4096, "swap": 0, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "name": "m1.medium"}} {{(pid=100792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:06:09.101229 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: INFO nova.api.openstack.requestlog [None req-43bcc8ca-a1e8-4626-89aa-1d0940925d8f admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.076535 Oct 29 01:06:09.101782 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: [pid: 100792|app: 0|req: 14/28] 10.222.0.90 () {64 vars in 1282 bytes} [Fri Oct 29 01:06:09 2021] POST /compute/v2.1/flavors => generated 406 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:06:09.114033 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi [None req-111c85cd-b65d-4c30-923b-48d19e116cd1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:06:09.135748 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: INFO nova.api.openstack.requestlog [None req-111c85cd-b65d-4c30-923b-48d19e116cd1 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025267 Oct 29 01:06:09.136299 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: [pid: 100791|app: 0|req: 15/29] 10.222.0.90 () {64 vars in 1332 bytes} [Fri Oct 29 01:06:09 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:11.475123 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi [None req-43bcc8ca-a1e8-4626-89aa-1d0940925d8f admin admin] Calling method '>' {{(pid=100792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:11.476806 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: INFO nova.api.openstack.requestlog [None req-43bcc8ca-a1e8-4626-89aa-1d0940925d8f admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002411 Oct 29 01:06:11.477360 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: [pid: 100792|app: 0|req: 15/30] 10.222.0.90 () {54 vars in 930 bytes} [Fri Oct 29 01:06:11 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:06:11.538260 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi [None req-daa82296-408f-43e8-9fb7-1b52189b57e1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "vcpus": 4, "disk": 80, "ram": 8192}} {{(pid=100791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:06:11.556519 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: INFO nova.api.openstack.requestlog [None req-daa82296-408f-43e8-9fb7-1b52189b57e1 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072381 Oct 29 01:06:11.556978 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: [pid: 100791|app: 0|req: 16/31] 10.222.0.90 () {64 vars in 1282 bytes} [Fri Oct 29 01:06:11 2021] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:06:11.569911 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi [None req-b0709ba1-8059-4eaa-affc-8ea077e0846b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:06:11.595871 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: INFO nova.api.openstack.requestlog [None req-b0709ba1-8059-4eaa-affc-8ea077e0846b admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029351 Oct 29 01:06:11.596447 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: [pid: 100792|app: 0|req: 16/32] 10.222.0.90 () {64 vars in 1332 bytes} [Fri Oct 29 01:06:11 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:13.946958 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi [None req-daa82296-408f-43e8-9fb7-1b52189b57e1 admin admin] Calling method '>' {{(pid=100791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:13.948533 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: INFO nova.api.openstack.requestlog [None req-daa82296-408f-43e8-9fb7-1b52189b57e1 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002030 Oct 29 01:06:13.949137 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: [pid: 100791|app: 0|req: 17/33] 10.222.0.90 () {54 vars in 930 bytes} [Fri Oct 29 01:06:13 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:06:14.020928 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi [None req-0036aef1-cfcc-4dac-960c-11d40db6f10b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "disk": 160, "swap": 0, "vcpus": 8, "ram": 16384, "rxtx_factor": 1.0, "id": "5", "os-flavor-access:is_public": true}} {{(pid=100792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:06:14.041264 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: INFO nova.api.openstack.requestlog [None req-0036aef1-cfcc-4dac-960c-11d40db6f10b admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.079940 Oct 29 01:06:14.042162 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: [pid: 100792|app: 0|req: 17/34] 10.222.0.90 () {64 vars in 1282 bytes} [Fri Oct 29 01:06:13 2021] POST /compute/v2.1/flavors => generated 408 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:06:14.053993 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi [None req-4bdf0752-5237-477d-afec-8e77ad4e3f11 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:06:14.079729 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: INFO nova.api.openstack.requestlog [None req-4bdf0752-5237-477d-afec-8e77ad4e3f11 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029253 Oct 29 01:06:14.082826 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: [pid: 100791|app: 0|req: 18/35] 10.222.0.90 () {64 vars in 1332 bytes} [Fri Oct 29 01:06:14 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:53.726051 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi [None req-0036aef1-cfcc-4dac-960c-11d40db6f10b admin admin] Calling method '>' {{(pid=100792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:53.727162 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: INFO nova.api.openstack.requestlog [None req-0036aef1-cfcc-4dac-960c-11d40db6f10b admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Oct 29 01:06:53.727561 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: [pid: 100792|app: 0|req: 18/36] 10.222.0.90 () {54 vars in 930 bytes} [Fri Oct 29 01:06:53 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:06:53.787562 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi [None req-cd7cd86b-81c0-4d36-8628-89eb371b23f8 admin admin] Calling method '>' {{(pid=100791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:53.803879 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: INFO nova.api.openstack.requestlog [None req-cd7cd86b-81c0-4d36-8628-89eb371b23f8 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069780 Oct 29 01:06:53.804411 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: [pid: 100791|app: 0|req: 19/37] 10.222.0.90 () {60 vars in 1291 bytes} [Fri Oct 29 01:06:53 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:06:55.324680 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi [None req-0036aef1-cfcc-4dac-960c-11d40db6f10b admin admin] Calling method '>' {{(pid=100792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:55.325803 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: INFO nova.api.openstack.requestlog [None req-0036aef1-cfcc-4dac-960c-11d40db6f10b admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002060 Oct 29 01:06:55.326201 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: [pid: 100792|app: 0|req: 19/38] 10.222.0.90 () {56 vars in 1074 bytes} [Fri Oct 29 01:06:55 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:06:55.520800 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi [None req-8932b867-855a-4340-8f98-7ea1ff26e093 admin admin] Calling method '>' {{(pid=100791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:55.526162 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: INFO nova.api.openstack.wsgi [None req-8932b867-855a-4340-8f98-7ea1ff26e093 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 29 01:06:55.526771 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi [None req-8932b867-855a-4340-8f98-7ea1ff26e093 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=100791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:06:55.528044 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: INFO nova.api.openstack.requestlog [None req-8932b867-855a-4340-8f98-7ea1ff26e093 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.060014 Oct 29 01:06:55.528537 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: [pid: 100791|app: 0|req: 20/39] 10.222.0.90 () {60 vars in 1190 bytes} [Fri Oct 29 01:06:55 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 29 01:06:55.538216 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi [None req-a4b3f7b9-4c0e-47bf-ae1d-175be5305c43 admin admin] Calling method '>' {{(pid=100792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:55.558875 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: INFO nova.api.openstack.requestlog [None req-a4b3f7b9-4c0e-47bf-ae1d-175be5305c43 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024256 Oct 29 01:06:55.559406 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: [pid: 100792|app: 0|req: 20/40] 10.222.0.90 () {60 vars in 1210 bytes} [Fri Oct 29 01:06:55 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:06:55.569204 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi [None req-e4f5da35-381c-466c-bb54-b7c1dfa1cbef admin admin] Calling method '>' {{(pid=100791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:55.589306 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: INFO nova.api.openstack.requestlog [None req-e4f5da35-381c-466c-bb54-b7c1dfa1cbef admin admin] 10.222.0.90 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023571 Oct 29 01:06:55.590318 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: [pid: 100791|app: 0|req: 21/41] 10.222.0.90 () {60 vars in 1210 bytes} [Fri Oct 29 01:06:55 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:06:55.600222 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi [None req-e70d3c59-b154-4258-9763-4283a7e02439 admin admin] Calling method '>' {{(pid=100792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:55.606024 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: INFO nova.api.openstack.wsgi [None req-e70d3c59-b154-4258-9763-4283a7e02439 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 29 01:06:55.606625 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi [None req-e70d3c59-b154-4258-9763-4283a7e02439 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=100792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:06:55.607397 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: INFO nova.api.openstack.requestlog [None req-e70d3c59-b154-4258-9763-4283a7e02439 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011070 Oct 29 01:06:55.607869 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: [pid: 100792|app: 0|req: 21/42] 10.222.0.90 () {60 vars in 1190 bytes} [Fri Oct 29 01:06:55 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 29 01:06:57.010602 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi [None req-e4f5da35-381c-466c-bb54-b7c1dfa1cbef admin admin] Calling method '>' {{(pid=100791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:57.011624 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: INFO nova.api.openstack.requestlog [None req-e4f5da35-381c-466c-bb54-b7c1dfa1cbef admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Oct 29 01:06:57.012045 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: [pid: 100791|app: 0|req: 22/43] 10.222.0.90 () {56 vars in 1074 bytes} [Fri Oct 29 01:06:57 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:06:57.212170 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi [None req-1a0df5e2-4519-4905-937d-89a83b4c772c admin admin] Calling method '>' {{(pid=100792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:57.217784 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: INFO nova.api.openstack.wsgi [None req-1a0df5e2-4519-4905-937d-89a83b4c772c admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 29 01:06:57.218339 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi [None req-1a0df5e2-4519-4905-937d-89a83b4c772c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=100792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:06:57.219143 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: INFO nova.api.openstack.requestlog [None req-1a0df5e2-4519-4905-937d-89a83b4c772c admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058808 Oct 29 01:06:57.219634 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: [pid: 100792|app: 0|req: 22/44] 10.222.0.90 () {60 vars in 1190 bytes} [Fri Oct 29 01:06:57 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 29 01:06:57.229652 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi [None req-607fbbdc-8ee3-43ca-8ec3-15221f8445d1 admin admin] Calling method '>' {{(pid=100791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:57.243106 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: INFO nova.api.openstack.requestlog [None req-607fbbdc-8ee3-43ca-8ec3-15221f8445d1 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016971 Oct 29 01:06:57.243618 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: [pid: 100791|app: 0|req: 23/45] 10.222.0.90 () {60 vars in 1210 bytes} [Fri Oct 29 01:06:57 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:06:57.253685 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi [None req-bf637ee5-894f-4f11-ad46-4eaae57207c3 admin admin] Calling method '>' {{(pid=100792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:57.266634 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: INFO nova.api.openstack.requestlog [None req-bf637ee5-894f-4f11-ad46-4eaae57207c3 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016261 Oct 29 01:06:57.267136 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: [pid: 100792|app: 0|req: 23/46] 10.222.0.90 () {60 vars in 1210 bytes} [Fri Oct 29 01:06:57 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:06:57.276668 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi [None req-62af5426-31f3-4c58-90ad-bee215923450 admin admin] Calling method '>' {{(pid=100791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:57.281765 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: INFO nova.api.openstack.wsgi [None req-62af5426-31f3-4c58-90ad-bee215923450 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 29 01:06:57.282328 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi [None req-62af5426-31f3-4c58-90ad-bee215923450 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=100791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:06:57.283137 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: INFO nova.api.openstack.requestlog [None req-62af5426-31f3-4c58-90ad-bee215923450 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.009908 Oct 29 01:06:57.283611 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: [pid: 100791|app: 0|req: 24/47] 10.222.0.90 () {60 vars in 1190 bytes} [Fri Oct 29 01:06:57 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 29 01:06:58.697156 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi [None req-bf637ee5-894f-4f11-ad46-4eaae57207c3 admin admin] Calling method '>' {{(pid=100792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:58.698147 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: INFO nova.api.openstack.requestlog [None req-bf637ee5-894f-4f11-ad46-4eaae57207c3 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001402 Oct 29 01:06:58.698790 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: [pid: 100792|app: 0|req: 24/48] 10.222.0.90 () {56 vars in 1074 bytes} [Fri Oct 29 01:06:58 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:06:58.888515 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi [None req-d3d3384a-9ffd-4e88-8fa7-247868aeb61e admin admin] Calling method '>' {{(pid=100791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:58.893971 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: INFO nova.api.openstack.wsgi [None req-d3d3384a-9ffd-4e88-8fa7-247868aeb61e admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 29 01:06:58.894569 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi [None req-d3d3384a-9ffd-4e88-8fa7-247868aeb61e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=100791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:06:58.895338 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: INFO nova.api.openstack.requestlog [None req-d3d3384a-9ffd-4e88-8fa7-247868aeb61e admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057983 Oct 29 01:06:58.895820 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: [pid: 100791|app: 0|req: 25/49] 10.222.0.90 () {60 vars in 1193 bytes} [Fri Oct 29 01:06:58 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 29 01:06:58.905986 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi [None req-6c3acd24-d60e-42f0-8bb0-a4813ad53518 admin admin] Calling method '>' {{(pid=100792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:58.919198 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: INFO nova.api.openstack.requestlog [None req-6c3acd24-d60e-42f0-8bb0-a4813ad53518 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017326 Oct 29 01:06:58.919728 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: [pid: 100792|app: 0|req: 25/50] 10.222.0.90 () {60 vars in 1210 bytes} [Fri Oct 29 01:06:58 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:06:58.929200 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi [None req-3deb16cc-4bc5-4243-8e32-070b79de7c2a admin admin] Calling method '>' {{(pid=100791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:58.942198 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: INFO nova.api.openstack.requestlog [None req-3deb16cc-4bc5-4243-8e32-070b79de7c2a admin admin] 10.222.0.90 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016375 Oct 29 01:06:58.942775 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: [pid: 100791|app: 0|req: 26/51] 10.222.0.90 () {60 vars in 1210 bytes} [Fri Oct 29 01:06:58 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:06:58.952670 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi [None req-d9a7dc9a-fd1f-4d61-bda6-160ad7f6002e admin admin] Calling method '>' {{(pid=100792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:58.958331 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: INFO nova.api.openstack.wsgi [None req-d9a7dc9a-fd1f-4d61-bda6-160ad7f6002e admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 29 01:06:58.959003 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi [None req-d9a7dc9a-fd1f-4d61-bda6-160ad7f6002e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=100792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:06:58.959789 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: INFO nova.api.openstack.requestlog [None req-d9a7dc9a-fd1f-4d61-bda6-160ad7f6002e admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011038 Oct 29 01:06:58.960291 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: [pid: 100792|app: 0|req: 26/52] 10.222.0.90 () {60 vars in 1193 bytes} [Fri Oct 29 01:06:58 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 29 01:07:00.364074 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi [None req-3deb16cc-4bc5-4243-8e32-070b79de7c2a admin admin] Calling method '>' {{(pid=100791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:00.365142 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: INFO nova.api.openstack.requestlog [None req-3deb16cc-4bc5-4243-8e32-070b79de7c2a admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Oct 29 01:07:00.365629 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: [pid: 100791|app: 0|req: 27/53] 10.222.0.90 () {56 vars in 1074 bytes} [Fri Oct 29 01:07:00 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:07:00.556163 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi [None req-fdcb078e-c96e-4a61-8fbc-6004a627cd7b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:07:00.573949 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: INFO nova.api.openstack.requestlog [None req-fdcb078e-c96e-4a61-8fbc-6004a627cd7b admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069930 Oct 29 01:07:00.574427 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: [pid: 100792|app: 0|req: 27/54] 10.222.0.90 () {64 vars in 1235 bytes} [Fri Oct 29 01:07:00 2021] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:07:02.010475 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi [None req-3deb16cc-4bc5-4243-8e32-070b79de7c2a admin admin] Calling method '>' {{(pid=100791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:02.011989 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: INFO nova.api.openstack.requestlog [None req-3deb16cc-4bc5-4243-8e32-070b79de7c2a admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Oct 29 01:07:02.012388 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: [pid: 100791|app: 0|req: 28/55] 10.222.0.90 () {56 vars in 1074 bytes} [Fri Oct 29 01:07:02 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:07:02.204214 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi [None req-f388316d-5ce9-4127-ba46-ef80d375cbc9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:07:02.221441 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: INFO nova.api.openstack.requestlog [None req-f388316d-5ce9-4127-ba46-ef80d375cbc9 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.070605 Oct 29 01:07:02.222262 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: [pid: 100792|app: 0|req: 28/56] 10.222.0.90 () {64 vars in 1235 bytes} [Fri Oct 29 01:07:02 2021] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:07:03.629998 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi [None req-3deb16cc-4bc5-4243-8e32-070b79de7c2a admin admin] Calling method '>' {{(pid=100791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:03.631032 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: INFO nova.api.openstack.requestlog [None req-3deb16cc-4bc5-4243-8e32-070b79de7c2a admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Oct 29 01:07:03.631418 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: [pid: 100791|app: 0|req: 29/57] 10.222.0.90 () {56 vars in 1074 bytes} [Fri Oct 29 01:07:03 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:07:03.823298 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi [None req-602f968a-5f19-410c-b608-b9148a4e4281 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:07:03.840919 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: INFO nova.api.openstack.requestlog [None req-602f968a-5f19-410c-b608-b9148a4e4281 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068624 Oct 29 01:07:03.841381 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: [pid: 100792|app: 0|req: 29/58] 10.222.0.90 () {64 vars in 1235 bytes} [Fri Oct 29 01:07:03 2021] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:07:05.247343 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi [None req-3deb16cc-4bc5-4243-8e32-070b79de7c2a admin admin] Calling method '>' {{(pid=100791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:05.248334 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: INFO nova.api.openstack.requestlog [None req-3deb16cc-4bc5-4243-8e32-070b79de7c2a admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001396 Oct 29 01:07:05.248726 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: [pid: 100791|app: 0|req: 30/59] 10.222.0.90 () {56 vars in 1074 bytes} [Fri Oct 29 01:07:05 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:07:05.442886 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi [None req-15db29a3-50cf-43ef-b652-9a33814f6aba admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:07:05.460200 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: INFO nova.api.openstack.requestlog [None req-15db29a3-50cf-43ef-b652-9a33814f6aba admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069608 Oct 29 01:07:05.460690 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: [pid: 100792|app: 0|req: 30/60] 10.222.0.90 () {64 vars in 1235 bytes} [Fri Oct 29 01:07:05 2021] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:07:06.876493 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi [None req-3deb16cc-4bc5-4243-8e32-070b79de7c2a admin admin] Calling method '>' {{(pid=100791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:06.877539 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: INFO nova.api.openstack.requestlog [None req-3deb16cc-4bc5-4243-8e32-070b79de7c2a admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Oct 29 01:07:06.877920 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: [pid: 100791|app: 0|req: 31/61] 10.222.0.90 () {56 vars in 1074 bytes} [Fri Oct 29 01:07:06 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:07:07.065844 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi [None req-6b152f0a-8fe8-4b2b-8a35-1a91c6a04e31 admin admin] Calling method '>' {{(pid=100792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:07.084989 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: INFO nova.api.openstack.requestlog [None req-6b152f0a-8fe8-4b2b-8a35-1a91c6a04e31 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069694 Oct 29 01:07:07.085456 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: [pid: 100792|app: 0|req: 31/62] 10.222.0.90 () {60 vars in 1202 bytes} [Fri Oct 29 01:07:07 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:07:53.150285 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi [None req-3deb16cc-4bc5-4243-8e32-070b79de7c2a admin admin] Calling method '>' {{(pid=100791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:53.151307 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: INFO nova.api.openstack.requestlog [None req-3deb16cc-4bc5-4243-8e32-070b79de7c2a admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Oct 29 01:07:53.151692 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: [pid: 100791|app: 0|req: 32/63] 10.222.0.90 () {54 vars in 930 bytes} [Fri Oct 29 01:07:53 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:07:53.209619 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi [None req-7cce5a25-5d3a-4f43-a141-9cca8deb5c3a admin admin] Calling method '>' {{(pid=100792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:53.228695 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: INFO nova.api.openstack.requestlog [None req-7cce5a25-5d3a-4f43-a141-9cca8deb5c3a admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070663 Oct 29 01:07:53.229217 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: [pid: 100792|app: 0|req: 32/64] 10.222.0.90 () {60 vars in 1291 bytes} [Fri Oct 29 01:07:53 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:07:53.251345 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi [None req-ed1b48ff-5275-4cc8-a672-3389894f3f67 admin admin] Calling method '>' {{(pid=100791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:53.259485 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: INFO nova.api.openstack.requestlog [None req-ed1b48ff-5275-4cc8-a672-3389894f3f67 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011661 Oct 29 01:07:53.259994 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: [pid: 100791|app: 0|req: 33/65] 10.222.0.90 () {60 vars in 1282 bytes} [Fri Oct 29 01:07:53 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:53.271618 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi [None req-d1eb8786-55f6-466d-83e8-695536e8c017 admin admin] Calling method '>' {{(pid=100792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:53.279116 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: INFO nova.api.openstack.requestlog [None req-d1eb8786-55f6-466d-83e8-695536e8c017 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010918 Oct 29 01:07:53.279650 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: [pid: 100792|app: 0|req: 33/66] 10.222.0.90 () {60 vars in 1285 bytes} [Fri Oct 29 01:07:53 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:53.290877 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi [None req-6a303441-bb4d-4b10-a2f1-b40ef99c29a9 admin admin] Calling method '>' {{(pid=100791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:53.298066 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: INFO nova.api.openstack.requestlog [None req-6a303441-bb4d-4b10-a2f1-b40ef99c29a9 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010525 Oct 29 01:07:53.298602 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: [pid: 100791|app: 0|req: 34/67] 10.222.0.90 () {60 vars in 1285 bytes} [Fri Oct 29 01:07:53 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:07:53.310533 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi [None req-2b47018c-09a6-426c-98bb-cce4edfc7899 admin admin] Calling method '>' {{(pid=100792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:53.317857 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: INFO nova.api.openstack.requestlog [None req-2b47018c-09a6-426c-98bb-cce4edfc7899 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010736 Oct 29 01:07:53.318368 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: [pid: 100792|app: 0|req: 34/68] 10.222.0.90 () {60 vars in 1282 bytes} [Fri Oct 29 01:07:53 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:12.345273 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi [None req-1621eb08-b5e4-46a0-91d5-d694b9e4ce3e tempest-verify_tempest_config-1850247232 tempest-verify_tempest_config-1850247232-project] Calling method '>' {{(pid=100791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:12.347249 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: INFO nova.api.openstack.requestlog [None req-1621eb08-b5e4-46a0-91d5-d694b9e4ce3e tempest-verify_tempest_config-1850247232 tempest-verify_tempest_config-1850247232-project] 10.222.0.90 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.105858 Oct 29 01:09:12.347767 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: [pid: 100791|app: 0|req: 35/69] 10.222.0.90 () {58 vars in 1133 bytes} [Fri Oct 29 01:09:12 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:10:42.772294 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi [None req-2b47018c-09a6-426c-98bb-cce4edfc7899 admin admin] Calling method '>' {{(pid=100792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:42.773292 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: INFO nova.api.openstack.requestlog [None req-2b47018c-09a6-426c-98bb-cce4edfc7899 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Oct 29 01:10:42.773680 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: [pid: 100792|app: 0|req: 35/70] 10.222.0.90 () {56 vars in 1074 bytes} [Fri Oct 29 01:10:42 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:10:43.025962 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi [None req-ea7cde6f-aa4a-433d-bc9d-7454cd2e323e admin admin] Calling method '>' {{(pid=100791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:43.027195 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:10:43.027195 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: warnings.warn(msg) Oct 29 01:10:43.028697 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG oslo_concurrency.lockutils [None req-ea7cde6f-aa4a-433d-bc9d-7454cd2e323e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:10:43.029133 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG oslo_concurrency.lockutils [None req-ea7cde6f-aa4a-433d-bc9d-7454cd2e323e admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:10:43.029943 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG oslo_concurrency.lockutils [None req-ea7cde6f-aa4a-433d-bc9d-7454cd2e323e admin admin] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:10:43.030362 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG oslo_concurrency.lockutils [None req-ea7cde6f-aa4a-433d-bc9d-7454cd2e323e admin admin] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:10:43.063630 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: INFO nova.api.openstack.requestlog [None req-ea7cde6f-aa4a-433d-bc9d-7454cd2e323e admin admin] 10.222.0.90 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.149636 Oct 29 01:10:43.064175 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: [pid: 100791|app: 0|req: 36/71] 10.222.0.90 () {60 vars in 1193 bytes} [Fri Oct 29 01:10:42 2021] GET /compute/v2.1/os-services => generated 791 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:10:44.489159 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi [None req-2b47018c-09a6-426c-98bb-cce4edfc7899 admin admin] Calling method '>' {{(pid=100792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:44.490702 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: INFO nova.api.openstack.requestlog [None req-2b47018c-09a6-426c-98bb-cce4edfc7899 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002017 Oct 29 01:10:44.491096 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: [pid: 100792|app: 0|req: 36/72] 10.222.0.90 () {56 vars in 1074 bytes} [Fri Oct 29 01:10:44 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:10:44.694092 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi [None req-d7ee6465-b482-4f9d-bca5-2be07525d2c1 admin admin] Calling method '>' {{(pid=100791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:44.695269 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:10:44.695269 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: warnings.warn(msg) Oct 29 01:10:44.696813 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG oslo_concurrency.lockutils [None req-d7ee6465-b482-4f9d-bca5-2be07525d2c1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:10:44.697245 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG oslo_concurrency.lockutils [None req-d7ee6465-b482-4f9d-bca5-2be07525d2c1 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:10:44.698062 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG oslo_concurrency.lockutils [None req-d7ee6465-b482-4f9d-bca5-2be07525d2c1 admin admin] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:10:44.698452 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG oslo_concurrency.lockutils [None req-d7ee6465-b482-4f9d-bca5-2be07525d2c1 admin admin] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:10:44.717020 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: INFO nova.api.openstack.requestlog [None req-d7ee6465-b482-4f9d-bca5-2be07525d2c1 admin admin] 10.222.0.90 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077489 Oct 29 01:10:44.717541 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: [pid: 100791|app: 0|req: 37/73] 10.222.0.90 () {60 vars in 1193 bytes} [Fri Oct 29 01:10:44 2021] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:10:56.578984 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi [None req-2b47018c-09a6-426c-98bb-cce4edfc7899 admin admin] Calling method '>' {{(pid=100792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:56.579987 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: INFO nova.api.openstack.requestlog [None req-2b47018c-09a6-426c-98bb-cce4edfc7899 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Oct 29 01:10:56.580383 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: [pid: 100792|app: 0|req: 37/74] 10.222.0.90 () {56 vars in 1074 bytes} [Fri Oct 29 01:10:56 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:10:56.771007 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi [None req-63f5b65a-bba0-4381-837a-9e904bb7dd26 admin admin] Calling method '>' {{(pid=100791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:56.772214 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:10:56.772214 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: warnings.warn(msg) Oct 29 01:10:56.773712 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG oslo_concurrency.lockutils [None req-63f5b65a-bba0-4381-837a-9e904bb7dd26 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:10:56.774150 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG oslo_concurrency.lockutils [None req-63f5b65a-bba0-4381-837a-9e904bb7dd26 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:10:56.774974 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG oslo_concurrency.lockutils [None req-63f5b65a-bba0-4381-837a-9e904bb7dd26 admin admin] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:10:56.775398 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG oslo_concurrency.lockutils [None req-63f5b65a-bba0-4381-837a-9e904bb7dd26 admin admin] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:10:56.799132 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: INFO nova.api.openstack.requestlog [None req-63f5b65a-bba0-4381-837a-9e904bb7dd26 admin admin] 10.222.0.90 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.078793 Oct 29 01:10:56.799596 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: [pid: 100791|app: 0|req: 38/75] 10.222.0.90 () {60 vars in 1193 bytes} [Fri Oct 29 01:10:56 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:10:58.219310 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: DEBUG nova.api.openstack.wsgi [None req-2b47018c-09a6-426c-98bb-cce4edfc7899 admin admin] Calling method '>' {{(pid=100792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:58.220293 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: INFO nova.api.openstack.requestlog [None req-2b47018c-09a6-426c-98bb-cce4edfc7899 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001682 Oct 29 01:10:58.220681 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: [pid: 100792|app: 0|req: 38/76] 10.222.0.90 () {56 vars in 1074 bytes} [Fri Oct 29 01:10:58 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:10:58.411857 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG nova.api.openstack.wsgi [None req-3dbbdce6-2411-4081-ac46-a01f2a74bbda admin admin] Calling method '>' {{(pid=100791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:58.413031 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:10:58.413031 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: warnings.warn(msg) Oct 29 01:10:58.414541 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG oslo_concurrency.lockutils [None req-3dbbdce6-2411-4081-ac46-a01f2a74bbda admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:10:58.414975 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG oslo_concurrency.lockutils [None req-3dbbdce6-2411-4081-ac46-a01f2a74bbda admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:10:58.415747 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG oslo_concurrency.lockutils [None req-3dbbdce6-2411-4081-ac46-a01f2a74bbda admin admin] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:10:58.416163 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: DEBUG oslo_concurrency.lockutils [None req-3dbbdce6-2411-4081-ac46-a01f2a74bbda admin admin] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:10:58.436987 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: INFO nova.api.openstack.requestlog [None req-3dbbdce6-2411-4081-ac46-a01f2a74bbda admin admin] 10.222.0.90 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.075605 Oct 29 01:10:58.437508 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: [pid: 100791|app: 0|req: 39/77] 10.222.0.90 () {60 vars in 1193 bytes} [Fri Oct 29 01:10:58 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:11:55.657463 dv-cinder-815582-5-iscsi devstack@n-api.service[100790]: Fri Oct 29 01:11:55 2021 - graceful shutdown triggered... Oct 29 01:11:55.657599 dv-cinder-815582-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 29 01:11:55.658521 dv-cinder-815582-5-iscsi devstack@n-api.service[100792]: Gracefully killing worker 2 (pid: 100792)... Oct 29 01:11:55.658966 dv-cinder-815582-5-iscsi devstack@n-api.service[100791]: Gracefully killing worker 1 (pid: 100791)... Oct 29 01:11:56.659610 dv-cinder-815582-5-iscsi devstack@n-api.service[100790]: worker 1 buried after 1 seconds Oct 29 01:11:56.660177 dv-cinder-815582-5-iscsi devstack@n-api.service[100790]: worker 2 buried after 1 seconds Oct 29 01:11:56.660177 dv-cinder-815582-5-iscsi devstack@n-api.service[100790]: goodbye to uWSGI. Oct 29 01:11:56.661208 dv-cinder-815582-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 29 01:11:56.661785 dv-cinder-815582-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 29 01:11:56.664662 dv-cinder-815582-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 29 01:11:56.674209 dv-cinder-815582-5-iscsi devstack@n-api.service[115728]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 29 01:11:56.676242 dv-cinder-815582-5-iscsi devstack@n-api.service[115728]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 29 01:11:56 2021] *** Oct 29 01:11:56.676242 dv-cinder-815582-5-iscsi devstack@n-api.service[115728]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 29 01:11:56.676242 dv-cinder-815582-5-iscsi devstack@n-api.service[115728]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 29 01:11:56.676242 dv-cinder-815582-5-iscsi devstack@n-api.service[115728]: nodename: dv-cinder-815582-5-iscsi Oct 29 01:11:56.676242 dv-cinder-815582-5-iscsi devstack@n-api.service[115728]: machine: x86_64 Oct 29 01:11:56.676242 dv-cinder-815582-5-iscsi devstack@n-api.service[115728]: clock source: unix Oct 29 01:11:56.676242 dv-cinder-815582-5-iscsi devstack@n-api.service[115728]: pcre jit disabled Oct 29 01:11:56.676242 dv-cinder-815582-5-iscsi devstack@n-api.service[115728]: detected number of CPU cores: 4 Oct 29 01:11:56.676242 dv-cinder-815582-5-iscsi devstack@n-api.service[115728]: current working directory: / Oct 29 01:11:56.676242 dv-cinder-815582-5-iscsi devstack@n-api.service[115728]: detected binary path: /usr/bin/uwsgi-core Oct 29 01:11:56.676242 dv-cinder-815582-5-iscsi devstack@n-api.service[115728]: your processes number limit is 47680 Oct 29 01:11:56.676984 dv-cinder-815582-5-iscsi devstack@n-api.service[115728]: your memory page size is 4096 bytes Oct 29 01:11:56.676984 dv-cinder-815582-5-iscsi devstack@n-api.service[115728]: detected max file descriptor number: 2048 Oct 29 01:11:56.676984 dv-cinder-815582-5-iscsi devstack@n-api.service[115728]: lock engine: pthread robust mutexes Oct 29 01:11:56.676984 dv-cinder-815582-5-iscsi devstack@n-api.service[115728]: thunder lock: enabled Oct 29 01:11:56.676984 dv-cinder-815582-5-iscsi devstack@n-api.service[115728]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 29 01:11:56.676984 dv-cinder-815582-5-iscsi devstack@n-api.service[115728]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 29 01:11:56.721961 dv-cinder-815582-5-iscsi devstack@n-api.service[115728]: Python main interpreter initialized at 0x558c0f2ce9c0 Oct 29 01:11:56.721961 dv-cinder-815582-5-iscsi devstack@n-api.service[115728]: python threads support enabled Oct 29 01:11:56.721961 dv-cinder-815582-5-iscsi devstack@n-api.service[115728]: your server socket listen backlog is limited to 100 connections Oct 29 01:11:56.721961 dv-cinder-815582-5-iscsi devstack@n-api.service[115728]: your mercy for graceful operations on workers is 90 seconds Oct 29 01:11:56.722434 dv-cinder-815582-5-iscsi devstack@n-api.service[115728]: mapped 403077 bytes (393 KB) for 2 cores Oct 29 01:11:56.722434 dv-cinder-815582-5-iscsi devstack@n-api.service[115728]: *** Operational MODE: preforking *** Oct 29 01:11:56.722716 dv-cinder-815582-5-iscsi devstack@n-api.service[115728]: *** uWSGI is running in multiple interpreter mode *** Oct 29 01:11:56.722716 dv-cinder-815582-5-iscsi devstack@n-api.service[115728]: spawned uWSGI master process (pid: 115728) Oct 29 01:11:56.722919 dv-cinder-815582-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 29 01:11:56.726465 dv-cinder-815582-5-iscsi devstack@n-api.service[115728]: spawned uWSGI worker 1 (pid: 115747, cores: 1) Oct 29 01:11:56.726465 dv-cinder-815582-5-iscsi devstack@n-api.service[115728]: spawned uWSGI worker 2 (pid: 115748, cores: 1) Oct 29 01:11:56.726465 dv-cinder-815582-5-iscsi devstack@n-api.service[115728]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 29 01:11:58.539145 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 01:11:58.539145 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: from cryptography.utils import int_from_bytes Oct 29 01:11:58.539831 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 01:11:58.539831 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: from cryptography.utils import int_from_bytes Oct 29 01:11:58.540995 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 01:11:58.540995 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: from cryptography.utils import int_from_bytes Oct 29 01:11:58.541517 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 01:11:58.541517 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: from cryptography.utils import int_from_bytes Oct 29 01:12:01.085200 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 29 01:12:01.085926 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 29 01:12:01.085926 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 29 01:12:01.086287 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 29 01:12:01.086509 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 29 01:12:01.086618 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 29 01:12:01.086983 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 29 01:12:01.087068 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.087150 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.087340 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 29 01:12:01.087500 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.087608 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 29 01:12:01.087779 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.087878 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 29 01:12:01.088106 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.088215 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.088417 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.088521 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.088736 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.088838 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.089060 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.089186 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.089389 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.089500 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.089665 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.089765 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.089959 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.090086 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.090284 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815582-5-iscsi {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.090416 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.090633 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.090799 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.090970 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.091201 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.091378 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.091558 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.091720 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815582-5-iscsi {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.091870 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.091870 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.092164 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.092164 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.092458 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.092608 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.093017 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.093193 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.094735 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.095057 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.095057 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.095494 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.095709 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.095928 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.095928 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.096361 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.096584 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.096791 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.097008 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.097222 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.097436 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.097665 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.097893 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.098109 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.098334 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.098564 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.098770 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.098983 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.099202 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.099416 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.099640 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815582-5-iscsi {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.099856 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.100042 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.100263 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.100428 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.100617 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.100790 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.100973 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815582-5-iscsi {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.101682 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.101853 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.102009 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.102162 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.102311 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.102496 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.102657 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.103042 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.103204 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.103347 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.103499 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.103791 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.103950 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.104104 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.104256 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.104406 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.104555 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.104705 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.104855 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.105010 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.105153 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.105313 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.105456 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.105646 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.105835 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.105987 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.106277 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.106462 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.106622 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.106792 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.107548 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.107761 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.107921 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.108076 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.108239 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.108395 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.108548 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.108691 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.108843 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.108994 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.109138 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.109294 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.109437 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.109581 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.109723 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.109877 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.110025 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.110182 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.110329 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.110556 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.110752 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.110911 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.111121 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.111669 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.111887 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.112036 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.112223 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.112437 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.112598 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.112742 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.112908 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.113224 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.113382 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.113532 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.113684 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.113847 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.114079 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.114235 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.114404 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.114578 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.114729 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.114888 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.115038 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.115187 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.115336 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.115495 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.115645 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.90 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.115797 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.116546 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.90 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.116710 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.116881 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.117167 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.117341 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.117489 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.90 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.120163 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.120357 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.90 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.120525 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.120689 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.120835 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.120989 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.121134 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.121286 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.121835 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.122099 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.122259 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.122458 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.122617 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.122769 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.122930 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.123088 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.123449 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.123600 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.123744 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.123894 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.124050 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.124326 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.124473 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.124624 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.124784 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.124934 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.125090 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.125240 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.125394 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.125546 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.125689 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.125841 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.126541 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.126698 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.126900 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.127045 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.127316 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.127469 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.127619 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.127762 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.127912 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.128055 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.128197 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.128898 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.129065 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.129217 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.129360 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.129508 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.129659 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.129892 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.130046 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.130201 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.130351 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.130581 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.130747 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.130895 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.130895 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.131328 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.131502 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.131966 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.132218 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.132376 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.132541 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.132685 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.132826 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.132968 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.133122 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.133268 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.133589 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.133748 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.133891 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.134043 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.134197 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.134342 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.134505 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.134660 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.134801 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.135589 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.135758 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.135909 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.136061 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.136204 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.136354 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.136513 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.136657 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.136799 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.136947 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.137090 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.137269 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.137503 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.137662 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.137812 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.137955 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.138103 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.138246 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.138443 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.138595 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.138738 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.138880 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.139032 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.139181 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.139343 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.139493 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.139643 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.139796 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.139939 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.140090 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.140240 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.140390 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.140554 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.140702 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.140853 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.140997 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.141148 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.141297 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.141440 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.141627 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.142697 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.142897 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.143044 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.143238 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.143385 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.143637 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.143879 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.144034 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.144177 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.144330 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:12:01.144508 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.144651 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.144807 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.144957 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.145101 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.145244 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.145393 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.145544 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.145806 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.145962 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.146122 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.146295 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.146463 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.146643 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.146809 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.146960 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.147116 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.147271 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.147420 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.147669 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.147828 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.147983 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.148123 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.148285 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.148507 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.148670 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.148825 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.148985 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.149135 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.149296 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.149453 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.149608 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.149766 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.149922 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.150078 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.150237 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.150418 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.150672 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.150826 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.150984 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.151133 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.151289 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.151438 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.151594 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.151744 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.151891 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.152040 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.152200 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.152370 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.152894 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.153054 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.153214 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.153365 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.153519 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.153764 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.154028 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.154186 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.154335 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.154510 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.154675 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.154838 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.154994 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.155161 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.155311 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.155458 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.155605 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.155765 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.156032 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.156188 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.156344 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.156500 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.156656 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.156818 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.156975 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.157153 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.157324 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.157475 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.157647 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.157881 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.158066 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.158224 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.158375 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.158585 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.158749 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.158910 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.159068 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.159216 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.159398 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.159550 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.159711 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.159869 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.160025 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.160181 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.160347 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.160498 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.161263 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.161434 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.161587 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.161743 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.161900 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.162062 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.162221 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.162379 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.162575 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.163672 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.163932 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.164217 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.164382 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.164382 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.164678 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.164678 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.164678 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.165103 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.165288 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.165447 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.165605 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.165756 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.165911 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.166094 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.166353 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.166585 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.166746 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.166895 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.167044 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.167206 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.167362 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.167362 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.167670 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.167820 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.168074 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.168229 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.168378 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.168378 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.168660 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.168660 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.168951 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.169101 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.169255 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.169415 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.169590 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.169865 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.170049 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.170219 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.170369 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.170550 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.170701 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.170864 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.171024 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.171183 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.171340 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.171489 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.171647 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.171810 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.171961 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.172109 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.172257 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.172411 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.172561 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.172723 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.173279 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.173865 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.174107 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.174361 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.174552 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.174729 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.174935 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.175101 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.175289 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.175443 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.175603 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.175761 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.175919 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.176069 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.176218 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.176384 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.176659 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.176825 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.177002 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.177153 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.177323 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.177475 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.177632 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.177789 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.177939 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.178107 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.178336 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.178515 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.178677 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.178838 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.179000 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.179160 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.179317 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.179473 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.179631 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.179781 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.179935 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.180095 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.180244 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.180407 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.180556 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.180712 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.180861 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.181027 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.181183 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.181347 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.181499 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.181654 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.181802 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.181950 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.182105 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.182263 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.182430 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.182603 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.182762 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.182911 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.183429 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.183602 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.183762 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.183912 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.184059 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.184301 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.184556 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.184794 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.184947 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.185103 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.185260 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.185410 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.185410 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.185725 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.185876 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.186031 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.186180 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.186327 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.186568 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.186907 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.187065 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.187213 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.187362 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.187510 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.187671 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.187828 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.187989 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.188146 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.188322 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.189061 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.189235 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.189386 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.189534 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.189689 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.189849 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.190012 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.190210 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.190369 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.190560 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.190720 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.190882 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.191041 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.191192 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.191348 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.191497 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.191653 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.191810 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.191972 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.192122 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.192270 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.192424 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.192591 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.192741 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.192898 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.193049 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.193552 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.193713 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.193863 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.194020 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.194185 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.194447 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.194711 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.194868 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.195019 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.195186 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.195337 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.195487 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.195641 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.195791 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.195939 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.196102 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.196251 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.196406 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.196556 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.196711 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.197426 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.197602 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.197766 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.197916 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.198064 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.198220 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.198377 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.198601 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.198759 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.198917 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.199084 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.199307 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.199476 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.199634 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.199790 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.199953 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.199953 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.200244 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.200403 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.200554 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.200701 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.200849 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.201004 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.201152 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.201314 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.201465 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.201613 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.201760 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.201929 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.202084 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.202246 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.202423 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.202581 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.203384 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.203908 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.204109 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.205235 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.205394 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.205556 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.205727 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.205877 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.205877 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.205877 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.206517 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.206694 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.206853 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.207065 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.207219 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.207409 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.207578 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.207784 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.207975 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.208223 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.208384 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.208542 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.208742 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.208899 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.209055 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.209212 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.209458 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.209621 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.209789 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.209944 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.210092 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.210259 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.210442 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.210609 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.210775 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.210775 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.211059 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.211215 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.211364 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.211525 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.211675 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.211825 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.211973 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.212128 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.212295 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.212454 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.212614 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.212771 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.212928 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.213097 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.213249 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.213249 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.213567 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.214099 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.214249 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.214429 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.214596 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.214790 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.215116 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.215271 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.215427 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.215591 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.215591 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.215893 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.216289 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.216458 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.216609 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.216756 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.216913 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.217076 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.217225 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.217539 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.217948 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.218118 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.218410 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.218550 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.218639 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.218738 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.218835 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.218928 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.219021 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.219106 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.219106 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.219271 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.219357 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.219462 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.219550 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.219634 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.219748 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.219848 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.219934 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.220017 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.220108 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.220201 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.220285 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.220378 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.220476 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.220561 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.220655 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.220740 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.220824 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.220906 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.220906 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.221058 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.221150 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.221236 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.221319 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.221319 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.221319 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.221554 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.221651 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.221737 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.221820 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.221903 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.221986 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.222081 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.222167 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.222250 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.222335 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.222456 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.222554 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.222648 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.222734 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.222814 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.222897 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.222988 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.223073 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.223165 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.223250 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.223340 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.223436 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.223527 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.223618 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.224043 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.224139 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.224222 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.224313 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.224398 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.224491 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.224584 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.224669 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.224764 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.224848 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.224931 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.225043 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.225287 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.225383 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.225469 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.225559 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.225652 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.225745 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.225836 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.225920 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.226011 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.226095 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.226179 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.226270 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.226354 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.226468 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.226562 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.226647 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.226739 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.226831 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.226916 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.227008 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.227092 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.227175 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.227267 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.227352 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.227436 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.227519 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.227609 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.227695 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.227787 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.227872 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.227957 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.228047 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.228138 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.228222 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.228318 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.228425 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.228512 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.228595 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.228679 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.228776 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.228863 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.228947 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.229030 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.229114 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.229197 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.229289 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.229390 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.229476 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.229560 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.230337 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.230451 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.230543 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.230638 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.230733 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.230825 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.230910 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.231013 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.231198 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.231298 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.231383 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.231466 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.231556 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.231654 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.231741 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.231832 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.231916 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.231999 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.232090 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.232183 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.232276 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.232369 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.232460 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.232545 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.232635 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.232728 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.232820 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.232906 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.232990 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.233079 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.233164 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.233259 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.233345 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.233436 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.233521 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.233605 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.233696 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.233781 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.233942 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.234252 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.234252 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.234570 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.234675 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.234761 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.234858 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.234944 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.235036 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.235120 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.235235 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.236020 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.236121 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.236213 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.236299 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.236389 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.236525 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.236611 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.236694 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.236777 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.236860 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.236952 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.237046 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.237137 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.237228 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.237321 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.237412 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.237505 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.237597 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.237682 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.237774 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.237859 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.237942 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.238035 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.238138 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.238232 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.238324 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.238432 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.238520 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.238616 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.238708 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.238791 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.238882 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.238972 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.239693 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.239813 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.239900 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.239984 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.240067 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.240157 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.240249 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.240357 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.240444 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.240535 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.240644 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.240738 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.240836 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.240922 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.241005 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.241088 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.241171 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.241253 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.241416 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.241503 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.241594 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.241685 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.241777 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.241868 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.241965 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.242063 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.242149 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.242233 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.242315 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.242423 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.242511 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.242606 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.242699 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.242791 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.242876 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.242968 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.243098 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.243217 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.243337 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.243449 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.243557 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.243679 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.243799 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.243916 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.244091 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.244404 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.244521 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.244641 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.244753 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.244753 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.244956 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.244956 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.245167 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.245286 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.245396 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.245512 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.245622 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.245749 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.245872 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.245998 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.246209 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.246324 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.246513 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.246637 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.246830 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.246950 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.247072 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.247181 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.247289 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.247397 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.247527 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.247638 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.247747 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.247855 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.247981 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.248100 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.248218 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.248328 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.248449 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.248567 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.248677 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.248799 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.248921 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.248921 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.249142 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.249301 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.249401 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.249505 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.249590 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.249681 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.249777 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.249873 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.249958 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.250054 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.250139 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.250222 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.250312 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.250312 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.250497 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.250584 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.250667 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.250757 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.250842 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.250976 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.251082 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.251176 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.251749 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.251838 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.251922 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.251922 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.251922 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.251922 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.252234 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.252325 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.252415 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.252509 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.252593 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.252683 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.252766 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.252855 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.252939 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.253029 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.253114 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.253197 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.253290 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.253382 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.253465 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.253557 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.253648 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.253733 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.253816 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.253905 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.254004 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.254107 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.254200 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.254300 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.254590 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.254688 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.254775 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.254859 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.254948 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.255034 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.255117 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.255208 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.255300 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.255384 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.255384 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.255563 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.255654 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.255752 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.255837 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.255920 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.256003 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.256086 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.256194 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.256333 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.256434 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.256520 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.256619 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.256694 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.256772 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.256857 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.256947 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.257031 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.257121 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.257205 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.257296 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.257388 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.257473 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.257562 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.257653 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.257743 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.257836 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.257921 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.258000 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.258072 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.258161 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.258253 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.258338 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.258448 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.258534 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.258616 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.258704 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.258800 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.258885 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.258976 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.259102 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.259102 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.259311 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.259406 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.259491 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.259491 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.259650 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.259745 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.259837 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.259930 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.260015 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.260105 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.260272 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.260361 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.260511 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.260598 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.260681 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.260764 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.260846 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.260928 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.261019 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.261111 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.261195 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.261285 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.261370 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.261460 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.261562 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.261647 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.261730 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.261813 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.261906 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.261998 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.262090 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.262175 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.262258 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.262340 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.262449 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.262544 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.262629 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.262711 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.262801 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.262885 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.262975 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.263067 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.263152 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.263242 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.263326 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.263416 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.263500 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.263597 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.263681 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.263771 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.263862 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.263987 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.264080 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.264323 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.264422 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.264649 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.264788 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.264954 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.265072 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.265255 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.265358 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.265585 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.265683 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.265886 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.265995 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.266219 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.266321 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.266597 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.266715 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.266923 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.267059 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.267239 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.267395 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.267555 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.267705 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.267873 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.268026 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.268192 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.268344 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.268505 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.268660 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.268824 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.268974 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.269145 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.269289 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.269464 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.269602 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.269917 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.270040 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.270230 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.270380 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.270569 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.270714 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.270885 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.271028 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.271228 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.271360 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.271504 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.271651 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.271970 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.272061 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.272289 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.272396 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.272601 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.272755 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.272922 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.273041 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.273233 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.273326 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.273562 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.273665 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.273874 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.273975 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.274185 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.274278 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.274528 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.274640 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.274845 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.274957 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.275153 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.275254 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.275481 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.275578 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.275806 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.275906 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.276128 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.276221 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.276465 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.276559 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.276786 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.276926 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.277094 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.277202 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.277410 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.277508 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.277726 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.277824 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.278037 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.278151 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.278351 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.278524 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.278690 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.278782 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.279006 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.279100 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.279317 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.279454 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.279627 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.279726 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.279934 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.280032 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.280242 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.280356 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.280558 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.280653 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.280870 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.280963 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.281177 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.281268 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.281505 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.281604 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.281823 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.281917 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.282156 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.282259 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.282515 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.282716 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.282850 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.283039 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.283168 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.283377 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.283469 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.283707 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.283801 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.284033 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.284133 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.284353 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.284591 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.284698 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.284912 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.285031 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.285274 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.285395 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.285570 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.285665 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.285886 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.285985 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.286197 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.286290 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.286526 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.286623 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.286853 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.286936 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.287156 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.287255 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.287461 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.287561 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.287768 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.287860 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.288072 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.288178 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.288432 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.288606 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.288707 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.288962 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.289055 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.289274 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.289371 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.289592 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.289690 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.289899 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.289998 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.290224 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.290500 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.290605 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.290829 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.290921 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.291150 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.291257 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.291482 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.291575 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.291798 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.291889 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.292115 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.292208 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.292421 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.292512 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.292726 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.292818 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.293040 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.293134 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.293343 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.293434 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.293644 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.293736 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.293954 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.294053 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.294258 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.294356 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.294587 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.294682 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.294904 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.295018 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.295211 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.295317 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.295510 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.295611 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.295821 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.295914 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.296124 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.296294 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.296430 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.296532 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.296735 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.296828 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.297037 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.297170 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.297341 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.297511 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.297641 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.297732 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.298485 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.298627 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.298786 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.298891 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.299086 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.299177 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.299388 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.299523 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.299697 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.299796 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.299997 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.300142 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.300318 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.300411 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.300623 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.300716 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.300927 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.301026 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.301226 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.301324 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.301535 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.301628 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.301836 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.301930 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.302150 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.302255 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.302477 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.302584 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.302784 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.302878 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.303098 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.303200 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.303406 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.303647 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.303739 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.304026 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.304117 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.304335 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.304436 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.304675 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.304774 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.305079 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.305223 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.305323 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.305516 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.305611 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.305901 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.305996 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.306220 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.306322 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.306575 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.306688 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.306892 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.306985 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.307205 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.307371 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.307509 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.307645 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.307832 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.307927 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.308124 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.308218 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.308435 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.308527 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.308743 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.308832 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.309052 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.309151 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.309359 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.309459 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.309670 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.309821 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.309978 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.310071 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.310288 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.310419 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.310624 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.310730 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.310936 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.311035 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.311248 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.311347 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.311558 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.311726 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.311868 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.311969 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.312179 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.312277 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.312497 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.312602 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.312809 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.312901 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.313114 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.313213 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.313437 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.314079 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.314264 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.314385 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.314624 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.314717 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.314955 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.315059 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.315283 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.315379 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.315563 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.315664 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.315936 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.316029 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.316251 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.316344 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.316574 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.316676 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.316886 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.316980 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.317190 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.317289 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.317510 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.317618 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.317833 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.317935 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.318144 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.318307 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.318484 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.318595 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.318792 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.318885 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.319099 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.319192 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.319410 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.319503 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.319742 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.319840 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.320057 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.320158 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.320359 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.320459 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.320667 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.320760 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.320968 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.321060 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.321273 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.321375 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.321592 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.321683 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.321904 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.322010 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.322223 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.322315 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.322557 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.322651 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.322877 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.322983 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.323184 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.323284 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.323492 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.323586 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.323803 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.323905 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.324114 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.324215 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.324418 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.324516 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.324725 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.324826 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.325040 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.325132 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.325350 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.325460 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.325664 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.325764 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.325980 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.326071 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.326288 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.326381 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.326622 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.326718 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.326942 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.327041 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.327255 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.327348 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.327559 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.327698 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.327883 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.327975 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.328198 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.328304 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.328512 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.328681 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.328823 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.328953 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.329165 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.329274 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.329483 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.329576 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.329811 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.329903 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.330126 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.330234 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.330464 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.330572 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.330777 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.330871 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.331091 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.331196 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.331406 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.331500 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.331730 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.331828 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.332053 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.332155 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.332304 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 29 01:12:01.332398 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.332694 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.333039 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.333351 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.333765 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.334099 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:12:01.334339 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 29 01:12:01.355102 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_db.sqlalchemy.engines [None req-4f27db14-1f2f-4181-8dfb-a0b787ee3d5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115748) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 01:12:01.356997 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_db.sqlalchemy.engines [None req-f4d75034-e21c-4f25-ab28-83fc263aed18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 01:12:01.433513 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.context [None req-4f27db14-1f2f-4181-8dfb-a0b787ee3d5e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6(cell1) {{(pid=115748) load_cells /opt/stack/nova/nova/context.py:464}} Oct 29 01:12:01.437947 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4f27db14-1f2f-4181-8dfb-a0b787ee3d5e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:01.438352 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.context [None req-f4d75034-e21c-4f25-ab28-83fc263aed18 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6(cell1) {{(pid=115747) load_cells /opt/stack/nova/nova/context.py:464}} Oct 29 01:12:01.440136 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4f27db14-1f2f-4181-8dfb-a0b787ee3d5e None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:01.440952 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4f27db14-1f2f-4181-8dfb-a0b787ee3d5e None None] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:01.442916 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4f27db14-1f2f-4181-8dfb-a0b787ee3d5e None None] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:01.443347 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f4d75034-e21c-4f25-ab28-83fc263aed18 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:01.444927 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f4d75034-e21c-4f25-ab28-83fc263aed18 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:01.445742 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f4d75034-e21c-4f25-ab28-83fc263aed18 None None] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:01.447716 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f4d75034-e21c-4f25-ab28-83fc263aed18 None None] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:01.454091 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_db.sqlalchemy.engines [None req-4f27db14-1f2f-4181-8dfb-a0b787ee3d5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115748) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 01:12:01.454925 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_db.sqlalchemy.engines [None req-4f27db14-1f2f-4181-8dfb-a0b787ee3d5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115748) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 01:12:01.459006 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_db.sqlalchemy.engines [None req-f4d75034-e21c-4f25-ab28-83fc263aed18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 01:12:01.461171 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_db.sqlalchemy.engines [None req-f4d75034-e21c-4f25-ab28-83fc263aed18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 01:12:01.720616 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_db.sqlalchemy.engines [None req-4f27db14-1f2f-4181-8dfb-a0b787ee3d5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115748) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 01:12:01.721413 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_db.sqlalchemy.engines [None req-f4d75034-e21c-4f25-ab28-83fc263aed18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 01:12:02.046884 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: WARNING keystonemiddleware.auth_token [None req-f4d75034-e21c-4f25-ab28-83fc263aed18 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 01:12:02.050231 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: WARNING keystonemiddleware.auth_token [None req-4f27db14-1f2f-4181-8dfb-a0b787ee3d5e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 01:12:02.053838 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: WARNING keystonemiddleware.auth_token [None req-f4d75034-e21c-4f25-ab28-83fc263aed18 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 01:12:02.056965 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: WARNING keystonemiddleware.auth_token [None req-4f27db14-1f2f-4181-8dfb-a0b787ee3d5e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 01:12:02.408211 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: WARNING keystonemiddleware.auth_token [None req-f4d75034-e21c-4f25-ab28-83fc263aed18 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 01:12:02.410046 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: WARNING keystonemiddleware.auth_token [None req-4f27db14-1f2f-4181-8dfb-a0b787ee3d5e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 01:12:02.413668 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: WARNING keystonemiddleware.auth_token [None req-f4d75034-e21c-4f25-ab28-83fc263aed18 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 01:12:02.415463 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: WARNING keystonemiddleware.auth_token [None req-4f27db14-1f2f-4181-8dfb-a0b787ee3d5e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 01:12:02.418851 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558c0f2ce9c0 pid: 115747 (default app) Oct 29 01:12:02.420632 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558c0f2ce9c0 pid: 115748 (default app) Oct 29 01:12:35.980827 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e3538e07-b8c4-4e08-84ec-493913d03663 tempest-VolumesGetTestJSON-1670648360 tempest-VolumesGetTestJSON-1670648360-project] Action: 'create', calling method: .version_select at 0x7f602b256f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-923236152", "metadata": {"Type": "work"}}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:12:35.991744 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-908f1103-1f12-4be5-a920-a0acc12fe292 tempest-VolumesSnapshotsTestJSON-703580526 tempest-VolumesSnapshotsTestJSON-703580526-project] Action: 'create', calling method: .version_select at 0x7f602b2d4f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1560262520"}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:12:38.397253 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-e3538e07-b8c4-4e08-84ec-493913d03663 tempest-VolumesGetTestJSON-1670648360 tempest-VolumesGetTestJSON-1670648360-project] 10.222.0.90 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.842880 Oct 29 01:12:38.398125 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1/1] 10.222.0.90 () {60 vars in 1155 bytes} [Fri Oct 29 01:12:34 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 3846 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 29 01:12:38.461555 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-908f1103-1f12-4be5-a920-a0acc12fe292 tempest-VolumesSnapshotsTestJSON-703580526 tempest-VolumesSnapshotsTestJSON-703580526-project] 10.222.0.90 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.938560 Oct 29 01:12:38.462508 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1/2] 10.222.0.90 () {60 vars in 1154 bytes} [Fri Oct 29 01:12:34 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 3941 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 29 01:12:38.651836 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-acd97256-b554-41f9-a3b6-fc537d132e1d tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1400855278", "imageRef": "3fef3f0d-d772-4999-b764-d6690634a06d", "flavorRef": "452", "networks": [{"uuid": "a8cf48dd-4234-4179-9b70-a1253a35f93b"}]}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:12:38.694850 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a8e806e4-625e-454c-a38a-afb117a87297 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1464369910", "imageRef": "3fef3f0d-d772-4999-b764-d6690634a06d", "flavorRef": "452", "networks": [{"uuid": "04819660-923b-4a69-94a5-8390cbffb752"}]}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:12:38.943894 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.network.neutron [None req-a8e806e4-625e-454c-a38a-afb117a87297 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] validate_networks() for [('04819660-923b-4a69-94a5-8390cbffb752', None, None, None, None, None)] {{(pid=115747) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 01:12:38.944682 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.network.neutron [None req-acd97256-b554-41f9-a3b6-fc537d132e1d tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] validate_networks() for [('a8cf48dd-4234-4179-9b70-a1253a35f93b', None, None, None, None, None)] {{(pid=115748) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 01:12:40.397595 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-a8e806e4-625e-454c-a38a-afb117a87297 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Flavor limits 0:0:0 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:12:40.399093 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-a8e806e4-625e-454c-a38a-afb117a87297 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Image limits 0:0:0 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:12:40.399922 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-a8e806e4-625e-454c-a38a-afb117a87297 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Flavor pref 0:0:0 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:12:40.401463 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-a8e806e4-625e-454c-a38a-afb117a87297 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Image pref 0:0:0 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:12:40.402117 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-a8e806e4-625e-454c-a38a-afb117a87297 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:12:40.425906 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a8e806e4-625e-454c-a38a-afb117a87297 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:40.426553 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a8e806e4-625e-454c-a38a-afb117a87297 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:40.427242 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a8e806e4-625e-454c-a38a-afb117a87297 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:40.427672 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a8e806e4-625e-454c-a38a-afb117a87297 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:40.463405 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.virt.hardware [None req-acd97256-b554-41f9-a3b6-fc537d132e1d tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Flavor limits 0:0:0 {{(pid=115748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:12:40.463922 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.virt.hardware [None req-acd97256-b554-41f9-a3b6-fc537d132e1d tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Image limits 0:0:0 {{(pid=115748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:12:40.464283 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.virt.hardware [None req-acd97256-b554-41f9-a3b6-fc537d132e1d tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Flavor pref 0:0:0 {{(pid=115748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:12:40.465488 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.virt.hardware [None req-acd97256-b554-41f9-a3b6-fc537d132e1d tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Image pref 0:0:0 {{(pid=115748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:12:40.466696 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.virt.hardware [None req-acd97256-b554-41f9-a3b6-fc537d132e1d tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:12:40.475842 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.quota [None req-a8e806e4-625e-454c-a38a-afb117a87297 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Getting quotas for project 355f0948092d4f3c929575a405284599. Resources: {'instances', 'cores', 'ram'} {{(pid=115747) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:12:40.484897 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.quota [None req-a8e806e4-625e-454c-a38a-afb117a87297 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Getting quotas for user 8fe86a50674f4837bfcb81170f5fd253 and project 355f0948092d4f3c929575a405284599. Resources: {'instances', 'cores', 'ram'} {{(pid=115747) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:12:40.489116 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-acd97256-b554-41f9-a3b6-fc537d132e1d tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:40.489863 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-acd97256-b554-41f9-a3b6-fc537d132e1d tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:40.490510 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-acd97256-b554-41f9-a3b6-fc537d132e1d tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:40.491044 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-acd97256-b554-41f9-a3b6-fc537d132e1d tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:40.497244 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a8e806e4-625e-454c-a38a-afb117a87297 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Going to run 1 instances... {{(pid=115747) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 01:12:40.500814 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a8e806e4-625e-454c-a38a-afb117a87297 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3fef3f0d-d772-4999-b764-d6690634a06d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 01:12:40.557786 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.quota [None req-acd97256-b554-41f9-a3b6-fc537d132e1d tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Getting quotas for project 9e81ffa504e64cd6801102af6c5c22fc. Resources: {'instances', 'cores', 'ram'} {{(pid=115748) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:12:40.580577 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.quota [None req-acd97256-b554-41f9-a3b6-fc537d132e1d tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Getting quotas for user 5b56d6242f2f476583fc644ba9be1e3b and project 9e81ffa504e64cd6801102af6c5c22fc. Resources: {'instances', 'cores', 'ram'} {{(pid=115748) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:12:40.602761 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-acd97256-b554-41f9-a3b6-fc537d132e1d tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Going to run 1 instances... {{(pid=115748) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 01:12:40.616326 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-acd97256-b554-41f9-a3b6-fc537d132e1d tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3fef3f0d-d772-4999-b764-d6690634a06d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 01:12:40.691589 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a8e806e4-625e-454c-a38a-afb117a87297 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.227877 Oct 29 01:12:40.692488 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 2/3] 10.222.0.90 () {60 vars in 1146 bytes} [Fri Oct 29 01:12:38 2021] POST /compute/v2.1/servers => generated 380 bytes in 2229 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:12:40.702846 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-4395e73c-daa4-4027-93a1-4c070a64d610 tempest-VolumesGetTestJSON-1670648360 tempest-VolumesGetTestJSON-1670648360-project] Calling method '.version_select at 0x7f602b04a280>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:40.794508 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-4395e73c-daa4-4027-93a1-4c070a64d610 tempest-VolumesGetTestJSON-1670648360 tempest-VolumesGetTestJSON-1670648360-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/a590710e-9bd2-4259-9e6b-b443b41874af" status: 200 len: 353 microversion: 2.1 time: 0.100628 Oct 29 01:12:40.795162 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 3/4] 10.222.0.90 () {58 vars in 1244 bytes} [Fri Oct 29 01:12:40 2021] GET /compute/v2.1/os-volumes/a590710e-9bd2-4259-9e6b-b443b41874af => generated 353 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:12:40.805445 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-1c8a37f7-ff82-4edb-963c-f2aa05ee7d4b tempest-VolumesSnapshotsTestJSON-703580526 tempest-VolumesSnapshotsTestJSON-703580526-project] Calling method '.version_select at 0x7f602b04af70>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:40.828500 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-acd97256-b554-41f9-a3b6-fc537d132e1d tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.429042 Oct 29 01:12:40.829626 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 2/5] 10.222.0.90 () {60 vars in 1146 bytes} [Fri Oct 29 01:12:38 2021] POST /compute/v2.1/servers => generated 380 bytes in 2431 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:12:40.837479 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-40ac71e5-8813-4c23-a2dc-510892f71dd2 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:40.839063 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-40ac71e5-8813-4c23-a2dc-510892f71dd2 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:12:41.055115 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-1c8a37f7-ff82-4edb-963c-f2aa05ee7d4b tempest-VolumesSnapshotsTestJSON-703580526 tempest-VolumesSnapshotsTestJSON-703580526-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/33cbef0d-1743-406e-9e97-35317085382f" status: 200 len: 346 microversion: 2.1 time: 0.258442 Oct 29 01:12:41.056200 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 4/6] 10.222.0.90 () {58 vars in 1244 bytes} [Fri Oct 29 01:12:40 2021] GET /compute/v2.1/os-volumes/33cbef0d-1743-406e-9e97-35317085382f => generated 346 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:12:41.060609 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-4ab5d40e-4242-4220-ad3a-70d9bb5f86b0 tempest-VolumesGetTestJSON-1670648360 tempest-VolumesGetTestJSON-1670648360-project] Calling method '.version_select at 0x7f602b04aee0>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:41.098741 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-40ac71e5-8813-4c23-a2dc-510892f71dd2 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:41.161017 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-4ab5d40e-4242-4220-ad3a-70d9bb5f86b0 tempest-VolumesGetTestJSON-1670648360 tempest-VolumesGetTestJSON-1670648360-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/a590710e-9bd2-4259-9e6b-b443b41874af" status: 200 len: 353 microversion: 2.1 time: 0.103709 Oct 29 01:12:41.161635 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 5/7] 10.222.0.90 () {58 vars in 1244 bytes} [Fri Oct 29 01:12:41 2021] GET /compute/v2.1/os-volumes/a590710e-9bd2-4259-9e6b-b443b41874af => generated 353 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:12:41.171021 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-40ac71e5-8813-4c23-a2dc-510892f71dd2 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1218 microversion: 2.1 time: 0.339071 Oct 29 01:12:41.174099 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-4917dbea-c748-426b-b7cc-16cdef593321 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:41.174833 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-4917dbea-c748-426b-b7cc-16cdef593321 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:12:41.188101 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 3/8] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:12:40 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1218 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:41.197386 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-89fd35f5-69ad-4b0d-9a35-aa42c0c9fec4 tempest-VolumesSnapshotsTestJSON-703580526 tempest-VolumesSnapshotsTestJSON-703580526-project] Action: 'create', calling method: .version_select at 0x7f602b1509d0>, body: {"snapshot": {"volume_id": "33cbef0d-1743-406e-9e97-35317085382f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1286530572"}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:12:41.386544 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-4917dbea-c748-426b-b7cc-16cdef593321 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:41.427025 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-4917dbea-c748-426b-b7cc-16cdef593321 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1215 microversion: 2.1 time: 0.260960 Oct 29 01:12:41.431432 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 6/9] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:12:41 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1215 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:41.439688 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a2bc38f8-a4eb-4eb1-88df-dcd7c8eea283 tempest-VolumesGetTestJSON-1670648360 tempest-VolumesGetTestJSON-1670648360-project] Calling method '.version_select at 0x7f6029fe2dc0>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:41.638066 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-89fd35f5-69ad-4b0d-9a35-aa42c0c9fec4 tempest-VolumesSnapshotsTestJSON-703580526 tempest-VolumesSnapshotsTestJSON-703580526-project] 10.222.0.90 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.447506 Oct 29 01:12:41.640605 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 4/10] 10.222.0.90 () {60 vars in 1161 bytes} [Fri Oct 29 01:12:41 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:12:41.655493 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2afbef9a-a160-4298-bc22-99c6be2cd8e2 tempest-VolumesSnapshotsTestJSON-703580526 tempest-VolumesSnapshotsTestJSON-703580526-project] Calling method '.version_select at 0x7f602a0100d0>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:41.808990 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a2bc38f8-a4eb-4eb1-88df-dcd7c8eea283 tempest-VolumesGetTestJSON-1670648360 tempest-VolumesGetTestJSON-1670648360-project] 10.222.0.90 "DELETE /compute/v2.1/os-volumes/a590710e-9bd2-4259-9e6b-b443b41874af" status: 202 len: 0 microversion: 2.1 time: 0.373696 Oct 29 01:12:41.810511 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 7/11] 10.222.0.90 () {58 vars in 1247 bytes} [Fri Oct 29 01:12:41 2021] DELETE /compute/v2.1/os-volumes/a590710e-9bd2-4259-9e6b-b443b41874af => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:12:41.819383 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-0f1e5012-09a1-42b3-9fa5-1cd86750f994 tempest-VolumesGetTestJSON-1670648360 tempest-VolumesGetTestJSON-1670648360-project] Calling method '.version_select at 0x7f6029fe2d30>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:41.879616 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2afbef9a-a160-4298-bc22-99c6be2cd8e2 tempest-VolumesSnapshotsTestJSON-703580526 tempest-VolumesSnapshotsTestJSON-703580526-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/ddb0e30a-9e72-4619-9212-2594d616cb4c" status: 200 len: 287 microversion: 2.1 time: 0.230105 Oct 29 01:12:41.880620 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 5/12] 10.222.0.90 () {58 vars in 1250 bytes} [Fri Oct 29 01:12:41 2021] GET /compute/v2.1/os-snapshots/ddb0e30a-9e72-4619-9212-2594d616cb4c => generated 287 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:12:41.891538 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-cc508588-b28d-4bb6-9671-4d523cd68a9d tempest-VolumesSnapshotsTestJSON-703580526 tempest-VolumesSnapshotsTestJSON-703580526-project] Calling method '.version_select at 0x7f602a010a60>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:41.973756 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-0f1e5012-09a1-42b3-9fa5-1cd86750f994 tempest-VolumesGetTestJSON-1670648360 tempest-VolumesGetTestJSON-1670648360-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/a590710e-9bd2-4259-9e6b-b443b41874af" status: 200 len: 352 microversion: 2.1 time: 0.157923 Oct 29 01:12:41.979236 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 8/13] 10.222.0.90 () {58 vars in 1244 bytes} [Fri Oct 29 01:12:41 2021] GET /compute/v2.1/os-volumes/a590710e-9bd2-4259-9e6b-b443b41874af => generated 352 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:12:41.987406 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-cc508588-b28d-4bb6-9671-4d523cd68a9d tempest-VolumesSnapshotsTestJSON-703580526 tempest-VolumesSnapshotsTestJSON-703580526-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.101120 Oct 29 01:12:41.988007 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 6/14] 10.222.0.90 () {58 vars in 1139 bytes} [Fri Oct 29 01:12:41 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:12:41.998901 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b6f660e3-e970-4bf7-8fc1-373c7feede8e tempest-VolumesSnapshotsTestJSON-703580526 tempest-VolumesSnapshotsTestJSON-703580526-project] Calling method '.version_select at 0x7f602a00f040>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:42.071077 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b6f660e3-e970-4bf7-8fc1-373c7feede8e tempest-VolumesSnapshotsTestJSON-703580526 tempest-VolumesSnapshotsTestJSON-703580526-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/ddb0e30a-9e72-4619-9212-2594d616cb4c" status: 200 len: 287 microversion: 2.1 time: 0.076263 Oct 29 01:12:42.072195 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 9/15] 10.222.0.90 () {58 vars in 1250 bytes} [Fri Oct 29 01:12:41 2021] GET /compute/v2.1/os-snapshots/ddb0e30a-9e72-4619-9212-2594d616cb4c => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:12:42.193296 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-31263364-bded-4f26-9c0f-d676072425c3 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:42.193950 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-31263364-bded-4f26-9c0f-d676072425c3 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:12:42.321886 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-31263364-bded-4f26-9c0f-d676072425c3 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:42.332990 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-31263364-bded-4f26-9c0f-d676072425c3 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1218 microversion: 2.1 time: 0.143606 Oct 29 01:12:42.339639 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 7/16] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:12:42 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1218 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:42.446905 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-28011a42-447b-4aeb-bfcb-1e75d9db37c7 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:42.447516 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-28011a42-447b-4aeb-bfcb-1e75d9db37c7 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:12:42.567670 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-28011a42-447b-4aeb-bfcb-1e75d9db37c7 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:42.574480 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-28011a42-447b-4aeb-bfcb-1e75d9db37c7 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1215 microversion: 2.1 time: 0.131100 Oct 29 01:12:42.578015 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 10/17] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:12:42 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1215 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:42.929316 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e17762ca-9227-4235-9704-c35ae2f0c417 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'create', calling method: .version_select at 0x7f602a000af0>, body: {"keypair": {"name": "tempest-keypair-1520794761"}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:12:42.961249 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.quota [None req-e17762ca-9227-4235-9704-c35ae2f0c417 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Getting quotas for project 0da5b2a4f59a412d95c116ace173e394. Resources: {'key_pairs'} {{(pid=115748) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:12:42.965337 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.quota [None req-e17762ca-9227-4235-9704-c35ae2f0c417 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Getting quotas for user 5bca27fde6ce471d900a7de497f487f6 and project 0da5b2a4f59a412d95c116ace173e394. Resources: {'key_pairs'} {{(pid=115748) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:12:42.988848 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-5155cc8a-a9a1-4d02-b81f-f98a3ca9f384 tempest-VolumesGetTestJSON-1670648360 tempest-VolumesGetTestJSON-1670648360-project] Calling method '.version_select at 0x7f6029ff7e50>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:43.070605 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-5155cc8a-a9a1-4d02-b81f-f98a3ca9f384 tempest-VolumesGetTestJSON-1670648360 tempest-VolumesGetTestJSON-1670648360-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/a590710e-9bd2-4259-9e6b-b443b41874af" status: 200 len: 352 microversion: 2.1 time: 0.087716 Oct 29 01:12:43.071581 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 11/18] 10.222.0.90 () {58 vars in 1244 bytes} [Fri Oct 29 01:12:42 2021] GET /compute/v2.1/os-volumes/a590710e-9bd2-4259-9e6b-b443b41874af => generated 352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:12:43.082878 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-8bc09fa3-9f81-46a2-803c-c87b20a9ef22 tempest-VolumesSnapshotsTestJSON-703580526 tempest-VolumesSnapshotsTestJSON-703580526-project] Calling method '.version_select at 0x7f602a00f040>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:43.125731 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-8bc09fa3-9f81-46a2-803c-c87b20a9ef22 tempest-VolumesSnapshotsTestJSON-703580526 tempest-VolumesSnapshotsTestJSON-703580526-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/ddb0e30a-9e72-4619-9212-2594d616cb4c" status: 200 len: 287 microversion: 2.1 time: 0.046404 Oct 29 01:12:43.126696 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 12/19] 10.222.0.90 () {58 vars in 1250 bytes} [Fri Oct 29 01:12:43 2021] GET /compute/v2.1/os-snapshots/ddb0e30a-9e72-4619-9212-2594d616cb4c => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:12:43.142641 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.quota [None req-e17762ca-9227-4235-9704-c35ae2f0c417 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Getting quotas for project 0da5b2a4f59a412d95c116ace173e394. Resources: {'key_pairs'} {{(pid=115748) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:12:43.146928 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.quota [None req-e17762ca-9227-4235-9704-c35ae2f0c417 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Getting quotas for user 5bca27fde6ce471d900a7de497f487f6 and project 0da5b2a4f59a412d95c116ace173e394. Resources: {'key_pairs'} {{(pid=115748) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:12:43.162565 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-e17762ca-9227-4235-9704-c35ae2f0c417 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.292635 Oct 29 01:12:43.163167 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 8/20] 10.222.0.90 () {62 vars in 1198 bytes} [Fri Oct 29 01:12:42 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 294 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Oct 29 01:12:43.358982 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d515c483-7789-4706-934c-03a458f6b41c tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:43.361046 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d515c483-7789-4706-934c-03a458f6b41c tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:12:43.368965 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d515c483-7789-4706-934c-03a458f6b41c tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:43.369789 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d515c483-7789-4706-934c-03a458f6b41c tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:43.371131 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d515c483-7789-4706-934c-03a458f6b41c tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:43.371827 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d515c483-7789-4706-934c-03a458f6b41c tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:43.565384 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-d515c483-7789-4706-934c-03a458f6b41c tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:43.592606 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-0a94cddb-58f1-424b-95d3-b7773d2d966b tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:43.593222 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-0a94cddb-58f1-424b-95d3-b7773d2d966b tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:12:43.602264 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0a94cddb-58f1-424b-95d3-b7773d2d966b tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:43.602693 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d515c483-7789-4706-934c-03a458f6b41c tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1222 microversion: 2.1 time: 0.248309 Oct 29 01:12:43.602837 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0a94cddb-58f1-424b-95d3-b7773d2d966b tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:43.603507 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0a94cddb-58f1-424b-95d3-b7773d2d966b tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:43.603940 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0a94cddb-58f1-424b-95d3-b7773d2d966b tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:43.605674 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 13/21] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:12:43 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1222 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:43.770244 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-0a94cddb-58f1-424b-95d3-b7773d2d966b tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:43.787399 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-0a94cddb-58f1-424b-95d3-b7773d2d966b tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1219 microversion: 2.1 time: 0.199421 Oct 29 01:12:43.798554 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 9/22] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:12:43 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1219 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:12:44.084304 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-34456229-c268-4101-b747-5ec373415542 tempest-VolumesGetTestJSON-1670648360 tempest-VolumesGetTestJSON-1670648360-project] Calling method '.version_select at 0x7f602a00f3a0>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:44.142961 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-54693d24-206d-4f0a-b366-fd83a45cd69d tempest-VolumesSnapshotsTestJSON-703580526 tempest-VolumesSnapshotsTestJSON-703580526-project] Calling method '.version_select at 0x7f602973c0d0>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:44.219799 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-54693d24-206d-4f0a-b366-fd83a45cd69d tempest-VolumesSnapshotsTestJSON-703580526 tempest-VolumesSnapshotsTestJSON-703580526-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/ddb0e30a-9e72-4619-9212-2594d616cb4c" status: 200 len: 287 microversion: 2.1 time: 0.085888 Oct 29 01:12:44.224404 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-34456229-c268-4101-b747-5ec373415542 tempest-VolumesGetTestJSON-1670648360 tempest-VolumesGetTestJSON-1670648360-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/a590710e-9bd2-4259-9e6b-b443b41874af" status: 200 len: 352 microversion: 2.1 time: 0.144910 Oct 29 01:12:44.229405 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 14/23] 10.222.0.90 () {58 vars in 1244 bytes} [Fri Oct 29 01:12:44 2021] GET /compute/v2.1/os-volumes/a590710e-9bd2-4259-9e6b-b443b41874af => generated 352 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:12:44.229593 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 10/24] 10.222.0.90 () {58 vars in 1250 bytes} [Fri Oct 29 01:12:44 2021] GET /compute/v2.1/os-snapshots/ddb0e30a-9e72-4619-9212-2594d616cb4c => generated 287 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:12:44.622105 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a20e8d12-45a5-4152-a927-fd0ebfb7f1ce tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:44.625705 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a20e8d12-45a5-4152-a927-fd0ebfb7f1ce tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:12:44.637516 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a20e8d12-45a5-4152-a927-fd0ebfb7f1ce tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:44.640038 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a20e8d12-45a5-4152-a927-fd0ebfb7f1ce tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:44.641128 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a20e8d12-45a5-4152-a927-fd0ebfb7f1ce tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:44.642287 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a20e8d12-45a5-4152-a927-fd0ebfb7f1ce tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:44.736645 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-a20e8d12-45a5-4152-a927-fd0ebfb7f1ce tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:44.746598 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a20e8d12-45a5-4152-a927-fd0ebfb7f1ce tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1222 microversion: 2.1 time: 0.128781 Oct 29 01:12:44.747826 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 15/25] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:12:44 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1222 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:44.811747 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-0bfbe039-79b1-4119-971d-9c4519ee2410 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:44.816461 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-0bfbe039-79b1-4119-971d-9c4519ee2410 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:12:44.847809 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0bfbe039-79b1-4119-971d-9c4519ee2410 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:44.848560 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0bfbe039-79b1-4119-971d-9c4519ee2410 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:44.855390 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0bfbe039-79b1-4119-971d-9c4519ee2410 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:44.856139 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0bfbe039-79b1-4119-971d-9c4519ee2410 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:44.944083 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-0bfbe039-79b1-4119-971d-9c4519ee2410 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:44.967315 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-0bfbe039-79b1-4119-971d-9c4519ee2410 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1219 microversion: 2.1 time: 0.161536 Oct 29 01:12:44.968231 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 11/26] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:12:44 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1219 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:45.228404 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ed5d09db-f15f-4eb4-8271-257f49cfeaba tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1161732948", "imageRef": "3fef3f0d-d772-4999-b764-d6690634a06d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7752f1e5-4ffa-49a3-bdd2-70599dc227a3"}], "security_groups": [{"name": "tempest-securitygroup--1200408146"}], "key_name": "tempest-keypair-1520794761", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:12:45.233934 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-b152a97e-7a0f-4cf0-bfb2-2db18d2b918f tempest-VolumesSnapshotsTestJSON-703580526 tempest-VolumesSnapshotsTestJSON-703580526-project] Calling method '.version_select at 0x7f6029fc2430>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:45.288440 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-b152a97e-7a0f-4cf0-bfb2-2db18d2b918f tempest-VolumesSnapshotsTestJSON-703580526 tempest-VolumesSnapshotsTestJSON-703580526-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/ddb0e30a-9e72-4619-9212-2594d616cb4c" status: 200 len: 287 microversion: 2.1 time: 0.060401 Oct 29 01:12:45.289498 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 12/27] 10.222.0.90 () {58 vars in 1250 bytes} [Fri Oct 29 01:12:45 2021] GET /compute/v2.1/os-snapshots/ddb0e30a-9e72-4619-9212-2594d616cb4c => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:12:45.294203 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c0f813f8-ec01-4fb3-ab2a-dd4d565fef42 tempest-VolumesGetTestJSON-1670648360 tempest-VolumesGetTestJSON-1670648360-project] Calling method '.version_select at 0x7f602a0104c0>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:45.377606 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c0f813f8-ec01-4fb3-ab2a-dd4d565fef42 tempest-VolumesGetTestJSON-1670648360 tempest-VolumesGetTestJSON-1670648360-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/a590710e-9bd2-4259-9e6b-b443b41874af" status: 200 len: 352 microversion: 2.1 time: 0.086690 Oct 29 01:12:45.382838 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 13/28] 10.222.0.90 () {58 vars in 1244 bytes} [Fri Oct 29 01:12:45 2021] GET /compute/v2.1/os-volumes/a590710e-9bd2-4259-9e6b-b443b41874af => generated 352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:12:45.526092 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.network.neutron [None req-ed5d09db-f15f-4eb4-8271-257f49cfeaba tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] validate_networks() for [('7752f1e5-4ffa-49a3-bdd2-70599dc227a3', None, None, None, None, None)] {{(pid=115747) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 01:12:45.766654 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-3b4aa1a6-2b1c-43bf-89fe-0f2433235ccb tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:45.767769 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-3b4aa1a6-2b1c-43bf-89fe-0f2433235ccb tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:12:45.780113 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3b4aa1a6-2b1c-43bf-89fe-0f2433235ccb tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:45.780945 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3b4aa1a6-2b1c-43bf-89fe-0f2433235ccb tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:45.789378 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3b4aa1a6-2b1c-43bf-89fe-0f2433235ccb tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:45.789970 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3b4aa1a6-2b1c-43bf-89fe-0f2433235ccb tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:45.902071 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-3b4aa1a6-2b1c-43bf-89fe-0f2433235ccb tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:45.912565 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-3b4aa1a6-2b1c-43bf-89fe-0f2433235ccb tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1270 microversion: 2.1 time: 0.152692 Oct 29 01:12:45.913756 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 14/29] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:12:45 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1270 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:45.984785 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2ece846f-f58d-4d9b-927b-23970e3dde8a tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:45.985950 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2ece846f-f58d-4d9b-927b-23970e3dde8a tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:12:46.000959 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2ece846f-f58d-4d9b-927b-23970e3dde8a tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:46.001767 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2ece846f-f58d-4d9b-927b-23970e3dde8a tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:46.002752 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2ece846f-f58d-4d9b-927b-23970e3dde8a tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:46.003676 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2ece846f-f58d-4d9b-927b-23970e3dde8a tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:46.052334 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-ed5d09db-f15f-4eb4-8271-257f49cfeaba tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Flavor limits 0:0:0 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:12:46.053477 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-ed5d09db-f15f-4eb4-8271-257f49cfeaba tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Image limits 0:0:0 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:12:46.054444 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-ed5d09db-f15f-4eb4-8271-257f49cfeaba tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Flavor pref 0:0:0 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:12:46.055037 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-ed5d09db-f15f-4eb4-8271-257f49cfeaba tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Image pref 0:0:0 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:12:46.055876 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-ed5d09db-f15f-4eb4-8271-257f49cfeaba tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:12:46.068092 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ed5d09db-f15f-4eb4-8271-257f49cfeaba tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:46.068991 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ed5d09db-f15f-4eb4-8271-257f49cfeaba tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:46.070459 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ed5d09db-f15f-4eb4-8271-257f49cfeaba tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:46.071053 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ed5d09db-f15f-4eb4-8271-257f49cfeaba tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:46.078669 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-2ece846f-f58d-4d9b-927b-23970e3dde8a tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:46.087998 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2ece846f-f58d-4d9b-927b-23970e3dde8a tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1211 microversion: 2.1 time: 0.107852 Oct 29 01:12:46.099032 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 15/30] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:12:45 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1211 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:12:46.099306 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.quota [None req-ed5d09db-f15f-4eb4-8271-257f49cfeaba tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Getting quotas for project 0da5b2a4f59a412d95c116ace173e394. Resources: {'instances', 'cores', 'ram'} {{(pid=115747) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:12:46.103738 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.quota [None req-ed5d09db-f15f-4eb4-8271-257f49cfeaba tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Getting quotas for user 5bca27fde6ce471d900a7de497f487f6 and project 0da5b2a4f59a412d95c116ace173e394. Resources: {'instances', 'cores', 'ram'} {{(pid=115747) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:12:46.117908 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ed5d09db-f15f-4eb4-8271-257f49cfeaba tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Going to run 1 instances... {{(pid=115747) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 01:12:46.120635 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ed5d09db-f15f-4eb4-8271-257f49cfeaba tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3fef3f0d-d772-4999-b764-d6690634a06d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 01:12:46.171025 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ed5d09db-f15f-4eb4-8271-257f49cfeaba tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.947726 Oct 29 01:12:46.171679 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 16/31] 10.222.0.90 () {62 vars in 1187 bytes} [Fri Oct 29 01:12:45 2021] POST /compute/v2.1/servers => generated 402 bytes in 949 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 01:12:46.181969 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-3ec115bc-4dde-4cb9-93e0-883dea2b3cf5 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:46.182706 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-3ec115bc-4dde-4cb9-93e0-883dea2b3cf5 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:12:46.243734 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-3ec115bc-4dde-4cb9-93e0-883dea2b3cf5 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:46.253480 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-3ec115bc-4dde-4cb9-93e0-883dea2b3cf5 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:46.255037 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-3ec115bc-4dde-4cb9-93e0-883dea2b3cf5 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:46.256168 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-3ec115bc-4dde-4cb9-93e0-883dea2b3cf5 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1282 microversion: 2.20 time: 0.078193 Oct 29 01:12:46.257066 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 16/32] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:12:46 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1282 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:12:46.300726 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-3290a3bd-f5ba-4552-bc74-d2f0d85bd5ed tempest-VolumesSnapshotsTestJSON-703580526 tempest-VolumesSnapshotsTestJSON-703580526-project] Calling method '.version_select at 0x7f6029fe2d30>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:46.339912 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-3290a3bd-f5ba-4552-bc74-d2f0d85bd5ed tempest-VolumesSnapshotsTestJSON-703580526 tempest-VolumesSnapshotsTestJSON-703580526-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/ddb0e30a-9e72-4619-9212-2594d616cb4c" status: 200 len: 288 microversion: 2.1 time: 0.042651 Oct 29 01:12:46.340717 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 17/33] 10.222.0.90 () {58 vars in 1250 bytes} [Fri Oct 29 01:12:46 2021] GET /compute/v2.1/os-snapshots/ddb0e30a-9e72-4619-9212-2594d616cb4c => generated 288 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:12:46.352959 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-afb5b024-8e83-4de2-a8d8-4a4ee2da0d81 tempest-VolumesSnapshotsTestJSON-703580526 tempest-VolumesSnapshotsTestJSON-703580526-project] Calling method '.version_select at 0x7f60296a11f0>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:46.389448 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f722623b-67d0-4764-a8d4-da9df614bd3e tempest-VolumesGetTestJSON-1670648360 tempest-VolumesGetTestJSON-1670648360-project] Calling method '.version_select at 0x7f602bac55e0>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:46.434330 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-afb5b024-8e83-4de2-a8d8-4a4ee2da0d81 tempest-VolumesSnapshotsTestJSON-703580526 tempest-VolumesSnapshotsTestJSON-703580526-project] 10.222.0.90 "DELETE /compute/v2.1/os-snapshots/ddb0e30a-9e72-4619-9212-2594d616cb4c" status: 202 len: 0 microversion: 2.1 time: 0.086561 Oct 29 01:12:46.438167 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 17/34] 10.222.0.90 () {58 vars in 1253 bytes} [Fri Oct 29 01:12:46 2021] DELETE /compute/v2.1/os-snapshots/ddb0e30a-9e72-4619-9212-2594d616cb4c => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:12:46.442603 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-52077583-7089-4754-8033-c2f8615f0035 tempest-VolumesSnapshotsTestJSON-703580526 tempest-VolumesSnapshotsTestJSON-703580526-project] Calling method '.version_select at 0x7f60296a1700>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:46.472240 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f722623b-67d0-4764-a8d4-da9df614bd3e tempest-VolumesGetTestJSON-1670648360 tempest-VolumesGetTestJSON-1670648360-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/a590710e-9bd2-4259-9e6b-b443b41874af" status: 200 len: 352 microversion: 2.1 time: 0.086909 Oct 29 01:12:46.473841 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 18/35] 10.222.0.90 () {58 vars in 1244 bytes} [Fri Oct 29 01:12:46 2021] GET /compute/v2.1/os-volumes/a590710e-9bd2-4259-9e6b-b443b41874af => generated 352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:12:46.482939 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-52077583-7089-4754-8033-c2f8615f0035 tempest-VolumesSnapshotsTestJSON-703580526 tempest-VolumesSnapshotsTestJSON-703580526-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/ddb0e30a-9e72-4619-9212-2594d616cb4c" status: 200 len: 287 microversion: 2.1 time: 0.043653 Oct 29 01:12:46.483801 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 18/36] 10.222.0.90 () {58 vars in 1250 bytes} [Fri Oct 29 01:12:46 2021] GET /compute/v2.1/os-snapshots/ddb0e30a-9e72-4619-9212-2594d616cb4c => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:12:46.930034 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d30adde6-d34d-4344-a0f1-285a09301e6e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:46.930680 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d30adde6-d34d-4344-a0f1-285a09301e6e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:12:46.937841 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d30adde6-d34d-4344-a0f1-285a09301e6e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:46.938557 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d30adde6-d34d-4344-a0f1-285a09301e6e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:46.939335 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d30adde6-d34d-4344-a0f1-285a09301e6e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:46.939779 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d30adde6-d34d-4344-a0f1-285a09301e6e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:47.007218 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-d30adde6-d34d-4344-a0f1-285a09301e6e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:47.014548 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d30adde6-d34d-4344-a0f1-285a09301e6e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1270 microversion: 2.1 time: 0.088027 Oct 29 01:12:47.015323 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 19/37] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:12:46 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1270 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:47.105305 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-8a3edb9b-086a-4822-83ea-68e6bc48a5a5 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:47.105909 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-8a3edb9b-086a-4822-83ea-68e6bc48a5a5 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:12:47.112136 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8a3edb9b-086a-4822-83ea-68e6bc48a5a5 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:47.112585 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8a3edb9b-086a-4822-83ea-68e6bc48a5a5 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:47.113346 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8a3edb9b-086a-4822-83ea-68e6bc48a5a5 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:47.113799 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8a3edb9b-086a-4822-83ea-68e6bc48a5a5 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:47.173001 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-8a3edb9b-086a-4822-83ea-68e6bc48a5a5 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:47.180548 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-8a3edb9b-086a-4822-83ea-68e6bc48a5a5 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1211 microversion: 2.1 time: 0.079101 Oct 29 01:12:47.181106 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 19/38] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:12:47 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1211 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:47.274595 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-8023c5a8-b377-4c16-aa6c-3d8e97d2a177 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:47.275284 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-8023c5a8-b377-4c16-aa6c-3d8e97d2a177 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:12:47.281021 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8023c5a8-b377-4c16-aa6c-3d8e97d2a177 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:47.281537 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8023c5a8-b377-4c16-aa6c-3d8e97d2a177 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:47.282360 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8023c5a8-b377-4c16-aa6c-3d8e97d2a177 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:47.282883 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8023c5a8-b377-4c16-aa6c-3d8e97d2a177 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:47.346806 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-8023c5a8-b377-4c16-aa6c-3d8e97d2a177 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:47.354589 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-8023c5a8-b377-4c16-aa6c-3d8e97d2a177 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:47.356012 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-8023c5a8-b377-4c16-aa6c-3d8e97d2a177 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:47.357093 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-8023c5a8-b377-4c16-aa6c-3d8e97d2a177 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1286 microversion: 2.20 time: 0.086217 Oct 29 01:12:47.358195 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 20/39] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:12:47 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:12:47.487366 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d67080da-0969-473f-abd6-176dd54ee542 tempest-VolumesGetTestJSON-1670648360 tempest-VolumesGetTestJSON-1670648360-project] Calling method '.version_select at 0x7f602a0105e0>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:47.493744 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-e386e820-bd3a-4137-84a4-903b19cad879 tempest-VolumesSnapshotsTestJSON-703580526 tempest-VolumesSnapshotsTestJSON-703580526-project] Calling method '.version_select at 0x7f6029f41b80>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:47.523724 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-e386e820-bd3a-4137-84a4-903b19cad879 tempest-VolumesSnapshotsTestJSON-703580526 tempest-VolumesSnapshotsTestJSON-703580526-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/ddb0e30a-9e72-4619-9212-2594d616cb4c" status: 200 len: 287 microversion: 2.1 time: 0.033765 Oct 29 01:12:47.524295 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 21/40] 10.222.0.90 () {58 vars in 1250 bytes} [Fri Oct 29 01:12:47 2021] GET /compute/v2.1/os-snapshots/ddb0e30a-9e72-4619-9212-2594d616cb4c => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:12:47.543774 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d67080da-0969-473f-abd6-176dd54ee542 tempest-VolumesGetTestJSON-1670648360 tempest-VolumesGetTestJSON-1670648360-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/a590710e-9bd2-4259-9e6b-b443b41874af" status: 200 len: 352 microversion: 2.1 time: 0.061344 Oct 29 01:12:47.544385 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 20/41] 10.222.0.90 () {58 vars in 1244 bytes} [Fri Oct 29 01:12:47 2021] GET /compute/v2.1/os-volumes/a590710e-9bd2-4259-9e6b-b443b41874af => generated 352 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:12:48.031903 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-6f45d31e-2e3f-4cf4-9e16-9e1e64901289 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:48.032624 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-6f45d31e-2e3f-4cf4-9e16-9e1e64901289 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:12:48.038513 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6f45d31e-2e3f-4cf4-9e16-9e1e64901289 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:48.039046 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6f45d31e-2e3f-4cf4-9e16-9e1e64901289 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:48.039824 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6f45d31e-2e3f-4cf4-9e16-9e1e64901289 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:48.040258 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6f45d31e-2e3f-4cf4-9e16-9e1e64901289 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:48.108142 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-6f45d31e-2e3f-4cf4-9e16-9e1e64901289 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:48.115858 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-6f45d31e-2e3f-4cf4-9e16-9e1e64901289 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1270 microversion: 2.1 time: 0.087978 Oct 29 01:12:48.116595 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 22/42] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:12:48 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1270 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:12:48.197789 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-47999f11-968f-4fcc-a9e5-d89ead67e6dc tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:48.198505 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-47999f11-968f-4fcc-a9e5-d89ead67e6dc tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:12:48.204996 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-47999f11-968f-4fcc-a9e5-d89ead67e6dc tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:48.205535 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-47999f11-968f-4fcc-a9e5-d89ead67e6dc tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:48.206361 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-47999f11-968f-4fcc-a9e5-d89ead67e6dc tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:48.206883 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-47999f11-968f-4fcc-a9e5-d89ead67e6dc tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:48.267222 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-47999f11-968f-4fcc-a9e5-d89ead67e6dc tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:48.275655 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-47999f11-968f-4fcc-a9e5-d89ead67e6dc tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1211 microversion: 2.1 time: 0.081135 Oct 29 01:12:48.276321 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 21/43] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:12:48 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1211 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:48.375647 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-39923d68-f4ed-484c-b427-96fc00c44ee4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:48.376535 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-39923d68-f4ed-484c-b427-96fc00c44ee4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:12:48.418162 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-39923d68-f4ed-484c-b427-96fc00c44ee4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:48.418162 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-39923d68-f4ed-484c-b427-96fc00c44ee4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:48.418162 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-39923d68-f4ed-484c-b427-96fc00c44ee4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:48.418162 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-39923d68-f4ed-484c-b427-96fc00c44ee4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:48.455618 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-39923d68-f4ed-484c-b427-96fc00c44ee4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:48.463163 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-39923d68-f4ed-484c-b427-96fc00c44ee4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:48.464667 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-39923d68-f4ed-484c-b427-96fc00c44ee4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:48.465748 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-39923d68-f4ed-484c-b427-96fc00c44ee4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1286 microversion: 2.20 time: 0.094304 Oct 29 01:12:48.466600 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 23/44] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:12:48 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1286 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:12:48.535383 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c35b7e2e-7a2e-4d64-b0fd-03391ec6b420 tempest-VolumesSnapshotsTestJSON-703580526 tempest-VolumesSnapshotsTestJSON-703580526-project] Calling method '.version_select at 0x7f602a0105e0>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:48.555295 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a4583fda-6f4b-412e-bb9c-46f4ef328e36 tempest-VolumesGetTestJSON-1670648360 tempest-VolumesGetTestJSON-1670648360-project] Calling method '.version_select at 0x7f6029f411f0>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:48.567781 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c35b7e2e-7a2e-4d64-b0fd-03391ec6b420 tempest-VolumesSnapshotsTestJSON-703580526 tempest-VolumesSnapshotsTestJSON-703580526-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/ddb0e30a-9e72-4619-9212-2594d616cb4c" status: 200 len: 287 microversion: 2.1 time: 0.036135 Oct 29 01:12:48.568344 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 22/45] 10.222.0.90 () {58 vars in 1250 bytes} [Fri Oct 29 01:12:48 2021] GET /compute/v2.1/os-snapshots/ddb0e30a-9e72-4619-9212-2594d616cb4c => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:12:48.617500 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a4583fda-6f4b-412e-bb9c-46f4ef328e36 tempest-VolumesGetTestJSON-1670648360 tempest-VolumesGetTestJSON-1670648360-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/a590710e-9bd2-4259-9e6b-b443b41874af" status: 200 len: 352 microversion: 2.1 time: 0.065657 Oct 29 01:12:48.618103 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 24/46] 10.222.0.90 () {58 vars in 1244 bytes} [Fri Oct 29 01:12:48 2021] GET /compute/v2.1/os-volumes/a590710e-9bd2-4259-9e6b-b443b41874af => generated 352 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:12:49.136053 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-0d06c9c4-5065-40d5-8fe9-1fbc99f49af5 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:49.146222 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-0d06c9c4-5065-40d5-8fe9-1fbc99f49af5 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:12:49.154992 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0d06c9c4-5065-40d5-8fe9-1fbc99f49af5 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:49.155447 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0d06c9c4-5065-40d5-8fe9-1fbc99f49af5 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:49.156229 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0d06c9c4-5065-40d5-8fe9-1fbc99f49af5 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:49.156739 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0d06c9c4-5065-40d5-8fe9-1fbc99f49af5 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:49.235314 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-0d06c9c4-5065-40d5-8fe9-1fbc99f49af5 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:49.244461 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-0d06c9c4-5065-40d5-8fe9-1fbc99f49af5 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1276 microversion: 2.1 time: 0.112915 Oct 29 01:12:49.245048 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 23/47] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:12:49 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1276 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:49.292765 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-4a442cc4-ce11-4869-aebe-ad55361cb274 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:49.293644 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-4a442cc4-ce11-4869-aebe-ad55361cb274 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:12:49.305058 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4a442cc4-ce11-4869-aebe-ad55361cb274 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:49.305667 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4a442cc4-ce11-4869-aebe-ad55361cb274 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:49.306693 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4a442cc4-ce11-4869-aebe-ad55361cb274 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:49.307324 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4a442cc4-ce11-4869-aebe-ad55361cb274 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:49.381315 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-4a442cc4-ce11-4869-aebe-ad55361cb274 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:49.391139 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-4a442cc4-ce11-4869-aebe-ad55361cb274 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1267 microversion: 2.1 time: 0.101897 Oct 29 01:12:49.391601 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 25/48] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:12:49 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1267 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:49.483292 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c2c5899b-d57d-4ff6-bece-78c9b03fb7f3 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:49.484900 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c2c5899b-d57d-4ff6-bece-78c9b03fb7f3 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:12:49.493030 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c2c5899b-d57d-4ff6-bece-78c9b03fb7f3 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:49.493493 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c2c5899b-d57d-4ff6-bece-78c9b03fb7f3 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:49.496239 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c2c5899b-d57d-4ff6-bece-78c9b03fb7f3 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:49.498174 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c2c5899b-d57d-4ff6-bece-78c9b03fb7f3 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:49.580317 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-4aed1ff8-2189-4647-837e-14e61edc9f15 tempest-VolumesSnapshotsTestJSON-703580526 tempest-VolumesSnapshotsTestJSON-703580526-project] Calling method '.version_select at 0x7f6029eed1f0>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:49.621618 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-c2c5899b-d57d-4ff6-bece-78c9b03fb7f3 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:49.635331 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-c2c5899b-d57d-4ff6-bece-78c9b03fb7f3 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:49.638097 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-c2c5899b-d57d-4ff6-bece-78c9b03fb7f3 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:49.646889 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c2c5899b-d57d-4ff6-bece-78c9b03fb7f3 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1278 microversion: 2.20 time: 0.167382 Oct 29 01:12:49.648656 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 24/49] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:12:49 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1278 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:12:49.657886 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-4c2c966f-67a7-404d-a72e-473b599a80f4 tempest-VolumesGetTestJSON-1670648360 tempest-VolumesGetTestJSON-1670648360-project] Calling method '.version_select at 0x7f60296ac4c0>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:49.799976 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.wsgi [None req-4aed1ff8-2189-4647-837e-14e61edc9f15 tempest-VolumesSnapshotsTestJSON-703580526 tempest-VolumesSnapshotsTestJSON-703580526-project] HTTP exception thrown: Snapshot ddb0e30a-9e72-4619-9212-2594d616cb4c could not be found. Oct 29 01:12:49.804556 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-4aed1ff8-2189-4647-837e-14e61edc9f15 tempest-VolumesSnapshotsTestJSON-703580526 tempest-VolumesSnapshotsTestJSON-703580526-project] Returning 404 to user: Snapshot ddb0e30a-9e72-4619-9212-2594d616cb4c could not be found. {{(pid=115747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:12:49.804556 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-4aed1ff8-2189-4647-837e-14e61edc9f15 tempest-VolumesSnapshotsTestJSON-703580526 tempest-VolumesSnapshotsTestJSON-703580526-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/ddb0e30a-9e72-4619-9212-2594d616cb4c" status: 404 len: 111 microversion: 2.1 time: 0.225808 Oct 29 01:12:49.805654 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 26/50] 10.222.0.90 () {58 vars in 1250 bytes} [Fri Oct 29 01:12:49 2021] GET /compute/v2.1/os-snapshots/ddb0e30a-9e72-4619-9212-2594d616cb4c => generated 111 bytes in 230 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:12:49.812689 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d2cf4ba9-05eb-41eb-91f8-5c58db0239de tempest-VolumesSnapshotsTestJSON-703580526 tempest-VolumesSnapshotsTestJSON-703580526-project] Calling method '.version_select at 0x7f6029fe2f70>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:49.840417 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.wsgi [None req-4c2c966f-67a7-404d-a72e-473b599a80f4 tempest-VolumesGetTestJSON-1670648360 tempest-VolumesGetTestJSON-1670648360-project] HTTP exception thrown: Volume a590710e-9bd2-4259-9e6b-b443b41874af could not be found. Oct 29 01:12:49.841554 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-4c2c966f-67a7-404d-a72e-473b599a80f4 tempest-VolumesGetTestJSON-1670648360 tempest-VolumesGetTestJSON-1670648360-project] Returning 404 to user: Volume a590710e-9bd2-4259-9e6b-b443b41874af could not be found. {{(pid=115748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:12:49.842573 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-4c2c966f-67a7-404d-a72e-473b599a80f4 tempest-VolumesGetTestJSON-1670648360 tempest-VolumesGetTestJSON-1670648360-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/a590710e-9bd2-4259-9e6b-b443b41874af" status: 404 len: 109 microversion: 2.1 time: 0.192670 Oct 29 01:12:49.843373 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 25/51] 10.222.0.90 () {58 vars in 1244 bytes} [Fri Oct 29 01:12:49 2021] GET /compute/v2.1/os-volumes/a590710e-9bd2-4259-9e6b-b443b41874af => generated 109 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:12:50.020693 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d2cf4ba9-05eb-41eb-91f8-5c58db0239de tempest-VolumesSnapshotsTestJSON-703580526 tempest-VolumesSnapshotsTestJSON-703580526-project] 10.222.0.90 "DELETE /compute/v2.1/os-volumes/33cbef0d-1743-406e-9e97-35317085382f" status: 202 len: 0 microversion: 2.1 time: 0.213490 Oct 29 01:12:50.021272 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 27/52] 10.222.0.90 () {58 vars in 1247 bytes} [Fri Oct 29 01:12:49 2021] DELETE /compute/v2.1/os-volumes/33cbef0d-1743-406e-9e97-35317085382f => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:12:50.032282 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-fe2d8d70-9d7c-4b47-9847-21c67ead95b5 tempest-VolumesSnapshotsTestJSON-703580526 tempest-VolumesSnapshotsTestJSON-703580526-project] Calling method '.version_select at 0x7f6029733940>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:50.262546 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-fd89ed6e-d19e-4981-a151-c80488c5088a tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:50.264193 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-fd89ed6e-d19e-4981-a151-c80488c5088a tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:12:50.279276 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-fe2d8d70-9d7c-4b47-9847-21c67ead95b5 tempest-VolumesSnapshotsTestJSON-703580526 tempest-VolumesSnapshotsTestJSON-703580526-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/33cbef0d-1743-406e-9e97-35317085382f" status: 200 len: 345 microversion: 2.1 time: 0.252934 Oct 29 01:12:50.280504 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 26/53] 10.222.0.90 () {58 vars in 1244 bytes} [Fri Oct 29 01:12:50 2021] GET /compute/v2.1/os-volumes/33cbef0d-1743-406e-9e97-35317085382f => generated 345 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:12:50.280847 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fd89ed6e-d19e-4981-a151-c80488c5088a tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:50.281368 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fd89ed6e-d19e-4981-a151-c80488c5088a tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:50.282343 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fd89ed6e-d19e-4981-a151-c80488c5088a tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:50.293933 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fd89ed6e-d19e-4981-a151-c80488c5088a tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:50.408015 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-4f2e446b-9043-48cd-bb02-c27c6465689e tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:50.409206 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-4f2e446b-9043-48cd-bb02-c27c6465689e tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:12:50.426657 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4f2e446b-9043-48cd-bb02-c27c6465689e tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:50.427625 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4f2e446b-9043-48cd-bb02-c27c6465689e tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:50.428771 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4f2e446b-9043-48cd-bb02-c27c6465689e tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:50.429828 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4f2e446b-9043-48cd-bb02-c27c6465689e tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:50.696495 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-fd89ed6e-d19e-4981-a151-c80488c5088a tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:50.712238 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-fd89ed6e-d19e-4981-a151-c80488c5088a tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1276 microversion: 2.1 time: 0.453978 Oct 29 01:12:50.714246 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 28/54] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:12:50 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1276 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:50.745088 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-1370ceb0-0d62-4adf-b139-a4963d4fa819 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:50.752648 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-4f2e446b-9043-48cd-bb02-c27c6465689e tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:50.754515 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-1370ceb0-0d62-4adf-b139-a4963d4fa819 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:12:50.764419 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-4f2e446b-9043-48cd-bb02-c27c6465689e tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1273 microversion: 2.1 time: 0.360802 Oct 29 01:12:50.769744 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 27/55] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:12:50 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1273 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:12:50.807242 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1370ceb0-0d62-4adf-b139-a4963d4fa819 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:50.815886 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1370ceb0-0d62-4adf-b139-a4963d4fa819 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:50.817568 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1370ceb0-0d62-4adf-b139-a4963d4fa819 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:50.821381 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1370ceb0-0d62-4adf-b139-a4963d4fa819 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:51.072693 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-1370ceb0-0d62-4adf-b139-a4963d4fa819 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:51.086158 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-1370ceb0-0d62-4adf-b139-a4963d4fa819 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:51.107422 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-1370ceb0-0d62-4adf-b139-a4963d4fa819 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:51.107422 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-1370ceb0-0d62-4adf-b139-a4963d4fa819 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1352 microversion: 2.20 time: 0.378607 Oct 29 01:12:51.107422 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 29/56] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:12:50 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1352 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:12:51.297117 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d8646cbe-0bc4-43d2-a524-45e7c7d0693a tempest-VolumesSnapshotsTestJSON-703580526 tempest-VolumesSnapshotsTestJSON-703580526-project] Calling method '.version_select at 0x7f602973c430>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:51.369761 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.wsgi [None req-d8646cbe-0bc4-43d2-a524-45e7c7d0693a tempest-VolumesSnapshotsTestJSON-703580526 tempest-VolumesSnapshotsTestJSON-703580526-project] HTTP exception thrown: Volume 33cbef0d-1743-406e-9e97-35317085382f could not be found. Oct 29 01:12:51.371056 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d8646cbe-0bc4-43d2-a524-45e7c7d0693a tempest-VolumesSnapshotsTestJSON-703580526 tempest-VolumesSnapshotsTestJSON-703580526-project] Returning 404 to user: Volume 33cbef0d-1743-406e-9e97-35317085382f could not be found. {{(pid=115748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:12:51.372603 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d8646cbe-0bc4-43d2-a524-45e7c7d0693a tempest-VolumesSnapshotsTestJSON-703580526 tempest-VolumesSnapshotsTestJSON-703580526-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/33cbef0d-1743-406e-9e97-35317085382f" status: 404 len: 109 microversion: 2.1 time: 0.083977 Oct 29 01:12:51.373165 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 28/57] 10.222.0.90 () {58 vars in 1244 bytes} [Fri Oct 29 01:12:51 2021] GET /compute/v2.1/os-volumes/33cbef0d-1743-406e-9e97-35317085382f => generated 109 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:12:51.388956 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-cbf35c13-fa54-43fe-866f-99a72ea0317b tempest-VolumesSnapshotsTestJSON-703580526 tempest-VolumesSnapshotsTestJSON-703580526-project] Calling method '.version_select at 0x7f6029eed700>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:51.689051 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.wsgi [None req-cbf35c13-fa54-43fe-866f-99a72ea0317b tempest-VolumesSnapshotsTestJSON-703580526 tempest-VolumesSnapshotsTestJSON-703580526-project] HTTP exception thrown: Volume 33cbef0d-1743-406e-9e97-35317085382f could not be found. Oct 29 01:12:51.690149 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-cbf35c13-fa54-43fe-866f-99a72ea0317b tempest-VolumesSnapshotsTestJSON-703580526 tempest-VolumesSnapshotsTestJSON-703580526-project] Returning 404 to user: Volume 33cbef0d-1743-406e-9e97-35317085382f could not be found. {{(pid=115747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:12:51.691209 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-cbf35c13-fa54-43fe-866f-99a72ea0317b tempest-VolumesSnapshotsTestJSON-703580526 tempest-VolumesSnapshotsTestJSON-703580526-project] 10.222.0.90 "DELETE /compute/v2.1/os-volumes/33cbef0d-1743-406e-9e97-35317085382f" status: 404 len: 109 microversion: 2.1 time: 0.312813 Oct 29 01:12:51.692102 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 30/58] 10.222.0.90 () {58 vars in 1247 bytes} [Fri Oct 29 01:12:51 2021] DELETE /compute/v2.1/os-volumes/33cbef0d-1743-406e-9e97-35317085382f => generated 109 bytes in 314 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:12:51.701609 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-db40404e-d907-4456-a52b-40a97c93d835 tempest-VolumesSnapshotsTestJSON-703580526 tempest-VolumesSnapshotsTestJSON-703580526-project] Calling method '.version_select at 0x7f60296a1940>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:51.741959 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-128151b3-967a-44fc-94be-f7fb8e8c9c87 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:51.744033 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-128151b3-967a-44fc-94be-f7fb8e8c9c87 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:12:51.768593 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-128151b3-967a-44fc-94be-f7fb8e8c9c87 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:51.769460 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-128151b3-967a-44fc-94be-f7fb8e8c9c87 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:51.773807 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-128151b3-967a-44fc-94be-f7fb8e8c9c87 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:51.774631 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-128151b3-967a-44fc-94be-f7fb8e8c9c87 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:51.969314 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.wsgi [None req-db40404e-d907-4456-a52b-40a97c93d835 tempest-VolumesSnapshotsTestJSON-703580526 tempest-VolumesSnapshotsTestJSON-703580526-project] HTTP exception thrown: Volume 33cbef0d-1743-406e-9e97-35317085382f could not be found. Oct 29 01:12:51.971234 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-db40404e-d907-4456-a52b-40a97c93d835 tempest-VolumesSnapshotsTestJSON-703580526 tempest-VolumesSnapshotsTestJSON-703580526-project] Returning 404 to user: Volume 33cbef0d-1743-406e-9e97-35317085382f could not be found. {{(pid=115748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:12:51.972815 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-db40404e-d907-4456-a52b-40a97c93d835 tempest-VolumesSnapshotsTestJSON-703580526 tempest-VolumesSnapshotsTestJSON-703580526-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/33cbef0d-1743-406e-9e97-35317085382f" status: 404 len: 109 microversion: 2.1 time: 0.276162 Oct 29 01:12:51.974564 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 29/59] 10.222.0.90 () {58 vars in 1244 bytes} [Fri Oct 29 01:12:51 2021] GET /compute/v2.1/os-volumes/33cbef0d-1743-406e-9e97-35317085382f => generated 109 bytes in 279 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:12:51.991151 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-41b9039d-e0d6-4215-bd5b-a38d8a366c4f tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:51.998291 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-41b9039d-e0d6-4215-bd5b-a38d8a366c4f tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:12:52.025663 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-41b9039d-e0d6-4215-bd5b-a38d8a366c4f tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:52.026907 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-41b9039d-e0d6-4215-bd5b-a38d8a366c4f tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:52.028957 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-41b9039d-e0d6-4215-bd5b-a38d8a366c4f tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:52.030194 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-41b9039d-e0d6-4215-bd5b-a38d8a366c4f tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:52.608020 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-128151b3-967a-44fc-94be-f7fb8e8c9c87 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:52.620945 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-128151b3-967a-44fc-94be-f7fb8e8c9c87 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1318 microversion: 2.1 time: 0.890328 Oct 29 01:12:52.624537 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 31/60] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:12:51 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1318 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:52.633621 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-4ee7cfbb-6411-4d97-9149-3367af3e8736 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:52.636452 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-4ee7cfbb-6411-4d97-9149-3367af3e8736 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:12:52.651373 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4ee7cfbb-6411-4d97-9149-3367af3e8736 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:52.653582 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4ee7cfbb-6411-4d97-9149-3367af3e8736 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:52.656188 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4ee7cfbb-6411-4d97-9149-3367af3e8736 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:52.658543 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4ee7cfbb-6411-4d97-9149-3367af3e8736 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:52.671489 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-41b9039d-e0d6-4215-bd5b-a38d8a366c4f tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:52.682529 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-41b9039d-e0d6-4215-bd5b-a38d8a366c4f tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1315 microversion: 2.1 time: 0.706355 Oct 29 01:12:52.683597 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 30/61] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:12:51 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1315 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:52.765008 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-4ee7cfbb-6411-4d97-9149-3367af3e8736 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:52.775593 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-4ee7cfbb-6411-4d97-9149-3367af3e8736 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:52.786199 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-4ee7cfbb-6411-4d97-9149-3367af3e8736 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:52.787514 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-4ee7cfbb-6411-4d97-9149-3367af3e8736 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1340 microversion: 2.20 time: 0.161624 Oct 29 01:12:52.788173 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 32/62] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:12:52 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1340 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:12:53.640807 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-bf31b750-2abf-421e-aa6f-67c092cb5c50 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:53.641573 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-bf31b750-2abf-421e-aa6f-67c092cb5c50 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:12:53.650657 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bf31b750-2abf-421e-aa6f-67c092cb5c50 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:53.655199 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bf31b750-2abf-421e-aa6f-67c092cb5c50 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:53.656207 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bf31b750-2abf-421e-aa6f-67c092cb5c50 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:53.656656 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bf31b750-2abf-421e-aa6f-67c092cb5c50 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:53.699668 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f61862e6-aa81-4402-97f3-0ed4a37fcc0f tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:53.701089 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f61862e6-aa81-4402-97f3-0ed4a37fcc0f tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:12:53.708982 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f61862e6-aa81-4402-97f3-0ed4a37fcc0f tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:53.709722 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f61862e6-aa81-4402-97f3-0ed4a37fcc0f tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:53.717005 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f61862e6-aa81-4402-97f3-0ed4a37fcc0f tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:53.717464 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f61862e6-aa81-4402-97f3-0ed4a37fcc0f tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:54.146851 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-bf31b750-2abf-421e-aa6f-67c092cb5c50 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:54.155689 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-bf31b750-2abf-421e-aa6f-67c092cb5c50 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1318 microversion: 2.1 time: 0.518966 Oct 29 01:12:54.174023 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 31/63] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:12:53 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1318 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:54.181988 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-f61862e6-aa81-4402-97f3-0ed4a37fcc0f tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:54.193461 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f61862e6-aa81-4402-97f3-0ed4a37fcc0f tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1315 microversion: 2.1 time: 0.497001 Oct 29 01:12:54.195766 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 33/64] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:12:53 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1315 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:12:54.199572 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d87e263b-7b6a-4640-b61b-57cecf1f1c95 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:54.201335 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d87e263b-7b6a-4640-b61b-57cecf1f1c95 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:12:54.221196 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d87e263b-7b6a-4640-b61b-57cecf1f1c95 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:54.225966 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d87e263b-7b6a-4640-b61b-57cecf1f1c95 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:54.227044 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d87e263b-7b6a-4640-b61b-57cecf1f1c95 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:54.228576 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d87e263b-7b6a-4640-b61b-57cecf1f1c95 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:54.448373 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-d87e263b-7b6a-4640-b61b-57cecf1f1c95 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:54.471775 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-d87e263b-7b6a-4640-b61b-57cecf1f1c95 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:54.482605 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-d87e263b-7b6a-4640-b61b-57cecf1f1c95 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:54.508157 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d87e263b-7b6a-4640-b61b-57cecf1f1c95 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1340 microversion: 2.20 time: 0.324779 Oct 29 01:12:54.528877 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 32/65] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:12:54 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1340 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:12:55.088829 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-dbcb6007-aa0a-4aa1-9c57-776a8524fed8 tempest-VolumesNegativeTest-716949326 tempest-VolumesNegativeTest-716949326-project] Action: 'create', calling method: .version_select at 0x7f6029f41e50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-569512785", "metadata": {"Type": "work"}}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:12:55.090428 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-dbcb6007-aa0a-4aa1-9c57-776a8524fed8 tempest-VolumesNegativeTest-716949326 tempest-VolumesNegativeTest-716949326-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=115747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:12:55.091856 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-dbcb6007-aa0a-4aa1-9c57-776a8524fed8 tempest-VolumesNegativeTest-716949326 tempest-VolumesNegativeTest-716949326-project] 10.222.0.90 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.203451 Oct 29 01:12:55.092786 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 34/66] 10.222.0.90 () {60 vars in 1155 bytes} [Fri Oct 29 01:12:54 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 205 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:12:55.101827 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-222537db-62d1-48e2-8ebc-8e0d3b45b540 tempest-VolumesNegativeTest-716949326 tempest-VolumesNegativeTest-716949326-project] Action: 'create', calling method: .version_select at 0x7f60296a1550>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-966614799", "metadata": {"Type": "work"}}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:12:55.107220 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-222537db-62d1-48e2-8ebc-8e0d3b45b540 tempest-VolumesNegativeTest-716949326 tempest-VolumesNegativeTest-716949326-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=115748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:12:55.108611 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-222537db-62d1-48e2-8ebc-8e0d3b45b540 tempest-VolumesNegativeTest-716949326 tempest-VolumesNegativeTest-716949326-project] 10.222.0.90 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010662 Oct 29 01:12:55.114961 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 33/67] 10.222.0.90 () {60 vars in 1155 bytes} [Fri Oct 29 01:12:55 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:12:55.129197 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9714ed8d-7008-4801-a9ab-b9138a4f8aa7 tempest-VolumesNegativeTest-716949326 tempest-VolumesNegativeTest-716949326-project] Action: 'create', calling method: .version_select at 0x7f6029eed160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1512484131", "metadata": {"Type": "work"}}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:12:55.132457 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9714ed8d-7008-4801-a9ab-b9138a4f8aa7 tempest-VolumesNegativeTest-716949326 tempest-VolumesNegativeTest-716949326-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=115747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:12:55.133672 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9714ed8d-7008-4801-a9ab-b9138a4f8aa7 tempest-VolumesNegativeTest-716949326 tempest-VolumesNegativeTest-716949326-project] 10.222.0.90 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013222 Oct 29 01:12:55.136651 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 35/68] 10.222.0.90 () {60 vars in 1155 bytes} [Fri Oct 29 01:12:55 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:12:55.150703 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2a2375f4-26b1-44d1-9e5d-fea95df868d0 tempest-VolumesNegativeTest-716949326 tempest-VolumesNegativeTest-716949326-project] Calling method '.version_select at 0x7f60297060d0>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:55.195598 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-8ea5e5b3-a86b-437e-9ba8-4f733361dfbf tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:55.200109 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-8ea5e5b3-a86b-437e-9ba8-4f733361dfbf tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:12:55.210514 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.wsgi [None req-2a2375f4-26b1-44d1-9e5d-fea95df868d0 tempest-VolumesNegativeTest-716949326 tempest-VolumesNegativeTest-716949326-project] HTTP exception thrown: Volume tempest-invalid-241460949 could not be found. Oct 29 01:12:55.211875 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2a2375f4-26b1-44d1-9e5d-fea95df868d0 tempest-VolumesNegativeTest-716949326 tempest-VolumesNegativeTest-716949326-project] Returning 404 to user: Volume tempest-invalid-241460949 could not be found. {{(pid=115748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:12:55.224162 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2a2375f4-26b1-44d1-9e5d-fea95df868d0 tempest-VolumesNegativeTest-716949326 tempest-VolumesNegativeTest-716949326-project] 10.222.0.90 "DELETE /compute/v2.1/os-volumes/tempest-invalid-241460949" status: 404 len: 98 microversion: 2.1 time: 0.081581 Oct 29 01:12:55.226715 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 34/69] 10.222.0.90 () {58 vars in 1214 bytes} [Fri Oct 29 01:12:55 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-241460949 => generated 98 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:12:55.227368 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8ea5e5b3-a86b-437e-9ba8-4f733361dfbf tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:55.231316 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8ea5e5b3-a86b-437e-9ba8-4f733361dfbf tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:55.234342 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8ea5e5b3-a86b-437e-9ba8-4f733361dfbf tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:55.240634 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8ea5e5b3-a86b-437e-9ba8-4f733361dfbf tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:55.245853 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-79f17ad5-46f6-4a5d-b839-dd349417d7a1 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:55.255831 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-79f17ad5-46f6-4a5d-b839-dd349417d7a1 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:12:55.270357 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-79f17ad5-46f6-4a5d-b839-dd349417d7a1 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:55.272614 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-79f17ad5-46f6-4a5d-b839-dd349417d7a1 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:55.276713 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-79f17ad5-46f6-4a5d-b839-dd349417d7a1 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:55.276713 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-79f17ad5-46f6-4a5d-b839-dd349417d7a1 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:55.605445 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-8ea5e5b3-a86b-437e-9ba8-4f733361dfbf tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:55.616175 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-8ea5e5b3-a86b-437e-9ba8-4f733361dfbf tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1318 microversion: 2.1 time: 0.440319 Oct 29 01:12:55.621389 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 36/70] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:12:55 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1318 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:55.627312 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-79f17ad5-46f6-4a5d-b839-dd349417d7a1 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:55.634050 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ae2e6664-61e2-494f-ba2d-33f13ed1a043 tempest-VolumesNegativeTest-716949326 tempest-VolumesNegativeTest-716949326-project] 10.222.0.90 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011380 Oct 29 01:12:55.639905 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-79f17ad5-46f6-4a5d-b839-dd349417d7a1 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1315 microversion: 2.1 time: 0.407442 Oct 29 01:12:55.641212 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 35/71] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:12:55 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1315 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:55.646197 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 37/72] 10.222.0.90 () {58 vars in 1139 bytes} [Fri Oct 29 01:12:55 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 29 01:12:55.657865 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f89dae94-405d-49a0-a93e-367f7e7d7501 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:55.658961 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f89dae94-405d-49a0-a93e-367f7e7d7501 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:12:55.665202 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f89dae94-405d-49a0-a93e-367f7e7d7501 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:55.665850 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f89dae94-405d-49a0-a93e-367f7e7d7501 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:55.667003 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f89dae94-405d-49a0-a93e-367f7e7d7501 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:55.667574 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f89dae94-405d-49a0-a93e-367f7e7d7501 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:55.916735 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-f89dae94-405d-49a0-a93e-367f7e7d7501 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:55.933952 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-f89dae94-405d-49a0-a93e-367f7e7d7501 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:55.937947 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-f89dae94-405d-49a0-a93e-367f7e7d7501 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:55.948952 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f89dae94-405d-49a0-a93e-367f7e7d7501 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1408 microversion: 2.20 time: 0.287500 Oct 29 01:12:55.959841 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 36/73] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:12:55 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1408 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:12:55.975668 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-07b023d5-7233-4964-9b9e-399c1262fe1b tempest-VolumesNegativeTest-716949326 tempest-VolumesNegativeTest-716949326-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.022111 Oct 29 01:12:55.977534 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 37/74] 10.222.0.90 () {58 vars in 1136 bytes} [Fri Oct 29 01:12:55 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 27 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 29 01:12:55.994812 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-76566deb-f761-4af3-a375-3ae3ddb55a62 tempest-VolumesNegativeTest-716949326 tempest-VolumesNegativeTest-716949326-project] Calling method '.version_select at 0x7f60296a15e0>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:56.053312 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.wsgi [None req-76566deb-f761-4af3-a375-3ae3ddb55a62 tempest-VolumesNegativeTest-716949326 tempest-VolumesNegativeTest-716949326-project] HTTP exception thrown: Volume b3eeec7c-2123-41ae-be5d-4eb65d684c1f could not be found. Oct 29 01:12:56.053925 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-76566deb-f761-4af3-a375-3ae3ddb55a62 tempest-VolumesNegativeTest-716949326 tempest-VolumesNegativeTest-716949326-project] Returning 404 to user: Volume b3eeec7c-2123-41ae-be5d-4eb65d684c1f could not be found. {{(pid=115748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:12:56.054839 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-76566deb-f761-4af3-a375-3ae3ddb55a62 tempest-VolumesNegativeTest-716949326 tempest-VolumesNegativeTest-716949326-project] 10.222.0.90 "DELETE /compute/v2.1/os-volumes/b3eeec7c-2123-41ae-be5d-4eb65d684c1f" status: 404 len: 109 microversion: 2.1 time: 0.070190 Oct 29 01:12:56.055393 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 38/75] 10.222.0.90 () {58 vars in 1247 bytes} [Fri Oct 29 01:12:55 2021] DELETE /compute/v2.1/os-volumes/b3eeec7c-2123-41ae-be5d-4eb65d684c1f => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:12:56.066479 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-218c4604-a230-4818-b125-113fccdb667c tempest-VolumesNegativeTest-716949326 tempest-VolumesNegativeTest-716949326-project] Calling method '.version_select at 0x7f6029706ca0>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:56.105885 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.wsgi [None req-218c4604-a230-4818-b125-113fccdb667c tempest-VolumesNegativeTest-716949326 tempest-VolumesNegativeTest-716949326-project] HTTP exception thrown: Volume 7762573c-11d7-49c7-b478-1b82978a0c7e could not be found. Oct 29 01:12:56.106575 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-218c4604-a230-4818-b125-113fccdb667c tempest-VolumesNegativeTest-716949326 tempest-VolumesNegativeTest-716949326-project] Returning 404 to user: Volume 7762573c-11d7-49c7-b478-1b82978a0c7e could not be found. {{(pid=115748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:12:56.107389 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-218c4604-a230-4818-b125-113fccdb667c tempest-VolumesNegativeTest-716949326 tempest-VolumesNegativeTest-716949326-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/7762573c-11d7-49c7-b478-1b82978a0c7e" status: 404 len: 109 microversion: 2.1 time: 0.044945 Oct 29 01:12:56.107933 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 39/76] 10.222.0.90 () {58 vars in 1244 bytes} [Fri Oct 29 01:12:56 2021] GET /compute/v2.1/os-volumes/7762573c-11d7-49c7-b478-1b82978a0c7e => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:12:56.162351 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [req-5a038ccb-fc82-46d7-a7c4-003896fbd8bd req-5c77c4ff-96cd-4dc4-bb3d-6524172f547f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e789e569-3570-483f-8768-27b5be53c535", "tag": "df5dbe79-b13c-4a7f-a7df-7f7b2b74a2db"}]} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:12:56.165168 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:12:56.165168 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: warnings.warn(msg) Oct 29 01:12:56.189185 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-5a038ccb-fc82-46d7-a7c4-003896fbd8bd req-5c77c4ff-96cd-4dc4-bb3d-6524172f547f service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:56.191041 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-5a038ccb-fc82-46d7-a7c4-003896fbd8bd req-5c77c4ff-96cd-4dc4-bb3d-6524172f547f service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:56.226763 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.compute.server_external_events [req-5a038ccb-fc82-46d7-a7c4-003896fbd8bd req-5c77c4ff-96cd-4dc4-bb3d-6524172f547f service nova] Creating event network-changed:df5dbe79-b13c-4a7f-a7df-7f7b2b74a2db for instance e789e569-3570-483f-8768-27b5be53c535 on hv-cinder-81558 Oct 29 01:12:56.229182 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-5a038ccb-fc82-46d7-a7c4-003896fbd8bd req-5c77c4ff-96cd-4dc4-bb3d-6524172f547f service nova] Acquired lock "compute-rpcapi-router" {{(pid=115747) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Oct 29 01:12:56.230977 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5132a741-7a3c-4f99-bcaf-c4d3daad42de None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:56.232338 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5132a741-7a3c-4f99-bcaf-c4d3daad42de None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:56.233651 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5132a741-7a3c-4f99-bcaf-c4d3daad42de None None] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:56.234677 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5132a741-7a3c-4f99-bcaf-c4d3daad42de None None] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:56.244872 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.compute.rpcapi [None req-5132a741-7a3c-4f99-bcaf-c4d3daad42de None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Oct 29 01:12:56.246090 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5132a741-7a3c-4f99-bcaf-c4d3daad42de None None] Releasing lock "compute-rpcapi-router" {{(pid=115747) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Oct 29 01:12:56.275408 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-5132a741-7a3c-4f99-bcaf-c4d3daad42de None None] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.627696 Oct 29 01:12:56.276743 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 38/77] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:12:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:12:56.638812 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-dd530c10-3538-486a-8484-55dc731aaace tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:56.640474 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-dd530c10-3538-486a-8484-55dc731aaace tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:12:56.647933 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dd530c10-3538-486a-8484-55dc731aaace tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:56.648695 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dd530c10-3538-486a-8484-55dc731aaace tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:56.650003 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dd530c10-3538-486a-8484-55dc731aaace tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:56.650768 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dd530c10-3538-486a-8484-55dc731aaace tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:56.659591 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-91ae4ef1-d9ab-47ab-98a6-bdea4d467895 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:56.661612 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-91ae4ef1-d9ab-47ab-98a6-bdea4d467895 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:12:56.675852 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-91ae4ef1-d9ab-47ab-98a6-bdea4d467895 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:56.676495 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-91ae4ef1-d9ab-47ab-98a6-bdea4d467895 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:56.677357 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-91ae4ef1-d9ab-47ab-98a6-bdea4d467895 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:56.677899 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-91ae4ef1-d9ab-47ab-98a6-bdea4d467895 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:56.914923 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-91ae4ef1-d9ab-47ab-98a6-bdea4d467895 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:56.922891 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-91ae4ef1-d9ab-47ab-98a6-bdea4d467895 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1315 microversion: 2.1 time: 0.268310 Oct 29 01:12:56.927637 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 39/78] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:12:56 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:56.962559 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-dd530c10-3538-486a-8484-55dc731aaace tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:56.971901 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-7c2c5651-478e-4273-a13f-42d679722964 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:56.975525 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-7c2c5651-478e-4273-a13f-42d679722964 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:12:56.983555 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-dd530c10-3538-486a-8484-55dc731aaace tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1318 microversion: 2.1 time: 0.350396 Oct 29 01:12:56.984920 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 40/79] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:12:56 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1318 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:56.999567 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7c2c5651-478e-4273-a13f-42d679722964 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:57.000108 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7c2c5651-478e-4273-a13f-42d679722964 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:57.000971 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7c2c5651-478e-4273-a13f-42d679722964 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:57.002349 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7c2c5651-478e-4273-a13f-42d679722964 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:57.314914 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-7c2c5651-478e-4273-a13f-42d679722964 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:57.325954 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-7c2c5651-478e-4273-a13f-42d679722964 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:57.327702 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-7c2c5651-478e-4273-a13f-42d679722964 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:57.330023 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-7c2c5651-478e-4273-a13f-42d679722964 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1408 microversion: 2.20 time: 0.361573 Oct 29 01:12:57.342275 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 40/80] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:12:56 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1408 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:12:57.943877 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-75fb2a6f-aaee-4070-ad73-b6ff298c1faf tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:57.944492 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-75fb2a6f-aaee-4070-ad73-b6ff298c1faf tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:12:57.950288 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-75fb2a6f-aaee-4070-ad73-b6ff298c1faf tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:57.950790 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-75fb2a6f-aaee-4070-ad73-b6ff298c1faf tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:57.951566 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-75fb2a6f-aaee-4070-ad73-b6ff298c1faf tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:57.952003 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-75fb2a6f-aaee-4070-ad73-b6ff298c1faf tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:58.004315 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-fcc596e7-2220-412e-9a32-88ba3e9c95de tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:58.006741 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-fcc596e7-2220-412e-9a32-88ba3e9c95de tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:12:58.047251 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fcc596e7-2220-412e-9a32-88ba3e9c95de tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:58.049064 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fcc596e7-2220-412e-9a32-88ba3e9c95de tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:58.050023 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fcc596e7-2220-412e-9a32-88ba3e9c95de tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:58.051813 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fcc596e7-2220-412e-9a32-88ba3e9c95de tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:58.224567 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-75fb2a6f-aaee-4070-ad73-b6ff298c1faf tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:58.234127 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-75fb2a6f-aaee-4070-ad73-b6ff298c1faf tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1315 microversion: 2.1 time: 0.293869 Oct 29 01:12:58.234739 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 41/81] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:12:57 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1315 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:58.291296 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-fcc596e7-2220-412e-9a32-88ba3e9c95de tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:58.301658 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-fcc596e7-2220-412e-9a32-88ba3e9c95de tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1318 microversion: 2.1 time: 0.303312 Oct 29 01:12:58.302555 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 41/82] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:12:57 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1318 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:58.348786 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-0f164a8e-1e5e-4d49-b363-802e7b07b18e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:58.349410 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-0f164a8e-1e5e-4d49-b363-802e7b07b18e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:12:58.359007 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0f164a8e-1e5e-4d49-b363-802e7b07b18e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:58.359984 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0f164a8e-1e5e-4d49-b363-802e7b07b18e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:58.363401 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0f164a8e-1e5e-4d49-b363-802e7b07b18e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:58.364030 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0f164a8e-1e5e-4d49-b363-802e7b07b18e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:58.439767 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-0fed3076-33f0-41be-981a-0d9db2ba8be6 tempest-VolumesTestJSON-1443441488 tempest-VolumesTestJSON-1443441488-project] Calling method '.version_select at 0x7f6029f41a60>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:58.526203 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-0fed3076-33f0-41be-981a-0d9db2ba8be6 tempest-VolumesTestJSON-1443441488 tempest-VolumesTestJSON-1443441488-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/b32e8d9b-bf6e-47fc-9d19-59c4b42fe5e3" status: 200 len: 350 microversion: 2.1 time: 0.091360 Oct 29 01:12:58.527204 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 42/83] 10.222.0.90 () {58 vars in 1244 bytes} [Fri Oct 29 01:12:58 2021] GET /compute/v2.1/os-volumes/b32e8d9b-bf6e-47fc-9d19-59c4b42fe5e3 => generated 350 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:12:58.557368 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-0f164a8e-1e5e-4d49-b363-802e7b07b18e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:58.572720 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-0f164a8e-1e5e-4d49-b363-802e7b07b18e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:58.574760 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-0f164a8e-1e5e-4d49-b363-802e7b07b18e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:58.576091 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-0f164a8e-1e5e-4d49-b363-802e7b07b18e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1408 microversion: 2.20 time: 0.230985 Oct 29 01:12:58.576805 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 42/84] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:12:58 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1408 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:12:59.252503 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-77076210-e48a-4a63-80ef-124a0e9e4e01 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:59.255092 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-77076210-e48a-4a63-80ef-124a0e9e4e01 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:12:59.264157 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-77076210-e48a-4a63-80ef-124a0e9e4e01 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:59.265366 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-77076210-e48a-4a63-80ef-124a0e9e4e01 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:59.266951 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-77076210-e48a-4a63-80ef-124a0e9e4e01 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:59.267580 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-77076210-e48a-4a63-80ef-124a0e9e4e01 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:59.321532 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-25033890-85fd-4211-aaaa-ac2729c8f5f8 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:59.325633 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-25033890-85fd-4211-aaaa-ac2729c8f5f8 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:12:59.348271 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-25033890-85fd-4211-aaaa-ac2729c8f5f8 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:59.360539 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-25033890-85fd-4211-aaaa-ac2729c8f5f8 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:59.361549 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-25033890-85fd-4211-aaaa-ac2729c8f5f8 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:59.361996 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-25033890-85fd-4211-aaaa-ac2729c8f5f8 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:59.595490 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-77076210-e48a-4a63-80ef-124a0e9e4e01 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:59.603667 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-77076210-e48a-4a63-80ef-124a0e9e4e01 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1315 microversion: 2.1 time: 0.355947 Oct 29 01:12:59.604389 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 43/85] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:12:59 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1315 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:59.618731 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-07f88547-8bb7-4b36-bce6-70c8251e3015 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:59.619344 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-07f88547-8bb7-4b36-bce6-70c8251e3015 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:12:59.627353 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-07f88547-8bb7-4b36-bce6-70c8251e3015 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:59.627815 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-07f88547-8bb7-4b36-bce6-70c8251e3015 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:59.628576 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-07f88547-8bb7-4b36-bce6-70c8251e3015 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:12:59.629007 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-07f88547-8bb7-4b36-bce6-70c8251e3015 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:12:59.683655 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-25033890-85fd-4211-aaaa-ac2729c8f5f8 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:59.693649 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-25033890-85fd-4211-aaaa-ac2729c8f5f8 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1318 microversion: 2.1 time: 0.378160 Oct 29 01:12:59.699745 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 43/86] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:12:59 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1318 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:59.823472 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-07f88547-8bb7-4b36-bce6-70c8251e3015 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:59.838714 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-07f88547-8bb7-4b36-bce6-70c8251e3015 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:59.843174 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-07f88547-8bb7-4b36-bce6-70c8251e3015 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:59.848235 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-07f88547-8bb7-4b36-bce6-70c8251e3015 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1408 microversion: 2.20 time: 0.232962 Oct 29 01:12:59.848806 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 44/87] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:12:59 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1408 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:13:00.532033 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-1d6cd92e-215f-4b22-8657-c079132e9a97 tempest-VolumesTestJSON-1443441488 tempest-VolumesTestJSON-1443441488-project] Calling method '.version_select at 0x7f6029706d30>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:00.609099 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-1d6cd92e-215f-4b22-8657-c079132e9a97 tempest-VolumesTestJSON-1443441488 tempest-VolumesTestJSON-1443441488-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/12d6b389-e722-47a2-a8bf-7eda3c861af8" status: 200 len: 349 microversion: 2.1 time: 0.088501 Oct 29 01:13:00.618082 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 44/88] 10.222.0.90 () {58 vars in 1244 bytes} [Fri Oct 29 01:13:00 2021] GET /compute/v2.1/os-volumes/12d6b389-e722-47a2-a8bf-7eda3c861af8 => generated 349 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:13:00.620288 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-5450319c-b215-4021-8c27-d9cd3f450be5 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:00.620985 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-5450319c-b215-4021-8c27-d9cd3f450be5 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:00.627924 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5450319c-b215-4021-8c27-d9cd3f450be5 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:00.628379 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5450319c-b215-4021-8c27-d9cd3f450be5 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:00.632428 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5450319c-b215-4021-8c27-d9cd3f450be5 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:00.633022 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5450319c-b215-4021-8c27-d9cd3f450be5 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:00.716437 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-aa112cfc-e70a-4526-ae66-b4bb3cec8aed tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:00.717057 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-aa112cfc-e70a-4526-ae66-b4bb3cec8aed tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:00.729185 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-aa112cfc-e70a-4526-ae66-b4bb3cec8aed tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:00.729593 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-aa112cfc-e70a-4526-ae66-b4bb3cec8aed tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:00.730409 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-aa112cfc-e70a-4526-ae66-b4bb3cec8aed tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:00.730848 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-aa112cfc-e70a-4526-ae66-b4bb3cec8aed tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:00.945963 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-5450319c-b215-4021-8c27-d9cd3f450be5 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:00.963655 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-5450319c-b215-4021-8c27-d9cd3f450be5 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1315 microversion: 2.1 time: 0.347053 Oct 29 01:13:00.964241 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 45/89] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:00 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1315 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:00.988390 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-368bc919-0f14-4fa0-aece-d8ae682dd3e7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:00.989017 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-368bc919-0f14-4fa0-aece-d8ae682dd3e7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:01.001686 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-368bc919-0f14-4fa0-aece-d8ae682dd3e7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:01.007453 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-368bc919-0f14-4fa0-aece-d8ae682dd3e7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:01.008916 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-368bc919-0f14-4fa0-aece-d8ae682dd3e7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:01.009728 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-368bc919-0f14-4fa0-aece-d8ae682dd3e7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:01.089166 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-aa112cfc-e70a-4526-ae66-b4bb3cec8aed tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:01.101457 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-aa112cfc-e70a-4526-ae66-b4bb3cec8aed tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1318 microversion: 2.1 time: 0.389176 Oct 29 01:13:01.104131 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 45/90] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:00 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1318 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:01.311071 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-368bc919-0f14-4fa0-aece-d8ae682dd3e7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:01.320089 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-368bc919-0f14-4fa0-aece-d8ae682dd3e7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:01.321528 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-368bc919-0f14-4fa0-aece-d8ae682dd3e7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:01.327502 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-368bc919-0f14-4fa0-aece-d8ae682dd3e7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1408 microversion: 2.20 time: 0.362237 Oct 29 01:13:01.330040 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 46/91] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:13:00 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1408 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:13:01.982182 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f36492ee-83a4-4773-97aa-2aa612be9a57 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:01.983374 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f36492ee-83a4-4773-97aa-2aa612be9a57 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:01.992011 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f36492ee-83a4-4773-97aa-2aa612be9a57 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:01.996477 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f36492ee-83a4-4773-97aa-2aa612be9a57 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:01.998095 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f36492ee-83a4-4773-97aa-2aa612be9a57 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:01.998740 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f36492ee-83a4-4773-97aa-2aa612be9a57 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:02.121442 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-bd1c76ff-bc94-40d4-a846-eb70d0d177c9 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:02.122069 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-bd1c76ff-bc94-40d4-a846-eb70d0d177c9 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:02.130899 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bd1c76ff-bc94-40d4-a846-eb70d0d177c9 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:02.134341 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bd1c76ff-bc94-40d4-a846-eb70d0d177c9 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:02.136361 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bd1c76ff-bc94-40d4-a846-eb70d0d177c9 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:02.139996 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bd1c76ff-bc94-40d4-a846-eb70d0d177c9 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:02.481590 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-f36492ee-83a4-4773-97aa-2aa612be9a57 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:02.492118 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f36492ee-83a4-4773-97aa-2aa612be9a57 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1315 microversion: 2.1 time: 0.513098 Oct 29 01:13:02.492835 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 46/92] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:01 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1315 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:02.504645 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f2c3f3ee-a766-4b01-9ecb-a1288a86d634 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:02.505110 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f2c3f3ee-a766-4b01-9ecb-a1288a86d634 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:02.521959 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f2c3f3ee-a766-4b01-9ecb-a1288a86d634 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:02.522463 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f2c3f3ee-a766-4b01-9ecb-a1288a86d634 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:02.526189 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f2c3f3ee-a766-4b01-9ecb-a1288a86d634 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:02.526677 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f2c3f3ee-a766-4b01-9ecb-a1288a86d634 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:02.633882 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-bd1c76ff-bc94-40d4-a846-eb70d0d177c9 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:02.655273 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-bd1c76ff-bc94-40d4-a846-eb70d0d177c9 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1318 microversion: 2.1 time: 0.534834 Oct 29 01:13:02.656500 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 47/93] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:02 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1318 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:13:02.678026 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-07f95601-e406-4949-a70f-fa60dbbcad7a tempest-VolumesTestJSON-1443441488 tempest-VolumesTestJSON-1443441488-project] Calling method '.version_select at 0x7f6029f41a60>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:02.812112 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-07f95601-e406-4949-a70f-fa60dbbcad7a tempest-VolumesTestJSON-1443441488 tempest-VolumesTestJSON-1443441488-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/5aba0896-0490-421e-97ae-5cde5880e6ca" status: 200 len: 350 microversion: 2.1 time: 0.153838 Oct 29 01:13:02.813227 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 48/94] 10.222.0.90 () {58 vars in 1244 bytes} [Fri Oct 29 01:13:02 2021] GET /compute/v2.1/os-volumes/5aba0896-0490-421e-97ae-5cde5880e6ca => generated 350 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:13:02.825069 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b65b9ad3-3b2c-4bf6-b1a8-ba3894a7e5a8 tempest-VolumesTestJSON-1443441488 tempest-VolumesTestJSON-1443441488-project] Calling method '.version_select at 0x7f6029eeddc0>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:02.941724 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b65b9ad3-3b2c-4bf6-b1a8-ba3894a7e5a8 tempest-VolumesTestJSON-1443441488 tempest-VolumesTestJSON-1443441488-project] 10.222.0.90 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.120522 Oct 29 01:13:02.942302 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 49/95] 10.222.0.90 () {58 vars in 1133 bytes} [Fri Oct 29 01:13:02 2021] GET /compute/v2.1/os-volumes => generated 1032 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:02.955056 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b87354b2-152f-4556-a017-21a3950d8430 tempest-VolumesTestJSON-1443441488 tempest-VolumesTestJSON-1443441488-project] Calling method '.version_select at 0x7f6029f12ee0>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:03.069274 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-f2c3f3ee-a766-4b01-9ecb-a1288a86d634 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:03.070163 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b87354b2-152f-4556-a017-21a3950d8430 tempest-VolumesTestJSON-1443441488 tempest-VolumesTestJSON-1443441488-project] 10.222.0.90 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.118814 Oct 29 01:13:03.078813 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 50/96] 10.222.0.90 () {58 vars in 1148 bytes} [Fri Oct 29 01:13:02 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 692 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:13:03.086181 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-1ea68a7d-ccb1-44f7-a8fc-34aefbadce0d tempest-VolumesTestJSON-1443441488 tempest-VolumesTestJSON-1443441488-project] Calling method '.version_select at 0x7f6029f41b80>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:03.089702 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-f2c3f3ee-a766-4b01-9ecb-a1288a86d634 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:03.092334 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-f2c3f3ee-a766-4b01-9ecb-a1288a86d634 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:03.096314 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f2c3f3ee-a766-4b01-9ecb-a1288a86d634 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1408 microversion: 2.20 time: 0.601453 Oct 29 01:13:03.110162 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 47/97] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:13:02 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1408 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:13:03.194917 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-1ea68a7d-ccb1-44f7-a8fc-34aefbadce0d tempest-VolumesTestJSON-1443441488 tempest-VolumesTestJSON-1443441488-project] 10.222.0.90 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.112742 Oct 29 01:13:03.202704 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 51/98] 10.222.0.90 () {58 vars in 1133 bytes} [Fri Oct 29 01:13:03 2021] GET /compute/v2.1/os-volumes => generated 1032 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:03.207184 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-96c9eb2c-2938-4658-a364-0113378afa32 tempest-VolumesTestJSON-1443441488 tempest-VolumesTestJSON-1443441488-project] Calling method '.version_select at 0x7f60296a1550>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:03.337731 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-96c9eb2c-2938-4658-a364-0113378afa32 tempest-VolumesTestJSON-1443441488 tempest-VolumesTestJSON-1443441488-project] 10.222.0.90 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.134042 Oct 29 01:13:03.338556 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 48/99] 10.222.0.90 () {58 vars in 1166 bytes} [Fri Oct 29 01:13:03 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 352 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:13:03.351694 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ca161e70-4770-44e7-8f5f-ea561a6cff61 tempest-VolumesTestJSON-1443441488 tempest-VolumesTestJSON-1443441488-project] Calling method '.version_select at 0x7f6029f27d30>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:03.509674 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-00842cfa-f4e3-4b94-aeec-d4392f28c9db tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:03.510291 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-00842cfa-f4e3-4b94-aeec-d4392f28c9db tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:03.525968 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-00842cfa-f4e3-4b94-aeec-d4392f28c9db tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:03.528486 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-00842cfa-f4e3-4b94-aeec-d4392f28c9db tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:03.529217 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-00842cfa-f4e3-4b94-aeec-d4392f28c9db tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:03.529648 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-00842cfa-f4e3-4b94-aeec-d4392f28c9db tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:03.533501 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ca161e70-4770-44e7-8f5f-ea561a6cff61 tempest-VolumesTestJSON-1443441488 tempest-VolumesTestJSON-1443441488-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.186251 Oct 29 01:13:03.534237 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 52/100] 10.222.0.90 () {58 vars in 1169 bytes} [Fri Oct 29 01:13:03 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 692 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:13:03.546531 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-af1a0337-5e32-4f0a-98b3-c99f46d304c1 tempest-VolumesTestJSON-1443441488 tempest-VolumesTestJSON-1443441488-project] Calling method '.version_select at 0x7f6029f12430>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:03.677814 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-af1a0337-5e32-4f0a-98b3-c99f46d304c1 tempest-VolumesTestJSON-1443441488 tempest-VolumesTestJSON-1443441488-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.135408 Oct 29 01:13:03.678758 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 53/101] 10.222.0.90 () {58 vars in 1154 bytes} [Fri Oct 29 01:13:03 2021] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:03.683752 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-cd6438ef-8892-47e9-8007-12bb582bdec9 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:03.684546 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-cd6438ef-8892-47e9-8007-12bb582bdec9 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:03.703938 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cd6438ef-8892-47e9-8007-12bb582bdec9 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:03.706710 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cd6438ef-8892-47e9-8007-12bb582bdec9 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:03.707672 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cd6438ef-8892-47e9-8007-12bb582bdec9 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:03.711167 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cd6438ef-8892-47e9-8007-12bb582bdec9 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:04.241592 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-00842cfa-f4e3-4b94-aeec-d4392f28c9db tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:04.257470 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-00842cfa-f4e3-4b94-aeec-d4392f28c9db tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1315 microversion: 2.1 time: 0.750246 Oct 29 01:13:04.260061 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 49/102] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:03 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1315 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:13:04.272955 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-cd6438ef-8892-47e9-8007-12bb582bdec9 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:04.278494 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-6e777902-f699-4870-aa51-428ac2d34719 tempest-VolumesTestJSON-1443441488 tempest-VolumesTestJSON-1443441488-project] Calling method '.version_select at 0x7f602973cee0>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:04.289651 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-cd6438ef-8892-47e9-8007-12bb582bdec9 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1318 microversion: 2.1 time: 0.602533 Oct 29 01:13:04.290962 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 54/103] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:03 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1318 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:04.315571 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [req-02690c24-f712-43d8-8021-fd4daedf301b req-eea47168-9cf2-49c2-8014-c7a88fa49096 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27a73464-dcac-4be6-a392-58d40a0296a8", "tag": "f3a5c6a4-eba2-4bfd-91f6-59386b7c88e8"}]} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:04.321150 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:13:04.321150 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: warnings.warn(msg) Oct 29 01:13:04.338915 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-02690c24-f712-43d8-8021-fd4daedf301b req-eea47168-9cf2-49c2-8014-c7a88fa49096 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:04.347065 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-02690c24-f712-43d8-8021-fd4daedf301b req-eea47168-9cf2-49c2-8014-c7a88fa49096 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:04.367979 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.compute.server_external_events [req-02690c24-f712-43d8-8021-fd4daedf301b req-eea47168-9cf2-49c2-8014-c7a88fa49096 service nova] Creating event network-changed:f3a5c6a4-eba2-4bfd-91f6-59386b7c88e8 for instance 27a73464-dcac-4be6-a392-58d40a0296a8 on hv-cinder-81558 Oct 29 01:13:04.378031 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [req-02690c24-f712-43d8-8021-fd4daedf301b req-eea47168-9cf2-49c2-8014-c7a88fa49096 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085649 Oct 29 01:13:04.379405 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 55/104] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:13:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:13:04.449194 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-6e777902-f699-4870-aa51-428ac2d34719 tempest-VolumesTestJSON-1443441488 tempest-VolumesTestJSON-1443441488-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.187948 Oct 29 01:13:04.452046 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 50/105] 10.222.0.90 () {58 vars in 1187 bytes} [Fri Oct 29 01:13:04 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 352 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:13:04.459789 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-0e9a8136-b58f-4dce-9518-f0696eaf0d2e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:04.459789 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-0e9a8136-b58f-4dce-9518-f0696eaf0d2e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:04.467634 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0e9a8136-b58f-4dce-9518-f0696eaf0d2e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:04.468743 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0e9a8136-b58f-4dce-9518-f0696eaf0d2e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:04.469598 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0e9a8136-b58f-4dce-9518-f0696eaf0d2e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:04.470295 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0e9a8136-b58f-4dce-9518-f0696eaf0d2e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:04.655154 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [req-f382d86e-250c-4515-98b2-cbd791e72cc1 req-7be8eaa8-6d96-458f-8a6f-9ac2b923f7ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2870eb8-76a6-4941-91c1-c2c7bacc911a", "tag": "ea450e77-a3c8-4eae-9e5f-25aa0f97a447"}]} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:04.656691 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:13:04.656691 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: warnings.warn(msg) Oct 29 01:13:04.663875 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-f382d86e-250c-4515-98b2-cbd791e72cc1 req-7be8eaa8-6d96-458f-8a6f-9ac2b923f7ca service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:04.664794 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-f382d86e-250c-4515-98b2-cbd791e72cc1 req-7be8eaa8-6d96-458f-8a6f-9ac2b923f7ca service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:04.677100 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.compute.server_external_events [req-f382d86e-250c-4515-98b2-cbd791e72cc1 req-7be8eaa8-6d96-458f-8a6f-9ac2b923f7ca service nova] Creating event network-changed:ea450e77-a3c8-4eae-9e5f-25aa0f97a447 for instance b2870eb8-76a6-4941-91c1-c2c7bacc911a on hv-cinder-81558 Oct 29 01:13:04.682646 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [req-f382d86e-250c-4515-98b2-cbd791e72cc1 req-7be8eaa8-6d96-458f-8a6f-9ac2b923f7ca service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.301747 Oct 29 01:13:04.683780 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 56/106] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:13:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:13:04.689242 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d677d281-7117-4cb3-a24f-6f97594fe731 tempest-VolumesTestJSON-1443441488 tempest-VolumesTestJSON-1443441488-project] Calling method '.version_select at 0x7f6029f27670>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:04.766250 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-0e9a8136-b58f-4dce-9518-f0696eaf0d2e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:04.775027 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-0e9a8136-b58f-4dce-9518-f0696eaf0d2e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:04.782004 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-0e9a8136-b58f-4dce-9518-f0696eaf0d2e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:04.783564 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-0e9a8136-b58f-4dce-9518-f0696eaf0d2e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1408 microversion: 2.20 time: 0.330291 Oct 29 01:13:04.796365 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 51/107] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:13:04 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1408 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:13:04.796841 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d677d281-7117-4cb3-a24f-6f97594fe731 tempest-VolumesTestJSON-1443441488 tempest-VolumesTestJSON-1443441488-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.111120 Oct 29 01:13:04.797761 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 57/108] 10.222.0.90 () {58 vars in 1154 bytes} [Fri Oct 29 01:13:04 2021] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:05.275891 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-7311cbf9-f44b-4749-b9c7-fb3ae00c7137 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:05.276599 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-7311cbf9-f44b-4749-b9c7-fb3ae00c7137 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:05.285579 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7311cbf9-f44b-4749-b9c7-fb3ae00c7137 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:05.286765 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7311cbf9-f44b-4749-b9c7-fb3ae00c7137 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:05.287824 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7311cbf9-f44b-4749-b9c7-fb3ae00c7137 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:05.288271 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7311cbf9-f44b-4749-b9c7-fb3ae00c7137 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:05.308727 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f4f5293b-556f-4346-9bd4-4488feada4e3 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:05.309388 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f4f5293b-556f-4346-9bd4-4488feada4e3 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:05.318061 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f4f5293b-556f-4346-9bd4-4488feada4e3 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:05.318715 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f4f5293b-556f-4346-9bd4-4488feada4e3 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:05.320582 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f4f5293b-556f-4346-9bd4-4488feada4e3 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:05.322284 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f4f5293b-556f-4346-9bd4-4488feada4e3 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:05.488328 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-7311cbf9-f44b-4749-b9c7-fb3ae00c7137 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:05.496045 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-7311cbf9-f44b-4749-b9c7-fb3ae00c7137 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1315 microversion: 2.1 time: 0.224015 Oct 29 01:13:05.497640 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 52/109] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:05 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:05.502979 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-f4f5293b-556f-4346-9bd4-4488feada4e3 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:05.510647 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f4f5293b-556f-4346-9bd4-4488feada4e3 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1318 microversion: 2.1 time: 0.205459 Oct 29 01:13:05.511203 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 58/110] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:05 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:13:05.803054 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-0213b32b-0015-46fc-8565-fc0ac025bbf1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:05.803775 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-0213b32b-0015-46fc-8565-fc0ac025bbf1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:05.809724 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0213b32b-0015-46fc-8565-fc0ac025bbf1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:05.810261 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0213b32b-0015-46fc-8565-fc0ac025bbf1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:05.811135 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0213b32b-0015-46fc-8565-fc0ac025bbf1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:05.811757 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0213b32b-0015-46fc-8565-fc0ac025bbf1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:05.943649 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-0213b32b-0015-46fc-8565-fc0ac025bbf1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:05.955342 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-0213b32b-0015-46fc-8565-fc0ac025bbf1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:05.958064 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-0213b32b-0015-46fc-8565-fc0ac025bbf1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:05.959862 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-0213b32b-0015-46fc-8565-fc0ac025bbf1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1408 microversion: 2.20 time: 0.159990 Oct 29 01:13:05.970260 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 53/111] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:13:05 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1408 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:13:06.512752 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f2bcdaf8-6c9d-4a88-b45a-e8a0d35012e6 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:06.513358 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f2bcdaf8-6c9d-4a88-b45a-e8a0d35012e6 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:06.519601 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f2bcdaf8-6c9d-4a88-b45a-e8a0d35012e6 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:06.520140 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f2bcdaf8-6c9d-4a88-b45a-e8a0d35012e6 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:06.522442 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f2bcdaf8-6c9d-4a88-b45a-e8a0d35012e6 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:06.522442 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f2bcdaf8-6c9d-4a88-b45a-e8a0d35012e6 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:06.528285 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-31f74c8c-2104-4fdb-a824-0cbe7d67158b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:06.529476 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-31f74c8c-2104-4fdb-a824-0cbe7d67158b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:06.536688 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-31f74c8c-2104-4fdb-a824-0cbe7d67158b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:06.538375 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-31f74c8c-2104-4fdb-a824-0cbe7d67158b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:06.540169 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-31f74c8c-2104-4fdb-a824-0cbe7d67158b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:06.540829 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-31f74c8c-2104-4fdb-a824-0cbe7d67158b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:06.733662 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-f2bcdaf8-6c9d-4a88-b45a-e8a0d35012e6 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:06.734953 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-31f74c8c-2104-4fdb-a824-0cbe7d67158b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:06.742524 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-31f74c8c-2104-4fdb-a824-0cbe7d67158b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1318 microversion: 2.1 time: 0.218586 Oct 29 01:13:06.751894 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f2bcdaf8-6c9d-4a88-b45a-e8a0d35012e6 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1315 microversion: 2.1 time: 0.233851 Oct 29 01:13:06.752623 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 54/112] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:06 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:06.753207 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 59/113] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:06 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:06.978496 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-64122b3b-4a19-4235-a3f6-12f03050e52c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:06.979175 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-64122b3b-4a19-4235-a3f6-12f03050e52c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:06.984902 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-64122b3b-4a19-4235-a3f6-12f03050e52c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:06.985347 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-64122b3b-4a19-4235-a3f6-12f03050e52c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:06.986112 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-64122b3b-4a19-4235-a3f6-12f03050e52c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:06.986575 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-64122b3b-4a19-4235-a3f6-12f03050e52c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:07.126200 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-64122b3b-4a19-4235-a3f6-12f03050e52c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:07.134529 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-64122b3b-4a19-4235-a3f6-12f03050e52c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:07.136287 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-64122b3b-4a19-4235-a3f6-12f03050e52c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:07.138715 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-64122b3b-4a19-4235-a3f6-12f03050e52c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1408 microversion: 2.20 time: 0.163311 Oct 29 01:13:07.149239 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 55/114] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:13:06 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1408 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:13:07.766721 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f245633c-bc7c-4286-a3ac-afd941529c28 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:07.769122 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f245633c-bc7c-4286-a3ac-afd941529c28 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:07.769396 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-3335f648-8e0e-496f-b6d7-7872b252255d tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:07.770615 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-3335f648-8e0e-496f-b6d7-7872b252255d tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:07.790883 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f245633c-bc7c-4286-a3ac-afd941529c28 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:07.792309 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3335f648-8e0e-496f-b6d7-7872b252255d tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:07.792808 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3335f648-8e0e-496f-b6d7-7872b252255d tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:07.793686 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3335f648-8e0e-496f-b6d7-7872b252255d tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:07.794246 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f245633c-bc7c-4286-a3ac-afd941529c28 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:07.795280 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f245633c-bc7c-4286-a3ac-afd941529c28 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:07.795726 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f245633c-bc7c-4286-a3ac-afd941529c28 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:07.800072 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3335f648-8e0e-496f-b6d7-7872b252255d tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:08.283545 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-3335f648-8e0e-496f-b6d7-7872b252255d tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:08.284152 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-f245633c-bc7c-4286-a3ac-afd941529c28 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:08.294227 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-3335f648-8e0e-496f-b6d7-7872b252255d tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1318 microversion: 2.1 time: 0.537693 Oct 29 01:13:08.295199 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 56/115] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:07 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1318 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:08.295318 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f245633c-bc7c-4286-a3ac-afd941529c28 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1315 microversion: 2.1 time: 0.535972 Oct 29 01:13:08.305061 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 60/116] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:07 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1315 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:08.307018 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-33658efb-3aa0-4c8b-822f-e4aa1aa59b13 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:08.307940 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-33658efb-3aa0-4c8b-822f-e4aa1aa59b13 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:08.317180 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-33658efb-3aa0-4c8b-822f-e4aa1aa59b13 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:08.317910 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-33658efb-3aa0-4c8b-822f-e4aa1aa59b13 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:08.318899 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-33658efb-3aa0-4c8b-822f-e4aa1aa59b13 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:08.319579 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-33658efb-3aa0-4c8b-822f-e4aa1aa59b13 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:08.593757 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-33658efb-3aa0-4c8b-822f-e4aa1aa59b13 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:08.603776 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-33658efb-3aa0-4c8b-822f-e4aa1aa59b13 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:08.605576 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-33658efb-3aa0-4c8b-822f-e4aa1aa59b13 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:08.606910 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-33658efb-3aa0-4c8b-822f-e4aa1aa59b13 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1408 microversion: 2.20 time: 0.309913 Oct 29 01:13:08.607607 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 57/117] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:13:08 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1408 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:13:09.312180 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a1f406cc-0f17-4994-89b1-5fd4bd7113ce tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:09.314175 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a1f406cc-0f17-4994-89b1-5fd4bd7113ce tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:09.319126 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-758b9727-3c2d-4753-910f-8a3e0fa15a0b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:09.319827 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-758b9727-3c2d-4753-910f-8a3e0fa15a0b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:09.332100 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-758b9727-3c2d-4753-910f-8a3e0fa15a0b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:09.332546 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-758b9727-3c2d-4753-910f-8a3e0fa15a0b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:09.333440 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-758b9727-3c2d-4753-910f-8a3e0fa15a0b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:09.334033 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-758b9727-3c2d-4753-910f-8a3e0fa15a0b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:09.338363 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a1f406cc-0f17-4994-89b1-5fd4bd7113ce tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:09.338877 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a1f406cc-0f17-4994-89b1-5fd4bd7113ce tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:09.340863 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a1f406cc-0f17-4994-89b1-5fd4bd7113ce tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:09.341291 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a1f406cc-0f17-4994-89b1-5fd4bd7113ce tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:09.533695 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-758b9727-3c2d-4753-910f-8a3e0fa15a0b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:09.538721 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-a1f406cc-0f17-4994-89b1-5fd4bd7113ce tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:09.541642 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-758b9727-3c2d-4753-910f-8a3e0fa15a0b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1318 microversion: 2.1 time: 0.226113 Oct 29 01:13:09.542430 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 58/118] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:09 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:09.546781 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a1f406cc-0f17-4994-89b1-5fd4bd7113ce tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1315 microversion: 2.1 time: 0.238244 Oct 29 01:13:09.547594 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 61/119] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:09 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:09.627564 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-0ac6e841-b093-4499-b98f-4d212754ca6c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:09.628583 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-0ac6e841-b093-4499-b98f-4d212754ca6c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:09.635985 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0ac6e841-b093-4499-b98f-4d212754ca6c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:09.636490 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0ac6e841-b093-4499-b98f-4d212754ca6c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:09.637823 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0ac6e841-b093-4499-b98f-4d212754ca6c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:09.638254 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0ac6e841-b093-4499-b98f-4d212754ca6c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:09.762446 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-0ac6e841-b093-4499-b98f-4d212754ca6c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:09.770369 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-0ac6e841-b093-4499-b98f-4d212754ca6c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:09.772200 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-0ac6e841-b093-4499-b98f-4d212754ca6c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:09.773588 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-0ac6e841-b093-4499-b98f-4d212754ca6c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1408 microversion: 2.20 time: 0.153153 Oct 29 01:13:09.774254 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 59/120] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:13:09 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:13:10.560641 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c9077345-bbe0-4008-aa3e-86d03182dce4 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:10.561251 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c9077345-bbe0-4008-aa3e-86d03182dce4 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:10.563543 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-b3c3ff08-296d-4375-83a1-af5d802b5e1d tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:10.564211 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-b3c3ff08-296d-4375-83a1-af5d802b5e1d tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:10.567098 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c9077345-bbe0-4008-aa3e-86d03182dce4 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:10.567545 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c9077345-bbe0-4008-aa3e-86d03182dce4 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:10.568307 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c9077345-bbe0-4008-aa3e-86d03182dce4 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:10.568736 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c9077345-bbe0-4008-aa3e-86d03182dce4 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:10.570179 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b3c3ff08-296d-4375-83a1-af5d802b5e1d tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:10.570726 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b3c3ff08-296d-4375-83a1-af5d802b5e1d tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:10.571547 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b3c3ff08-296d-4375-83a1-af5d802b5e1d tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:10.572051 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b3c3ff08-296d-4375-83a1-af5d802b5e1d tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:10.741382 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c9077345-bbe0-4008-aa3e-86d03182dce4 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:10.745967 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-b3c3ff08-296d-4375-83a1-af5d802b5e1d tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:10.748910 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c9077345-bbe0-4008-aa3e-86d03182dce4 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1318 microversion: 2.1 time: 0.191898 Oct 29 01:13:10.749558 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 62/121] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:10 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:13:10.753101 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-b3c3ff08-296d-4375-83a1-af5d802b5e1d tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1315 microversion: 2.1 time: 0.193243 Oct 29 01:13:10.753649 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 60/122] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:10 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:13:10.790418 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b8ee2249-823c-46e6-9902-8e6609d69029 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:10.791017 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b8ee2249-823c-46e6-9902-8e6609d69029 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:10.796721 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b8ee2249-823c-46e6-9902-8e6609d69029 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:10.797155 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b8ee2249-823c-46e6-9902-8e6609d69029 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:10.797900 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b8ee2249-823c-46e6-9902-8e6609d69029 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:10.798324 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b8ee2249-823c-46e6-9902-8e6609d69029 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:10.914094 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-b8ee2249-823c-46e6-9902-8e6609d69029 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:10.921719 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-b8ee2249-823c-46e6-9902-8e6609d69029 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:10.923298 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-b8ee2249-823c-46e6-9902-8e6609d69029 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:10.924320 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b8ee2249-823c-46e6-9902-8e6609d69029 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1408 microversion: 2.20 time: 0.137413 Oct 29 01:13:10.924873 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 63/123] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:13:10 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1408 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:13:11.765758 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-332b8b82-7bda-425e-bcc5-8dc6a1e07cde tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:11.766299 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-332b8b82-7bda-425e-bcc5-8dc6a1e07cde tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:11.769642 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f0a353a3-ac46-4ab2-b98a-bb067c19e935 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:11.770261 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f0a353a3-ac46-4ab2-b98a-bb067c19e935 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:11.773345 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-332b8b82-7bda-425e-bcc5-8dc6a1e07cde tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:11.773834 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-332b8b82-7bda-425e-bcc5-8dc6a1e07cde tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:11.774852 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-332b8b82-7bda-425e-bcc5-8dc6a1e07cde tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:11.775340 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-332b8b82-7bda-425e-bcc5-8dc6a1e07cde tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:11.776450 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f0a353a3-ac46-4ab2-b98a-bb067c19e935 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:11.776903 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f0a353a3-ac46-4ab2-b98a-bb067c19e935 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:11.778501 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f0a353a3-ac46-4ab2-b98a-bb067c19e935 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:11.779008 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f0a353a3-ac46-4ab2-b98a-bb067c19e935 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:11.954571 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-f0a353a3-ac46-4ab2-b98a-bb067c19e935 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:11.957459 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-332b8b82-7bda-425e-bcc5-8dc6a1e07cde tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:11.963259 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f0a353a3-ac46-4ab2-b98a-bb067c19e935 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1315 microversion: 2.1 time: 0.197134 Oct 29 01:13:11.963830 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 64/124] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:11 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:13:11.965822 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-332b8b82-7bda-425e-bcc5-8dc6a1e07cde tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1318 microversion: 2.1 time: 0.203647 Oct 29 01:13:11.966782 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 61/125] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:11 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:11.969217 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-15b918c0-14fd-409f-82b5-da212c60c815 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:11.969824 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-15b918c0-14fd-409f-82b5-da212c60c815 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:11.975551 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-15b918c0-14fd-409f-82b5-da212c60c815 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:11.975996 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-15b918c0-14fd-409f-82b5-da212c60c815 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:11.976757 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-15b918c0-14fd-409f-82b5-da212c60c815 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:11.977191 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-15b918c0-14fd-409f-82b5-da212c60c815 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:12.094279 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-15b918c0-14fd-409f-82b5-da212c60c815 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:12.101869 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-15b918c0-14fd-409f-82b5-da212c60c815 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:12.103408 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-15b918c0-14fd-409f-82b5-da212c60c815 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:12.104490 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-15b918c0-14fd-409f-82b5-da212c60c815 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1408 microversion: 2.20 time: 0.139596 Oct 29 01:13:12.105042 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 65/126] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:13:11 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1408 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:13:12.980300 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-cf262fd4-b5fa-49c2-9fb2-a6bb7f0052aa tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:12.980899 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-cf262fd4-b5fa-49c2-9fb2-a6bb7f0052aa tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:12.982080 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-98bf40d1-2ef7-4932-a721-5d67711ed9c1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:12.983031 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-98bf40d1-2ef7-4932-a721-5d67711ed9c1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:12.987904 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cf262fd4-b5fa-49c2-9fb2-a6bb7f0052aa tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:12.988568 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cf262fd4-b5fa-49c2-9fb2-a6bb7f0052aa tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:12.989344 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cf262fd4-b5fa-49c2-9fb2-a6bb7f0052aa tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:12.989754 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-98bf40d1-2ef7-4932-a721-5d67711ed9c1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:12.989868 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cf262fd4-b5fa-49c2-9fb2-a6bb7f0052aa tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:12.990206 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-98bf40d1-2ef7-4932-a721-5d67711ed9c1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:12.990979 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-98bf40d1-2ef7-4932-a721-5d67711ed9c1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:12.991404 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-98bf40d1-2ef7-4932-a721-5d67711ed9c1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:13.165700 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-cf262fd4-b5fa-49c2-9fb2-a6bb7f0052aa tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:13.172028 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-98bf40d1-2ef7-4932-a721-5d67711ed9c1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:13.176192 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-cf262fd4-b5fa-49c2-9fb2-a6bb7f0052aa tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1315 microversion: 2.1 time: 0.199443 Oct 29 01:13:13.176775 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 62/127] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:12 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:13.180587 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-98bf40d1-2ef7-4932-a721-5d67711ed9c1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1318 microversion: 2.1 time: 0.202038 Oct 29 01:13:13.181314 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 66/128] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:12 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:13:13.181444 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-6a77c9d6-65f6-45d9-83c6-3851d3db30ae tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:13.182102 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-6a77c9d6-65f6-45d9-83c6-3851d3db30ae tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:13.187833 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6a77c9d6-65f6-45d9-83c6-3851d3db30ae tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:13.188343 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6a77c9d6-65f6-45d9-83c6-3851d3db30ae tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:13.189095 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6a77c9d6-65f6-45d9-83c6-3851d3db30ae tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:13.189519 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6a77c9d6-65f6-45d9-83c6-3851d3db30ae tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:13.312762 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-6a77c9d6-65f6-45d9-83c6-3851d3db30ae tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:13.320460 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-6a77c9d6-65f6-45d9-83c6-3851d3db30ae tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:13.321962 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-6a77c9d6-65f6-45d9-83c6-3851d3db30ae tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:13.323072 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-6a77c9d6-65f6-45d9-83c6-3851d3db30ae tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1408 microversion: 2.20 time: 0.145394 Oct 29 01:13:13.323631 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 63/129] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:13:13 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1408 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:13:14.192709 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-23f5e2cf-8047-4165-9262-b67cd2724252 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:14.193308 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-23f5e2cf-8047-4165-9262-b67cd2724252 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:14.196528 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d387aabb-a15f-456f-988f-367fa66479ac tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:14.197126 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d387aabb-a15f-456f-988f-367fa66479ac tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:14.199743 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-23f5e2cf-8047-4165-9262-b67cd2724252 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:14.200185 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-23f5e2cf-8047-4165-9262-b67cd2724252 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:14.200939 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-23f5e2cf-8047-4165-9262-b67cd2724252 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:14.201362 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-23f5e2cf-8047-4165-9262-b67cd2724252 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:14.203444 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d387aabb-a15f-456f-988f-367fa66479ac tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:14.203883 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d387aabb-a15f-456f-988f-367fa66479ac tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:14.204632 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d387aabb-a15f-456f-988f-367fa66479ac tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:14.205057 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d387aabb-a15f-456f-988f-367fa66479ac tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:14.377402 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-d387aabb-a15f-456f-988f-367fa66479ac tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:14.379932 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-23f5e2cf-8047-4165-9262-b67cd2724252 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:14.384784 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d387aabb-a15f-456f-988f-367fa66479ac tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1318 microversion: 2.1 time: 0.191794 Oct 29 01:13:14.385427 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 64/130] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:14 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:13:14.386998 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-23f5e2cf-8047-4165-9262-b67cd2724252 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1315 microversion: 2.1 time: 0.197971 Oct 29 01:13:14.387542 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 67/131] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:14 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:14.390056 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d47320e7-6ada-4604-9624-2efb71ea5624 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:14.390812 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d47320e7-6ada-4604-9624-2efb71ea5624 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:14.396366 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d47320e7-6ada-4604-9624-2efb71ea5624 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:14.396808 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d47320e7-6ada-4604-9624-2efb71ea5624 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:14.397557 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d47320e7-6ada-4604-9624-2efb71ea5624 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:14.397980 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d47320e7-6ada-4604-9624-2efb71ea5624 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:14.512761 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-d47320e7-6ada-4604-9624-2efb71ea5624 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:14.520407 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-d47320e7-6ada-4604-9624-2efb71ea5624 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:14.521880 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-d47320e7-6ada-4604-9624-2efb71ea5624 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:14.522983 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d47320e7-6ada-4604-9624-2efb71ea5624 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1408 microversion: 2.20 time: 0.136661 Oct 29 01:13:14.523532 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 65/132] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:13:14 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1408 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:13:15.400565 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-1c97560d-daca-478e-bb21-2fc2f19215c0 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:15.401173 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-1c97560d-daca-478e-bb21-2fc2f19215c0 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:15.403783 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-69dd065f-06e2-489d-950e-b40bad0edd50 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:15.404418 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-69dd065f-06e2-489d-950e-b40bad0edd50 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:15.407741 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1c97560d-daca-478e-bb21-2fc2f19215c0 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:15.408185 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1c97560d-daca-478e-bb21-2fc2f19215c0 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:15.408948 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1c97560d-daca-478e-bb21-2fc2f19215c0 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:15.409378 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1c97560d-daca-478e-bb21-2fc2f19215c0 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:15.410029 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-69dd065f-06e2-489d-950e-b40bad0edd50 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:15.410514 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-69dd065f-06e2-489d-950e-b40bad0edd50 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:15.411268 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-69dd065f-06e2-489d-950e-b40bad0edd50 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:15.411698 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-69dd065f-06e2-489d-950e-b40bad0edd50 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:15.586760 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-69dd065f-06e2-489d-950e-b40bad0edd50 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:15.591806 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-1c97560d-daca-478e-bb21-2fc2f19215c0 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:15.594326 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-69dd065f-06e2-489d-950e-b40bad0edd50 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1315 microversion: 2.1 time: 0.194663 Oct 29 01:13:15.595129 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 66/133] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:15 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:13:15.599287 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f59ff64b-094e-4b42-bc11-9aaf5db02325 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:15.599886 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f59ff64b-094e-4b42-bc11-9aaf5db02325 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:15.603560 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-1c97560d-daca-478e-bb21-2fc2f19215c0 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1318 microversion: 2.1 time: 0.206531 Oct 29 01:13:15.604122 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 68/134] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:15 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:15.605612 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f59ff64b-094e-4b42-bc11-9aaf5db02325 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:15.606060 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f59ff64b-094e-4b42-bc11-9aaf5db02325 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:15.606844 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f59ff64b-094e-4b42-bc11-9aaf5db02325 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:15.607275 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f59ff64b-094e-4b42-bc11-9aaf5db02325 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:15.731642 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-f59ff64b-094e-4b42-bc11-9aaf5db02325 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:15.739617 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-f59ff64b-094e-4b42-bc11-9aaf5db02325 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:15.741116 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-f59ff64b-094e-4b42-bc11-9aaf5db02325 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:15.742205 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f59ff64b-094e-4b42-bc11-9aaf5db02325 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1408 microversion: 2.20 time: 0.146307 Oct 29 01:13:15.742808 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 67/135] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:13:15 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1408 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:13:16.611381 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-bb5ae603-9abf-408a-8921-9a32112624b8 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:16.611977 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-bb5ae603-9abf-408a-8921-9a32112624b8 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:16.617644 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bb5ae603-9abf-408a-8921-9a32112624b8 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:16.618087 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bb5ae603-9abf-408a-8921-9a32112624b8 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:16.618861 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bb5ae603-9abf-408a-8921-9a32112624b8 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:16.619296 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bb5ae603-9abf-408a-8921-9a32112624b8 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:16.619773 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c46f1ce1-25ba-47ba-920b-d316f9eff18a tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:16.620415 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c46f1ce1-25ba-47ba-920b-d316f9eff18a tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:16.626091 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c46f1ce1-25ba-47ba-920b-d316f9eff18a tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:16.626569 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c46f1ce1-25ba-47ba-920b-d316f9eff18a tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:16.627332 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c46f1ce1-25ba-47ba-920b-d316f9eff18a tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:16.627764 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c46f1ce1-25ba-47ba-920b-d316f9eff18a tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:16.795613 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-bb5ae603-9abf-408a-8921-9a32112624b8 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:16.800111 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-c46f1ce1-25ba-47ba-920b-d316f9eff18a tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:16.803365 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-bb5ae603-9abf-408a-8921-9a32112624b8 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1315 microversion: 2.1 time: 0.195580 Oct 29 01:13:16.804024 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 69/136] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:16 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:16.807541 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c46f1ce1-25ba-47ba-920b-d316f9eff18a tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1318 microversion: 2.1 time: 0.191369 Oct 29 01:13:16.808165 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 68/137] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:16 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:13:16.808536 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-8676b458-7688-4b7d-9d41-af413c25e363 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:16.809386 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-8676b458-7688-4b7d-9d41-af413c25e363 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:16.815303 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8676b458-7688-4b7d-9d41-af413c25e363 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:16.815825 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8676b458-7688-4b7d-9d41-af413c25e363 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:16.816657 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8676b458-7688-4b7d-9d41-af413c25e363 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:16.817226 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8676b458-7688-4b7d-9d41-af413c25e363 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:16.943829 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-8676b458-7688-4b7d-9d41-af413c25e363 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:16.951455 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-8676b458-7688-4b7d-9d41-af413c25e363 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:16.952984 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-8676b458-7688-4b7d-9d41-af413c25e363 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:16.954115 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-8676b458-7688-4b7d-9d41-af413c25e363 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1408 microversion: 2.20 time: 0.149069 Oct 29 01:13:16.954786 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 70/138] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:13:16 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1408 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:13:17.819648 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-1479511e-9a4c-4404-b2bd-906bd56410e1 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:17.820445 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-1479511e-9a4c-4404-b2bd-906bd56410e1 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:17.823346 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-230475b5-c059-4b85-bbca-df73110be9a3 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:17.824603 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-230475b5-c059-4b85-bbca-df73110be9a3 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:17.827639 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1479511e-9a4c-4404-b2bd-906bd56410e1 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:17.828289 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1479511e-9a4c-4404-b2bd-906bd56410e1 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:17.829138 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1479511e-9a4c-4404-b2bd-906bd56410e1 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:17.829771 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1479511e-9a4c-4404-b2bd-906bd56410e1 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:17.830437 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-230475b5-c059-4b85-bbca-df73110be9a3 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:17.831039 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-230475b5-c059-4b85-bbca-df73110be9a3 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:17.832149 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-230475b5-c059-4b85-bbca-df73110be9a3 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:17.832573 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-230475b5-c059-4b85-bbca-df73110be9a3 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:18.009531 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-230475b5-c059-4b85-bbca-df73110be9a3 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:18.012436 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-1479511e-9a4c-4404-b2bd-906bd56410e1 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:18.016825 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-230475b5-c059-4b85-bbca-df73110be9a3 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1318 microversion: 2.1 time: 0.196925 Oct 29 01:13:18.017385 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 71/139] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:17 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:13:18.019612 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-1479511e-9a4c-4404-b2bd-906bd56410e1 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1315 microversion: 2.1 time: 0.203600 Oct 29 01:13:18.020159 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 69/140] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:17 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:18.023106 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-33aa7f38-6d2e-4a4b-96de-34d3531ce1cd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:18.023694 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-33aa7f38-6d2e-4a4b-96de-34d3531ce1cd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:18.029739 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-33aa7f38-6d2e-4a4b-96de-34d3531ce1cd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:18.030174 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-33aa7f38-6d2e-4a4b-96de-34d3531ce1cd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:18.030943 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-33aa7f38-6d2e-4a4b-96de-34d3531ce1cd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:18.031387 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-33aa7f38-6d2e-4a4b-96de-34d3531ce1cd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:18.146590 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-33aa7f38-6d2e-4a4b-96de-34d3531ce1cd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:18.155095 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-33aa7f38-6d2e-4a4b-96de-34d3531ce1cd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:18.156562 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-33aa7f38-6d2e-4a4b-96de-34d3531ce1cd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:18.157628 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-33aa7f38-6d2e-4a4b-96de-34d3531ce1cd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1408 microversion: 2.20 time: 0.138345 Oct 29 01:13:18.158174 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 72/141] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:13:18 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1408 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:13:19.036089 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-99a84758-08b0-4cf9-a4f1-fac4bda577fb tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:19.036894 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-99a84758-08b0-4cf9-a4f1-fac4bda577fb tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:19.038154 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f555da0a-8d91-49a0-b105-f946fda838b6 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:19.038861 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f555da0a-8d91-49a0-b105-f946fda838b6 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:19.043265 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-99a84758-08b0-4cf9-a4f1-fac4bda577fb tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:19.043703 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-99a84758-08b0-4cf9-a4f1-fac4bda577fb tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:19.044614 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-99a84758-08b0-4cf9-a4f1-fac4bda577fb tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:19.045052 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-99a84758-08b0-4cf9-a4f1-fac4bda577fb tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:19.045473 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f555da0a-8d91-49a0-b105-f946fda838b6 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:19.045993 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f555da0a-8d91-49a0-b105-f946fda838b6 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:19.046855 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f555da0a-8d91-49a0-b105-f946fda838b6 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:19.047509 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f555da0a-8d91-49a0-b105-f946fda838b6 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:19.235872 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-f555da0a-8d91-49a0-b105-f946fda838b6 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:19.240057 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-99a84758-08b0-4cf9-a4f1-fac4bda577fb tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:19.244412 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f555da0a-8d91-49a0-b105-f946fda838b6 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1315 microversion: 2.1 time: 0.211224 Oct 29 01:13:19.245073 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 73/142] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:19 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:19.249738 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-99a84758-08b0-4cf9-a4f1-fac4bda577fb tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1318 microversion: 2.1 time: 0.218951 Oct 29 01:13:19.258923 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 70/143] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:19 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:13:19.260025 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-945cee57-dcc7-46e4-8ecb-69c0e301826c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:19.262135 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-945cee57-dcc7-46e4-8ecb-69c0e301826c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:19.268312 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-945cee57-dcc7-46e4-8ecb-69c0e301826c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:19.268830 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-945cee57-dcc7-46e4-8ecb-69c0e301826c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:19.269706 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-945cee57-dcc7-46e4-8ecb-69c0e301826c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:19.270137 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-945cee57-dcc7-46e4-8ecb-69c0e301826c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:19.400201 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-945cee57-dcc7-46e4-8ecb-69c0e301826c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:19.408826 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-945cee57-dcc7-46e4-8ecb-69c0e301826c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:19.410448 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-945cee57-dcc7-46e4-8ecb-69c0e301826c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:19.411680 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-945cee57-dcc7-46e4-8ecb-69c0e301826c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1408 microversion: 2.20 time: 0.164591 Oct 29 01:13:19.412313 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 74/144] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:13:19 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:13:20.261274 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-ddeee5b6-fcf8-47c9-b5be-e3b42fe364b2 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:20.261274 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-ddeee5b6-fcf8-47c9-b5be-e3b42fe364b2 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:20.266250 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-499243c3-2461-4a45-8dae-184036b327f1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:20.267360 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ddeee5b6-fcf8-47c9-b5be-e3b42fe364b2 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:20.267623 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-499243c3-2461-4a45-8dae-184036b327f1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:20.267939 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ddeee5b6-fcf8-47c9-b5be-e3b42fe364b2 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:20.268767 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ddeee5b6-fcf8-47c9-b5be-e3b42fe364b2 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:20.269256 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ddeee5b6-fcf8-47c9-b5be-e3b42fe364b2 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:20.273871 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-499243c3-2461-4a45-8dae-184036b327f1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:20.274316 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-499243c3-2461-4a45-8dae-184036b327f1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:20.275102 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-499243c3-2461-4a45-8dae-184036b327f1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:20.275522 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-499243c3-2461-4a45-8dae-184036b327f1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:20.452441 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-ddeee5b6-fcf8-47c9-b5be-e3b42fe364b2 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:20.462074 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-499243c3-2461-4a45-8dae-184036b327f1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:20.470423 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-499243c3-2461-4a45-8dae-184036b327f1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1318 microversion: 2.1 time: 0.207623 Oct 29 01:13:20.471374 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 75/145] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:20 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:20.475723 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c26a30fb-22a6-4f67-8a4a-93a0c7490446 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:20.476320 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c26a30fb-22a6-4f67-8a4a-93a0c7490446 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:20.482099 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c26a30fb-22a6-4f67-8a4a-93a0c7490446 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:20.482476 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c26a30fb-22a6-4f67-8a4a-93a0c7490446 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:20.483393 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c26a30fb-22a6-4f67-8a4a-93a0c7490446 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:20.483820 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c26a30fb-22a6-4f67-8a4a-93a0c7490446 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:20.484573 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-ddeee5b6-fcf8-47c9-b5be-e3b42fe364b2 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1315 microversion: 2.1 time: 0.227359 Oct 29 01:13:20.485352 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 71/146] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:20 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:20.622522 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c26a30fb-22a6-4f67-8a4a-93a0c7490446 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:20.634754 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c26a30fb-22a6-4f67-8a4a-93a0c7490446 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:20.638793 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c26a30fb-22a6-4f67-8a4a-93a0c7490446 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:20.640177 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c26a30fb-22a6-4f67-8a4a-93a0c7490446 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1408 microversion: 2.20 time: 0.167718 Oct 29 01:13:20.650671 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 76/147] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:13:20 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1408 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:13:21.488457 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-4aacac57-b80e-4faa-ac4d-67ecf2ac903b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:21.489070 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-4aacac57-b80e-4faa-ac4d-67ecf2ac903b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:21.501784 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4aacac57-b80e-4faa-ac4d-67ecf2ac903b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:21.502238 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4aacac57-b80e-4faa-ac4d-67ecf2ac903b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:21.503050 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4aacac57-b80e-4faa-ac4d-67ecf2ac903b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:21.503559 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ddca2523-8bb5-4b58-8dc2-f82aac200c38 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:21.505274 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ddca2523-8bb5-4b58-8dc2-f82aac200c38 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:21.505385 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4aacac57-b80e-4faa-ac4d-67ecf2ac903b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:21.519732 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ddca2523-8bb5-4b58-8dc2-f82aac200c38 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:21.523742 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ddca2523-8bb5-4b58-8dc2-f82aac200c38 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:21.524808 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ddca2523-8bb5-4b58-8dc2-f82aac200c38 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:21.528563 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ddca2523-8bb5-4b58-8dc2-f82aac200c38 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:21.806223 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-4aacac57-b80e-4faa-ac4d-67ecf2ac903b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:21.812240 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-4aacac57-b80e-4faa-ac4d-67ecf2ac903b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1318 microversion: 2.1 time: 0.328883 Oct 29 01:13:21.828207 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 72/148] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:21 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1318 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:21.845240 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-ddca2523-8bb5-4b58-8dc2-f82aac200c38 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:21.853579 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ddca2523-8bb5-4b58-8dc2-f82aac200c38 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1315 microversion: 2.1 time: 0.355164 Oct 29 01:13:21.854175 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 77/149] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:21 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1315 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:21.864269 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-55ac240c-e061-450e-a0e4-1828574920f3 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:21.864269 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-55ac240c-e061-450e-a0e4-1828574920f3 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:21.867182 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-55ac240c-e061-450e-a0e4-1828574920f3 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:21.867871 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-55ac240c-e061-450e-a0e4-1828574920f3 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:21.868676 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-55ac240c-e061-450e-a0e4-1828574920f3 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:21.869091 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-55ac240c-e061-450e-a0e4-1828574920f3 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:22.075900 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-55ac240c-e061-450e-a0e4-1828574920f3 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:22.097367 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-55ac240c-e061-450e-a0e4-1828574920f3 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:22.099679 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-55ac240c-e061-450e-a0e4-1828574920f3 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:22.100846 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-55ac240c-e061-450e-a0e4-1828574920f3 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1408 microversion: 2.20 time: 0.243921 Oct 29 01:13:22.101450 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 78/150] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:13:21 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1408 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:13:22.158804 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [req-f98899e2-a4c2-4ecf-8f7a-f73868f66a4a req-eb09a23c-dbdc-4914-bc32-d2b8f62d365e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e789e569-3570-483f-8768-27b5be53c535", "name": "network-vif-plugged", "status": "completed", "tag": "df5dbe79-b13c-4a7f-a7df-7f7b2b74a2db"}]} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:22.161000 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:13:22.161000 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: warnings.warn(msg) Oct 29 01:13:22.171513 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-f98899e2-a4c2-4ecf-8f7a-f73868f66a4a req-eb09a23c-dbdc-4914-bc32-d2b8f62d365e service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:22.171946 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-f98899e2-a4c2-4ecf-8f7a-f73868f66a4a req-eb09a23c-dbdc-4914-bc32-d2b8f62d365e service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:22.196631 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.compute.server_external_events [req-f98899e2-a4c2-4ecf-8f7a-f73868f66a4a req-eb09a23c-dbdc-4914-bc32-d2b8f62d365e service nova] Creating event network-vif-plugged:df5dbe79-b13c-4a7f-a7df-7f7b2b74a2db for instance e789e569-3570-483f-8768-27b5be53c535 on hv-cinder-81558 Oct 29 01:13:22.197256 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-f98899e2-a4c2-4ecf-8f7a-f73868f66a4a req-eb09a23c-dbdc-4914-bc32-d2b8f62d365e service nova] Acquired lock "compute-rpcapi-router" {{(pid=115748) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Oct 29 01:13:22.198858 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ce8b7427-4be8-4657-8792-9bd9b9e69254 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:22.199425 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ce8b7427-4be8-4657-8792-9bd9b9e69254 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:22.200205 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ce8b7427-4be8-4657-8792-9bd9b9e69254 None None] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:22.200632 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ce8b7427-4be8-4657-8792-9bd9b9e69254 None None] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:22.210776 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.compute.rpcapi [None req-ce8b7427-4be8-4657-8792-9bd9b9e69254 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Oct 29 01:13:22.211801 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ce8b7427-4be8-4657-8792-9bd9b9e69254 None None] Releasing lock "compute-rpcapi-router" {{(pid=115748) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Oct 29 01:13:22.249199 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-ce8b7427-4be8-4657-8792-9bd9b9e69254 None None] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.419668 Oct 29 01:13:22.249865 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 73/151] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:13:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:13:22.840662 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-6c36771d-c8f6-4096-8f4b-0fd3eba41037 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:22.841120 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-6c36771d-c8f6-4096-8f4b-0fd3eba41037 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:22.848350 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6c36771d-c8f6-4096-8f4b-0fd3eba41037 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:22.848806 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6c36771d-c8f6-4096-8f4b-0fd3eba41037 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:22.849639 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6c36771d-c8f6-4096-8f4b-0fd3eba41037 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:22.850069 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6c36771d-c8f6-4096-8f4b-0fd3eba41037 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:22.874882 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-91e06bb1-a1b0-4ecd-b3ba-7dbf930ac55a tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:22.875659 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-91e06bb1-a1b0-4ecd-b3ba-7dbf930ac55a tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:22.884726 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-91e06bb1-a1b0-4ecd-b3ba-7dbf930ac55a tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:22.886320 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-91e06bb1-a1b0-4ecd-b3ba-7dbf930ac55a tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:22.890307 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-91e06bb1-a1b0-4ecd-b3ba-7dbf930ac55a tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:22.891893 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-91e06bb1-a1b0-4ecd-b3ba-7dbf930ac55a tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:23.069345 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-6c36771d-c8f6-4096-8f4b-0fd3eba41037 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:23.078060 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-6c36771d-c8f6-4096-8f4b-0fd3eba41037 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1318 microversion: 2.1 time: 0.245851 Oct 29 01:13:23.079557 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 79/152] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:22 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:23.097906 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-91e06bb1-a1b0-4ecd-b3ba-7dbf930ac55a tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:23.105931 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-91e06bb1-a1b0-4ecd-b3ba-7dbf930ac55a tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1315 microversion: 2.1 time: 0.236879 Oct 29 01:13:23.115212 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 74/153] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:22 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:23.119487 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a7b965f5-5eeb-49ff-8da6-c818654af965 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:23.120779 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a7b965f5-5eeb-49ff-8da6-c818654af965 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:23.126774 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a7b965f5-5eeb-49ff-8da6-c818654af965 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:23.127287 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a7b965f5-5eeb-49ff-8da6-c818654af965 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:23.128352 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a7b965f5-5eeb-49ff-8da6-c818654af965 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:23.128753 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a7b965f5-5eeb-49ff-8da6-c818654af965 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:23.267750 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-a7b965f5-5eeb-49ff-8da6-c818654af965 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:23.285963 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-a7b965f5-5eeb-49ff-8da6-c818654af965 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:23.288277 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-a7b965f5-5eeb-49ff-8da6-c818654af965 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:23.289683 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a7b965f5-5eeb-49ff-8da6-c818654af965 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1408 microversion: 2.20 time: 0.174259 Oct 29 01:13:23.290336 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 80/154] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:13:23 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:13:24.096215 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-ca06651e-da37-4550-83f4-1b9ff854a1d7 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:24.096810 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-ca06651e-da37-4550-83f4-1b9ff854a1d7 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:24.103928 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ca06651e-da37-4550-83f4-1b9ff854a1d7 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:24.105131 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ca06651e-da37-4550-83f4-1b9ff854a1d7 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:24.105908 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ca06651e-da37-4550-83f4-1b9ff854a1d7 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:24.106524 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ca06651e-da37-4550-83f4-1b9ff854a1d7 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:24.122796 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a689d3ab-0b4e-4084-a6fc-64da71bb0b92 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:24.123360 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a689d3ab-0b4e-4084-a6fc-64da71bb0b92 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:24.130693 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a689d3ab-0b4e-4084-a6fc-64da71bb0b92 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:24.132162 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a689d3ab-0b4e-4084-a6fc-64da71bb0b92 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:24.132942 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a689d3ab-0b4e-4084-a6fc-64da71bb0b92 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:24.133419 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a689d3ab-0b4e-4084-a6fc-64da71bb0b92 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:24.590157 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-ca06651e-da37-4550-83f4-1b9ff854a1d7 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:24.600868 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-ca06651e-da37-4550-83f4-1b9ff854a1d7 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1318 microversion: 2.1 time: 0.508418 Oct 29 01:13:24.602189 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 75/155] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:24 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1318 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:24.619471 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [req-a01e79e4-5900-459a-88c5-536f0e04f566 req-c8aed100-53a5-4194-bb23-2d6440b62439 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27a73464-dcac-4be6-a392-58d40a0296a8", "name": "network-vif-plugged", "status": "completed", "tag": "f3a5c6a4-eba2-4bfd-91f6-59386b7c88e8"}, {"server_uuid": "b2870eb8-76a6-4941-91c1-c2c7bacc911a", "name": "network-vif-plugged", "status": "completed", "tag": "ea450e77-a3c8-4eae-9e5f-25aa0f97a447"}]} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:24.627047 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-a689d3ab-0b4e-4084-a6fc-64da71bb0b92 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:24.630693 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:13:24.630693 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: warnings.warn(msg) Oct 29 01:13:24.644837 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a689d3ab-0b4e-4084-a6fc-64da71bb0b92 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1315 microversion: 2.1 time: 0.525974 Oct 29 01:13:24.645927 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 81/156] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:24 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1315 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:13:24.647248 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-a01e79e4-5900-459a-88c5-536f0e04f566 req-c8aed100-53a5-4194-bb23-2d6440b62439 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:24.647884 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-a01e79e4-5900-459a-88c5-536f0e04f566 req-c8aed100-53a5-4194-bb23-2d6440b62439 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:24.653463 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-74453ceb-ada1-4ef4-a200-ccf382a88890 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:24.654153 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-74453ceb-ada1-4ef4-a200-ccf382a88890 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:24.665907 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.compute.server_external_events [req-a01e79e4-5900-459a-88c5-536f0e04f566 req-c8aed100-53a5-4194-bb23-2d6440b62439 service nova] Creating event network-vif-plugged:f3a5c6a4-eba2-4bfd-91f6-59386b7c88e8 for instance 27a73464-dcac-4be6-a392-58d40a0296a8 on hv-cinder-81558 Oct 29 01:13:24.667619 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.compute.server_external_events [req-a01e79e4-5900-459a-88c5-536f0e04f566 req-c8aed100-53a5-4194-bb23-2d6440b62439 service nova] Creating event network-vif-plugged:ea450e77-a3c8-4eae-9e5f-25aa0f97a447 for instance b2870eb8-76a6-4941-91c1-c2c7bacc911a on hv-cinder-81558 Oct 29 01:13:24.671029 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-74453ceb-ada1-4ef4-a200-ccf382a88890 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:24.671718 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-74453ceb-ada1-4ef4-a200-ccf382a88890 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:24.673112 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-74453ceb-ada1-4ef4-a200-ccf382a88890 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:24.673626 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-74453ceb-ada1-4ef4-a200-ccf382a88890 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:24.683359 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [req-a01e79e4-5900-459a-88c5-536f0e04f566 req-c8aed100-53a5-4194-bb23-2d6440b62439 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.079418 Oct 29 01:13:24.695624 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 76/157] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:13:24 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:13:24.863508 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-74453ceb-ada1-4ef4-a200-ccf382a88890 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:24.879381 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-74453ceb-ada1-4ef4-a200-ccf382a88890 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:24.881724 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-74453ceb-ada1-4ef4-a200-ccf382a88890 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:24.883421 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-74453ceb-ada1-4ef4-a200-ccf382a88890 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1408 microversion: 2.20 time: 0.234754 Oct 29 01:13:24.884638 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 82/158] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:13:24 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1408 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:13:25.619073 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c8f3ddc4-73f1-4c2c-a12f-32a45a3719f5 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:25.623991 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c8f3ddc4-73f1-4c2c-a12f-32a45a3719f5 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:25.630245 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c8f3ddc4-73f1-4c2c-a12f-32a45a3719f5 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:25.631565 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c8f3ddc4-73f1-4c2c-a12f-32a45a3719f5 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:25.632531 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c8f3ddc4-73f1-4c2c-a12f-32a45a3719f5 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:25.633171 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c8f3ddc4-73f1-4c2c-a12f-32a45a3719f5 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:25.663463 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-1bfca68d-6a4c-4f04-8f7f-5e2c473023ff tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:25.664937 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-1bfca68d-6a4c-4f04-8f7f-5e2c473023ff tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:25.675281 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1bfca68d-6a4c-4f04-8f7f-5e2c473023ff tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:25.676016 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1bfca68d-6a4c-4f04-8f7f-5e2c473023ff tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:25.677056 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1bfca68d-6a4c-4f04-8f7f-5e2c473023ff tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:25.677672 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1bfca68d-6a4c-4f04-8f7f-5e2c473023ff tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:25.830136 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-c8f3ddc4-73f1-4c2c-a12f-32a45a3719f5 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:25.837596 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c8f3ddc4-73f1-4c2c-a12f-32a45a3719f5 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1508 microversion: 2.1 time: 0.222624 Oct 29 01:13:25.838553 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 77/159] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:25 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1508 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:25.879877 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-1bfca68d-6a4c-4f04-8f7f-5e2c473023ff tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:25.890879 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-1bfca68d-6a4c-4f04-8f7f-5e2c473023ff tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1315 microversion: 2.1 time: 0.230891 Oct 29 01:13:25.892146 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 83/160] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:25 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:13:25.916106 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c8b442ae-f8e5-4f29-9395-4e44740c44ee tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:25.916817 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c8b442ae-f8e5-4f29-9395-4e44740c44ee tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:25.932445 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c8b442ae-f8e5-4f29-9395-4e44740c44ee tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:25.935177 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c8b442ae-f8e5-4f29-9395-4e44740c44ee tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:25.936188 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c8b442ae-f8e5-4f29-9395-4e44740c44ee tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:25.936811 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c8b442ae-f8e5-4f29-9395-4e44740c44ee tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:26.158655 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-c8b442ae-f8e5-4f29-9395-4e44740c44ee tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:26.170548 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-c8b442ae-f8e5-4f29-9395-4e44740c44ee tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:26.184441 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-c8b442ae-f8e5-4f29-9395-4e44740c44ee tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:26.185985 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c8b442ae-f8e5-4f29-9395-4e44740c44ee tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1408 microversion: 2.20 time: 0.287879 Oct 29 01:13:26.197928 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 78/161] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:13:25 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1408 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:13:26.915670 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-2caa0b6e-588b-4938-9706-60762ed20c0e tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:26.916283 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-2caa0b6e-588b-4938-9706-60762ed20c0e tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:26.922028 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2caa0b6e-588b-4938-9706-60762ed20c0e tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:26.922507 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2caa0b6e-588b-4938-9706-60762ed20c0e tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:26.923275 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2caa0b6e-588b-4938-9706-60762ed20c0e tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:26.923703 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2caa0b6e-588b-4938-9706-60762ed20c0e tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:27.099480 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-2caa0b6e-588b-4938-9706-60762ed20c0e tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:27.107718 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-2caa0b6e-588b-4938-9706-60762ed20c0e tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1315 microversion: 2.1 time: 0.195551 Oct 29 01:13:27.108295 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 84/162] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:26 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:27.209434 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e0975211-e3e8-42fe-92aa-60d591696885 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:27.210401 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-e0975211-e3e8-42fe-92aa-60d591696885 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:27.249536 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e0975211-e3e8-42fe-92aa-60d591696885 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:27.250370 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e0975211-e3e8-42fe-92aa-60d591696885 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:27.251549 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e0975211-e3e8-42fe-92aa-60d591696885 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:27.252413 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e0975211-e3e8-42fe-92aa-60d591696885 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:27.517099 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-e0975211-e3e8-42fe-92aa-60d591696885 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:27.527710 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-e0975211-e3e8-42fe-92aa-60d591696885 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:27.529935 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-e0975211-e3e8-42fe-92aa-60d591696885 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:27.531386 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-e0975211-e3e8-42fe-92aa-60d591696885 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1408 microversion: 2.20 time: 0.331064 Oct 29 01:13:27.555294 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 79/163] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:13:27 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1408 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:13:28.124739 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9ceab222-8128-43b9-a803-4e0befadab0a tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:28.125875 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9ceab222-8128-43b9-a803-4e0befadab0a tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:28.132145 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9ceab222-8128-43b9-a803-4e0befadab0a tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:28.132765 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9ceab222-8128-43b9-a803-4e0befadab0a tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:28.133683 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9ceab222-8128-43b9-a803-4e0befadab0a tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:28.134263 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9ceab222-8128-43b9-a803-4e0befadab0a tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:28.428689 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-9ceab222-8128-43b9-a803-4e0befadab0a tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:28.439256 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9ceab222-8128-43b9-a803-4e0befadab0a tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1315 microversion: 2.1 time: 0.317826 Oct 29 01:13:28.440406 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 85/164] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:28 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:28.559046 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-b492784a-64e1-4a3b-8ab2-ed33321afd54 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:28.560592 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-b492784a-64e1-4a3b-8ab2-ed33321afd54 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:28.569150 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b492784a-64e1-4a3b-8ab2-ed33321afd54 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:28.570345 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b492784a-64e1-4a3b-8ab2-ed33321afd54 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:28.571396 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b492784a-64e1-4a3b-8ab2-ed33321afd54 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:28.572069 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b492784a-64e1-4a3b-8ab2-ed33321afd54 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:28.794669 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-b492784a-64e1-4a3b-8ab2-ed33321afd54 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:28.803609 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-b492784a-64e1-4a3b-8ab2-ed33321afd54 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:28.805417 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-b492784a-64e1-4a3b-8ab2-ed33321afd54 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:28.807905 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-b492784a-64e1-4a3b-8ab2-ed33321afd54 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1408 microversion: 2.20 time: 0.253890 Oct 29 01:13:28.809169 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 80/165] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:13:28 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1408 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:13:29.463750 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-0e63c0f2-12b9-41e5-870c-66b8881da0fb tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:29.464368 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-0e63c0f2-12b9-41e5-870c-66b8881da0fb tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:29.481236 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0e63c0f2-12b9-41e5-870c-66b8881da0fb tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:29.481691 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0e63c0f2-12b9-41e5-870c-66b8881da0fb tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:29.482500 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0e63c0f2-12b9-41e5-870c-66b8881da0fb tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:29.482941 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0e63c0f2-12b9-41e5-870c-66b8881da0fb tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:29.833695 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e9a2e6cb-75f4-4e44-a3c0-ca54376b1c07 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:29.834298 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-e9a2e6cb-75f4-4e44-a3c0-ca54376b1c07 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:29.844636 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e9a2e6cb-75f4-4e44-a3c0-ca54376b1c07 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:29.845086 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e9a2e6cb-75f4-4e44-a3c0-ca54376b1c07 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:29.845869 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e9a2e6cb-75f4-4e44-a3c0-ca54376b1c07 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:29.846305 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e9a2e6cb-75f4-4e44-a3c0-ca54376b1c07 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:29.888724 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-0e63c0f2-12b9-41e5-870c-66b8881da0fb tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:29.903596 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-0e63c0f2-12b9-41e5-870c-66b8881da0fb tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1315 microversion: 2.1 time: 0.447788 Oct 29 01:13:29.915106 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 86/166] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:29 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1315 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:30.121824 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-e9a2e6cb-75f4-4e44-a3c0-ca54376b1c07 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:30.130123 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-e9a2e6cb-75f4-4e44-a3c0-ca54376b1c07 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:30.131663 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-e9a2e6cb-75f4-4e44-a3c0-ca54376b1c07 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:30.132779 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-e9a2e6cb-75f4-4e44-a3c0-ca54376b1c07 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1408 microversion: 2.20 time: 0.307123 Oct 29 01:13:30.145874 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 81/167] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:13:29 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1408 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:13:30.930836 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-32b541cc-f18a-4684-a945-4c74d079c797 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:30.931546 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-32b541cc-f18a-4684-a945-4c74d079c797 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:30.939557 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-32b541cc-f18a-4684-a945-4c74d079c797 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:30.940247 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-32b541cc-f18a-4684-a945-4c74d079c797 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:30.941093 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-32b541cc-f18a-4684-a945-4c74d079c797 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:30.941705 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-32b541cc-f18a-4684-a945-4c74d079c797 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:31.095249 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-32b541cc-f18a-4684-a945-4c74d079c797 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:31.106102 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-32b541cc-f18a-4684-a945-4c74d079c797 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1315 microversion: 2.1 time: 0.178520 Oct 29 01:13:31.108069 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 87/168] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:30 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:31.163261 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-00ebed08-8fa2-4c30-afe1-904976c55f0b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:31.164193 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-00ebed08-8fa2-4c30-afe1-904976c55f0b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:31.176377 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-00ebed08-8fa2-4c30-afe1-904976c55f0b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:31.176822 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-00ebed08-8fa2-4c30-afe1-904976c55f0b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:31.177607 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-00ebed08-8fa2-4c30-afe1-904976c55f0b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:31.178030 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-00ebed08-8fa2-4c30-afe1-904976c55f0b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:31.419807 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-00ebed08-8fa2-4c30-afe1-904976c55f0b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:31.427919 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-00ebed08-8fa2-4c30-afe1-904976c55f0b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:31.429811 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-00ebed08-8fa2-4c30-afe1-904976c55f0b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:31.431161 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-00ebed08-8fa2-4c30-afe1-904976c55f0b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1408 microversion: 2.20 time: 0.271719 Oct 29 01:13:31.432848 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 82/169] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:13:31 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1408 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:13:32.125464 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b6934e6c-fd74-4034-9f7a-96516c489639 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:32.127094 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b6934e6c-fd74-4034-9f7a-96516c489639 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:32.135480 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b6934e6c-fd74-4034-9f7a-96516c489639 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:32.137208 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b6934e6c-fd74-4034-9f7a-96516c489639 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:32.138528 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b6934e6c-fd74-4034-9f7a-96516c489639 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:32.139820 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b6934e6c-fd74-4034-9f7a-96516c489639 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:32.324694 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-b6934e6c-fd74-4034-9f7a-96516c489639 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:32.334877 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b6934e6c-fd74-4034-9f7a-96516c489639 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1315 microversion: 2.1 time: 0.213795 Oct 29 01:13:32.335799 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 88/170] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:32 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:32.451355 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-3b6c1655-1090-4294-a138-d907310319fd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:32.452012 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-3b6c1655-1090-4294-a138-d907310319fd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:32.465181 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3b6c1655-1090-4294-a138-d907310319fd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:32.466752 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3b6c1655-1090-4294-a138-d907310319fd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:32.468877 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3b6c1655-1090-4294-a138-d907310319fd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:32.469428 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3b6c1655-1090-4294-a138-d907310319fd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:32.658049 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-3b6c1655-1090-4294-a138-d907310319fd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:32.675983 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-3b6c1655-1090-4294-a138-d907310319fd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:32.679740 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-3b6c1655-1090-4294-a138-d907310319fd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:32.682804 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-3b6c1655-1090-4294-a138-d907310319fd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1408 microversion: 2.20 time: 0.236327 Oct 29 01:13:32.683682 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 83/171] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:13:32 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1408 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:13:32.992624 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-96ab4bb2-3685-4e5a-87bf-ac81ebc6647d tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d37affa9-55e4-4782-a10e-837f26aad84c"}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:32.994818 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-96ab4bb2-3685-4e5a-87bf-ac81ebc6647d tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:33.002430 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-96ab4bb2-3685-4e5a-87bf-ac81ebc6647d tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:33.003151 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-96ab4bb2-3685-4e5a-87bf-ac81ebc6647d tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:33.004521 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-96ab4bb2-3685-4e5a-87bf-ac81ebc6647d tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:33.005211 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-96ab4bb2-3685-4e5a-87bf-ac81ebc6647d tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:33.352857 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-fac9bc1a-0c35-40bc-9374-9cc466cce517 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:33.353733 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-fac9bc1a-0c35-40bc-9374-9cc466cce517 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:33.360872 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fac9bc1a-0c35-40bc-9374-9cc466cce517 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:33.361375 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fac9bc1a-0c35-40bc-9374-9cc466cce517 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:33.362982 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fac9bc1a-0c35-40bc-9374-9cc466cce517 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:33.363772 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fac9bc1a-0c35-40bc-9374-9cc466cce517 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:33.559219 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-fac9bc1a-0c35-40bc-9374-9cc466cce517 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:33.570325 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-fac9bc1a-0c35-40bc-9374-9cc466cce517 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1502 microversion: 2.1 time: 0.218291 Oct 29 01:13:33.571039 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 84/172] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:33 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1502 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:33.701666 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-fd323045-5b48-4f92-9f47-197308d4a273 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:33.703111 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-fd323045-5b48-4f92-9f47-197308d4a273 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:33.710092 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fd323045-5b48-4f92-9f47-197308d4a273 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:33.710610 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fd323045-5b48-4f92-9f47-197308d4a273 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:33.711383 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fd323045-5b48-4f92-9f47-197308d4a273 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:33.711806 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fd323045-5b48-4f92-9f47-197308d4a273 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:33.866822 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-fd323045-5b48-4f92-9f47-197308d4a273 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:33.886486 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-fd323045-5b48-4f92-9f47-197308d4a273 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:33.888563 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-fd323045-5b48-4f92-9f47-197308d4a273 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:33.889886 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-fd323045-5b48-4f92-9f47-197308d4a273 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1599 microversion: 2.20 time: 0.192935 Oct 29 01:13:33.890933 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 85/173] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:13:33 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1599 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:13:33.913434 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-4a5d074d-a4ee-48c8-9a9d-0709625f3503 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:33.913950 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-4a5d074d-a4ee-48c8-9a9d-0709625f3503 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:33.921759 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4a5d074d-a4ee-48c8-9a9d-0709625f3503 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:33.922218 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4a5d074d-a4ee-48c8-9a9d-0709625f3503 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:33.923064 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4a5d074d-a4ee-48c8-9a9d-0709625f3503 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:33.923507 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4a5d074d-a4ee-48c8-9a9d-0709625f3503 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:34.125431 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-4a5d074d-a4ee-48c8-9a9d-0709625f3503 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.219209 Oct 29 01:13:34.132349 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 86/174] 10.222.0.90 () {60 vars in 1315 bytes} [Fri Oct 29 01:13:33 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/os-interface => generated 284 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:13:36.289757 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e221c2b7-c0c5-443d-a480-2115f7afaadc tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:36.290786 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-e221c2b7-c0c5-443d-a480-2115f7afaadc tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:36.296856 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e221c2b7-c0c5-443d-a480-2115f7afaadc tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:36.297535 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e221c2b7-c0c5-443d-a480-2115f7afaadc tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:36.298302 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e221c2b7-c0c5-443d-a480-2115f7afaadc tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:36.298767 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e221c2b7-c0c5-443d-a480-2115f7afaadc tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:36.565732 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-e221c2b7-c0c5-443d-a480-2115f7afaadc tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 200 len: 14 microversion: 2.20 time: 0.279502 Oct 29 01:13:36.570728 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 87/175] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:13:36 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 14 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:36.576952 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [req-e3d0211c-ad45-4d91-a847-10c24cac38a8 req-7b092a26-b877-4874-a17e-b5d917c2683c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27a73464-dcac-4be6-a392-58d40a0296a8", "tag": "f3a5c6a4-eba2-4bfd-91f6-59386b7c88e8"}]} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:36.599782 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:13:36.599782 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: warnings.warn(msg) Oct 29 01:13:36.610358 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-e3d0211c-ad45-4d91-a847-10c24cac38a8 req-7b092a26-b877-4874-a17e-b5d917c2683c service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:36.611113 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-e3d0211c-ad45-4d91-a847-10c24cac38a8 req-7b092a26-b877-4874-a17e-b5d917c2683c service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:36.667551 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.compute.server_external_events [req-e3d0211c-ad45-4d91-a847-10c24cac38a8 req-7b092a26-b877-4874-a17e-b5d917c2683c service nova] Creating event network-changed:f3a5c6a4-eba2-4bfd-91f6-59386b7c88e8 for instance 27a73464-dcac-4be6-a392-58d40a0296a8 on hv-cinder-81558 Oct 29 01:13:36.678589 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [req-e3d0211c-ad45-4d91-a847-10c24cac38a8 req-7b092a26-b877-4874-a17e-b5d917c2683c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106303 Oct 29 01:13:36.682021 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 88/176] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:13:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:13:36.939700 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-96ab4bb2-3685-4e5a-87bf-ac81ebc6647d tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "POST /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.953514 Oct 29 01:13:36.948140 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 89/177] 10.222.0.90 () {60 vars in 1322 bytes} [Fri Oct 29 01:13:32 2021] POST /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535/os-volume_attachments => generated 194 bytes in 3961 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:13:37.581733 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-19eae8ae-5d29-4333-a3cb-53c9cb577474 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:37.582835 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-19eae8ae-5d29-4333-a3cb-53c9cb577474 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:37.595654 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-19eae8ae-5d29-4333-a3cb-53c9cb577474 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:37.596094 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-19eae8ae-5d29-4333-a3cb-53c9cb577474 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:37.596948 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-19eae8ae-5d29-4333-a3cb-53c9cb577474 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:37.597275 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-19eae8ae-5d29-4333-a3cb-53c9cb577474 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:37.778926 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-19eae8ae-5d29-4333-a3cb-53c9cb577474 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 200 len: 14 microversion: 2.20 time: 0.204147 Oct 29 01:13:37.779582 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 89/178] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:13:37 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 14 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:38.372249 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-afa4242e-7adb-4cc6-82a0-bf6bd4cfb773 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f589a4d7-8923-4bda-bd1b-1aa7e579de9b"}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:38.374664 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-afa4242e-7adb-4cc6-82a0-bf6bd4cfb773 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:38.394755 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-afa4242e-7adb-4cc6-82a0-bf6bd4cfb773 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:38.398810 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-afa4242e-7adb-4cc6-82a0-bf6bd4cfb773 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:38.399917 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-afa4242e-7adb-4cc6-82a0-bf6bd4cfb773 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:38.408709 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-afa4242e-7adb-4cc6-82a0-bf6bd4cfb773 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:38.791946 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-ce5ee74d-bff3-4b4e-88de-fd2fd22eea47 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:38.794184 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-ce5ee74d-bff3-4b4e-88de-fd2fd22eea47 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:38.802780 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ce5ee74d-bff3-4b4e-88de-fd2fd22eea47 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:38.803648 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ce5ee74d-bff3-4b4e-88de-fd2fd22eea47 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:38.804674 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ce5ee74d-bff3-4b4e-88de-fd2fd22eea47 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:38.805634 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ce5ee74d-bff3-4b4e-88de-fd2fd22eea47 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:38.866967 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-afa4242e-7adb-4cc6-82a0-bf6bd4cfb773 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "POST /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.501066 Oct 29 01:13:38.867588 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 90/179] 10.222.0.90 () {60 vars in 1322 bytes} [Fri Oct 29 01:13:38 2021] POST /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a/os-volume_attachments => generated 194 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:13:39.005523 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-ce5ee74d-bff3-4b4e-88de-fd2fd22eea47 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 200 len: 14 microversion: 2.20 time: 0.218338 Oct 29 01:13:39.006473 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 90/180] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:13:38 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 14 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:13:40.033677 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ce9c55d4-c3f2-460a-a820-30542d2a7258 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:40.036099 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ce9c55d4-c3f2-460a-a820-30542d2a7258 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:40.047291 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ce9c55d4-c3f2-460a-a820-30542d2a7258 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:40.049396 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ce9c55d4-c3f2-460a-a820-30542d2a7258 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:40.050543 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ce9c55d4-c3f2-460a-a820-30542d2a7258 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:40.051385 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ce9c55d4-c3f2-460a-a820-30542d2a7258 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:40.184359 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ce9c55d4-c3f2-460a-a820-30542d2a7258 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 200 len: 14 microversion: 2.20 time: 0.169751 Oct 29 01:13:40.187383 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 91/181] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:13:40 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 14 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:40.852567 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-355aae2e-ca6d-44f2-8ca6-c6ae6480bbdf tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Action: 'create', calling method: .version_select at 0x7f602959f5e0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1011925652"}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:40.894648 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.quota [None req-355aae2e-ca6d-44f2-8ca6-c6ae6480bbdf tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Getting quotas for project 7c4db728610349e3b7f324f37a51b58c. Resources: {'key_pairs'} {{(pid=115748) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:13:40.900821 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.quota [None req-355aae2e-ca6d-44f2-8ca6-c6ae6480bbdf tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Getting quotas for user 306798b38f4f419aaf5472650c2c1ea5 and project 7c4db728610349e3b7f324f37a51b58c. Resources: {'key_pairs'} {{(pid=115748) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:13:41.144671 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.quota [None req-355aae2e-ca6d-44f2-8ca6-c6ae6480bbdf tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Getting quotas for project 7c4db728610349e3b7f324f37a51b58c. Resources: {'key_pairs'} {{(pid=115748) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:13:41.153452 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.quota [None req-355aae2e-ca6d-44f2-8ca6-c6ae6480bbdf tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Getting quotas for user 306798b38f4f419aaf5472650c2c1ea5 and project 7c4db728610349e3b7f324f37a51b58c. Resources: {'key_pairs'} {{(pid=115748) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:13:41.170316 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-355aae2e-ca6d-44f2-8ca6-c6ae6480bbdf tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.662253 Oct 29 01:13:41.171678 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 91/182] 10.222.0.90 () {60 vars in 1157 bytes} [Fri Oct 29 01:13:40 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:41.203604 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c822a941-8d47-45ea-8659-590e25c4dd6a tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:41.204709 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c822a941-8d47-45ea-8659-590e25c4dd6a tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:41.243241 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c822a941-8d47-45ea-8659-590e25c4dd6a tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:41.243241 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c822a941-8d47-45ea-8659-590e25c4dd6a tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:41.243241 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c822a941-8d47-45ea-8659-590e25c4dd6a tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:41.243241 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c822a941-8d47-45ea-8659-590e25c4dd6a tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:41.388082 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c822a941-8d47-45ea-8659-590e25c4dd6a tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 200 len: 14 microversion: 2.20 time: 0.193759 Oct 29 01:13:41.388867 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 92/183] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:13:41 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 14 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:42.399802 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-02e1d36b-a80b-4f19-b3a7-fb86635b6b07 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:42.401634 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-02e1d36b-a80b-4f19-b3a7-fb86635b6b07 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:42.421257 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-02e1d36b-a80b-4f19-b3a7-fb86635b6b07 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:42.421654 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-02e1d36b-a80b-4f19-b3a7-fb86635b6b07 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:42.422502 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-02e1d36b-a80b-4f19-b3a7-fb86635b6b07 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:42.422877 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-02e1d36b-a80b-4f19-b3a7-fb86635b6b07 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:42.575489 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-02e1d36b-a80b-4f19-b3a7-fb86635b6b07 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 200 len: 14 microversion: 2.20 time: 0.179889 Oct 29 01:13:42.577190 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 92/184] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:13:42 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 14 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:43.590609 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-627622c1-edc7-45b8-92b8-8fdea6d4335f tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:43.592505 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-627622c1-edc7-45b8-92b8-8fdea6d4335f tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:43.604758 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-627622c1-edc7-45b8-92b8-8fdea6d4335f tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:43.608651 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-627622c1-edc7-45b8-92b8-8fdea6d4335f tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:43.613148 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-627622c1-edc7-45b8-92b8-8fdea6d4335f tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:43.614835 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-627622c1-edc7-45b8-92b8-8fdea6d4335f tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:46.448267 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-627622c1-edc7-45b8-92b8-8fdea6d4335f tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 200 len: 14 microversion: 2.20 time: 2.859416 Oct 29 01:13:46.448267 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 93/185] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:13:43 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 14 bytes in 2864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:13:47.457883 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-a392a573-388f-459c-8c30-be8f3edde8c2 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:47.459594 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-a392a573-388f-459c-8c30-be8f3edde8c2 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:47.483075 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a392a573-388f-459c-8c30-be8f3edde8c2 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:47.483849 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a392a573-388f-459c-8c30-be8f3edde8c2 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:47.484215 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a392a573-388f-459c-8c30-be8f3edde8c2 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:47.484637 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a392a573-388f-459c-8c30-be8f3edde8c2 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:47.653487 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-a392a573-388f-459c-8c30-be8f3edde8c2 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 200 len: 14 microversion: 2.20 time: 0.199466 Oct 29 01:13:47.657754 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 93/186] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:13:47 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 14 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:48.665727 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c6f2c722-1cb5-4c1a-9169-f791f506738b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:48.666792 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c6f2c722-1cb5-4c1a-9169-f791f506738b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:48.676754 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c6f2c722-1cb5-4c1a-9169-f791f506738b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:48.677965 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c6f2c722-1cb5-4c1a-9169-f791f506738b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:48.678969 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c6f2c722-1cb5-4c1a-9169-f791f506738b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:48.679571 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c6f2c722-1cb5-4c1a-9169-f791f506738b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:48.793263 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c6f2c722-1cb5-4c1a-9169-f791f506738b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 200 len: 14 microversion: 2.20 time: 0.131349 Oct 29 01:13:48.793799 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 94/187] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:13:48 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:49.564767 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2889ad43-6919-414f-9506-0a40bb004f47 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1992389042", "imageRef": "3fef3f0d-d772-4999-b764-d6690634a06d", "flavorRef": "452", "networks": [{"uuid": "04819660-923b-4a69-94a5-8390cbffb752"}]}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:49.618774 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.network.neutron [None req-2889ad43-6919-414f-9506-0a40bb004f47 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] validate_networks() for [('04819660-923b-4a69-94a5-8390cbffb752', None, None, None, None, None)] {{(pid=115748) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 01:13:49.804462 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a4562264-1e2a-4c75-bb5c-1497f7e1b95b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:49.805621 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a4562264-1e2a-4c75-bb5c-1497f7e1b95b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:49.812483 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a4562264-1e2a-4c75-bb5c-1497f7e1b95b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:49.813005 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a4562264-1e2a-4c75-bb5c-1497f7e1b95b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:49.813838 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a4562264-1e2a-4c75-bb5c-1497f7e1b95b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:49.814463 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a4562264-1e2a-4c75-bb5c-1497f7e1b95b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:49.980025 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a4562264-1e2a-4c75-bb5c-1497f7e1b95b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 200 len: 1652 microversion: 2.20 time: 0.179294 Oct 29 01:13:49.982419 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 95/188] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:13:49 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 1652 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:13:50.000968 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.virt.hardware [None req-2889ad43-6919-414f-9506-0a40bb004f47 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Flavor limits 0:0:0 {{(pid=115748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:13:50.001419 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.virt.hardware [None req-2889ad43-6919-414f-9506-0a40bb004f47 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Image limits 0:0:0 {{(pid=115748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:13:50.001883 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.virt.hardware [None req-2889ad43-6919-414f-9506-0a40bb004f47 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Flavor pref 0:0:0 {{(pid=115748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:13:50.002282 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.virt.hardware [None req-2889ad43-6919-414f-9506-0a40bb004f47 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Image pref 0:0:0 {{(pid=115748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:13:50.002717 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.virt.hardware [None req-2889ad43-6919-414f-9506-0a40bb004f47 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:13:50.012213 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2889ad43-6919-414f-9506-0a40bb004f47 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:50.012873 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2889ad43-6919-414f-9506-0a40bb004f47 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:50.013828 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2889ad43-6919-414f-9506-0a40bb004f47 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:50.014473 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2889ad43-6919-414f-9506-0a40bb004f47 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:50.031494 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.quota [None req-2889ad43-6919-414f-9506-0a40bb004f47 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Getting quotas for project 355f0948092d4f3c929575a405284599. Resources: {'instances', 'cores', 'ram'} {{(pid=115748) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:13:50.035445 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.quota [None req-2889ad43-6919-414f-9506-0a40bb004f47 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Getting quotas for user 8fe86a50674f4837bfcb81170f5fd253 and project 355f0948092d4f3c929575a405284599. Resources: {'instances', 'cores', 'ram'} {{(pid=115748) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:13:50.048319 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2889ad43-6919-414f-9506-0a40bb004f47 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Going to run 1 instances... {{(pid=115748) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 01:13:50.051334 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2889ad43-6919-414f-9506-0a40bb004f47 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 176a8750-3a7e-4e6e-97b9-8394581d0ff3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3fef3f0d-d772-4999-b764-d6690634a06d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 01:13:50.098524 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2889ad43-6919-414f-9506-0a40bb004f47 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.537616 Oct 29 01:13:50.099164 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 94/189] 10.222.0.90 () {60 vars in 1146 bytes} [Fri Oct 29 01:13:49 2021] POST /compute/v2.1/servers => generated 380 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:13:50.109907 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c89a400b-1ab9-427e-ba58-756c23e47ee4 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:50.110633 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c89a400b-1ab9-427e-ba58-756c23e47ee4 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 176a8750-3a7e-4e6e-97b9-8394581d0ff3] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:50.165723 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c89a400b-1ab9-427e-ba58-756c23e47ee4 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:50.177216 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c89a400b-1ab9-427e-ba58-756c23e47ee4 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/176a8750-3a7e-4e6e-97b9-8394581d0ff3" status: 200 len: 1218 microversion: 2.1 time: 0.071212 Oct 29 01:13:50.185514 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 96/190] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:50 2021] GET /compute/v2.1/servers/176a8750-3a7e-4e6e-97b9-8394581d0ff3 => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:50.990373 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-29fa7cae-546b-4651-a592-7211c1f113dd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:50.991346 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-29fa7cae-546b-4651-a592-7211c1f113dd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:50.998356 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-29fa7cae-546b-4651-a592-7211c1f113dd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:50.998835 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-29fa7cae-546b-4651-a592-7211c1f113dd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:50.999577 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-29fa7cae-546b-4651-a592-7211c1f113dd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:50.999999 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-29fa7cae-546b-4651-a592-7211c1f113dd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:51.194198 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-93621fd1-b1b2-490d-a8b7-591469fdd77f tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:51.194783 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-93621fd1-b1b2-490d-a8b7-591469fdd77f tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 176a8750-3a7e-4e6e-97b9-8394581d0ff3] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:51.201202 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-93621fd1-b1b2-490d-a8b7-591469fdd77f tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:51.201642 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-93621fd1-b1b2-490d-a8b7-591469fdd77f tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:51.202409 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-93621fd1-b1b2-490d-a8b7-591469fdd77f tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:51.202833 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-93621fd1-b1b2-490d-a8b7-591469fdd77f tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:51.261684 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-93621fd1-b1b2-490d-a8b7-591469fdd77f tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:51.270147 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-93621fd1-b1b2-490d-a8b7-591469fdd77f tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/176a8750-3a7e-4e6e-97b9-8394581d0ff3" status: 200 len: 1214 microversion: 2.1 time: 0.079926 Oct 29 01:13:51.270790 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 97/191] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:51 2021] GET /compute/v2.1/servers/176a8750-3a7e-4e6e-97b9-8394581d0ff3 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:13:52.287389 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f28f87ab-96c0-4c80-be97-32d8976617c3 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:52.287989 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f28f87ab-96c0-4c80-be97-32d8976617c3 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 176a8750-3a7e-4e6e-97b9-8394581d0ff3] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:52.294372 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f28f87ab-96c0-4c80-be97-32d8976617c3 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:52.294932 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f28f87ab-96c0-4c80-be97-32d8976617c3 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:52.295686 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f28f87ab-96c0-4c80-be97-32d8976617c3 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:52.296109 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f28f87ab-96c0-4c80-be97-32d8976617c3 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:52.353703 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-f28f87ab-96c0-4c80-be97-32d8976617c3 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:52.360853 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f28f87ab-96c0-4c80-be97-32d8976617c3 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/176a8750-3a7e-4e6e-97b9-8394581d0ff3" status: 200 len: 1214 microversion: 2.1 time: 0.077172 Oct 29 01:13:52.361402 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 98/192] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:52 2021] GET /compute/v2.1/servers/176a8750-3a7e-4e6e-97b9-8394581d0ff3 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:13:53.377698 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-38dc9a18-7e98-4f2c-99b4-5328c1620c40 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:53.378369 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-38dc9a18-7e98-4f2c-99b4-5328c1620c40 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 176a8750-3a7e-4e6e-97b9-8394581d0ff3] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:53.385057 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-38dc9a18-7e98-4f2c-99b4-5328c1620c40 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:53.385504 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-38dc9a18-7e98-4f2c-99b4-5328c1620c40 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:53.386256 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-38dc9a18-7e98-4f2c-99b4-5328c1620c40 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:53.386722 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-38dc9a18-7e98-4f2c-99b4-5328c1620c40 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:53.458043 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-38dc9a18-7e98-4f2c-99b4-5328c1620c40 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:53.468343 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-38dc9a18-7e98-4f2c-99b4-5328c1620c40 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/176a8750-3a7e-4e6e-97b9-8394581d0ff3" status: 200 len: 1214 microversion: 2.1 time: 0.094210 Oct 29 01:13:53.469144 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 99/193] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:53 2021] GET /compute/v2.1/servers/176a8750-3a7e-4e6e-97b9-8394581d0ff3 => generated 1214 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:13:54.196072 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-29fa7cae-546b-4651-a592-7211c1f113dd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 200 len: 15064 microversion: 2.20 time: 3.209155 Oct 29 01:13:54.196946 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 95/194] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:13:50 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 15064 bytes in 3211 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:13:54.484809 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-1a5aad69-6fe8-41cf-b599-f674f96b3c1b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:54.485413 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-1a5aad69-6fe8-41cf-b599-f674f96b3c1b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 176a8750-3a7e-4e6e-97b9-8394581d0ff3] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:54.491526 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1a5aad69-6fe8-41cf-b599-f674f96b3c1b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:54.491970 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1a5aad69-6fe8-41cf-b599-f674f96b3c1b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:54.493222 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1a5aad69-6fe8-41cf-b599-f674f96b3c1b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:54.493647 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1a5aad69-6fe8-41cf-b599-f674f96b3c1b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:54.584068 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-1a5aad69-6fe8-41cf-b599-f674f96b3c1b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:54.591737 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-1a5aad69-6fe8-41cf-b599-f674f96b3c1b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/176a8750-3a7e-4e6e-97b9-8394581d0ff3" status: 200 len: 1270 microversion: 2.1 time: 0.110654 Oct 29 01:13:54.592287 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 100/195] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:54 2021] GET /compute/v2.1/servers/176a8750-3a7e-4e6e-97b9-8394581d0ff3 => generated 1270 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:55.208674 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-b23bca4b-b08e-4efd-8990-a069d073d47b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:55.209696 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-b23bca4b-b08e-4efd-8990-a069d073d47b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:55.218803 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b23bca4b-b08e-4efd-8990-a069d073d47b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:55.219370 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b23bca4b-b08e-4efd-8990-a069d073d47b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:55.220172 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b23bca4b-b08e-4efd-8990-a069d073d47b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:55.220607 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b23bca4b-b08e-4efd-8990-a069d073d47b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:55.399991 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-b23bca4b-b08e-4efd-8990-a069d073d47b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 200 len: 17781 microversion: 2.20 time: 0.195736 Oct 29 01:13:55.400586 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 96/196] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:13:55 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 17781 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:13:55.611446 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-62d960b3-b156-4c88-821c-8731ef385492 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:55.612065 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-62d960b3-b156-4c88-821c-8731ef385492 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 176a8750-3a7e-4e6e-97b9-8394581d0ff3] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:55.622067 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-62d960b3-b156-4c88-821c-8731ef385492 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:55.622548 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-62d960b3-b156-4c88-821c-8731ef385492 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:55.623474 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-62d960b3-b156-4c88-821c-8731ef385492 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:55.624292 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-62d960b3-b156-4c88-821c-8731ef385492 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:55.859775 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-62d960b3-b156-4c88-821c-8731ef385492 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:55.867088 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-62d960b3-b156-4c88-821c-8731ef385492 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/176a8750-3a7e-4e6e-97b9-8394581d0ff3" status: 200 len: 1318 microversion: 2.1 time: 0.260618 Oct 29 01:13:55.868206 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 101/197] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:55 2021] GET /compute/v2.1/servers/176a8750-3a7e-4e6e-97b9-8394581d0ff3 => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:56.412408 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-15c89108-3d26-4f03-8f7d-e569c393ab3a tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:56.413466 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-15c89108-3d26-4f03-8f7d-e569c393ab3a tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:56.420654 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-15c89108-3d26-4f03-8f7d-e569c393ab3a tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:56.421260 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-15c89108-3d26-4f03-8f7d-e569c393ab3a tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:56.422442 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-15c89108-3d26-4f03-8f7d-e569c393ab3a tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:56.422875 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-15c89108-3d26-4f03-8f7d-e569c393ab3a tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:56.529915 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [req-51e1d7b0-3a5a-4bb0-8c5e-01fe67fee0a0 req-2289a6db-fb57-4e8a-82e1-9a654ce7fafe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "176a8750-3a7e-4e6e-97b9-8394581d0ff3", "tag": "cadc346c-7128-4011-9c14-1ca218295b4e"}]} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:56.533473 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:13:56.533473 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: warnings.warn(msg) Oct 29 01:13:56.538875 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-15c89108-3d26-4f03-8f7d-e569c393ab3a tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 200 len: 17808 microversion: 2.20 time: 0.130773 Oct 29 01:13:56.541088 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 97/198] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:13:56 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 17808 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:13:56.554569 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-51e1d7b0-3a5a-4bb0-8c5e-01fe67fee0a0 req-2289a6db-fb57-4e8a-82e1-9a654ce7fafe service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:56.554910 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-51e1d7b0-3a5a-4bb0-8c5e-01fe67fee0a0 req-2289a6db-fb57-4e8a-82e1-9a654ce7fafe service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:56.576691 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.compute.server_external_events [req-51e1d7b0-3a5a-4bb0-8c5e-01fe67fee0a0 req-2289a6db-fb57-4e8a-82e1-9a654ce7fafe service nova] Creating event network-changed:cadc346c-7128-4011-9c14-1ca218295b4e for instance 176a8750-3a7e-4e6e-97b9-8394581d0ff3 on hv-cinder-81558 Oct 29 01:13:56.581752 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [req-51e1d7b0-3a5a-4bb0-8c5e-01fe67fee0a0 req-2289a6db-fb57-4e8a-82e1-9a654ce7fafe service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063992 Oct 29 01:13:56.582783 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 102/199] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:13:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:13:56.887368 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-dc670888-9ba7-481c-89dd-20befb10e6f7 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:56.892059 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-dc670888-9ba7-481c-89dd-20befb10e6f7 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 176a8750-3a7e-4e6e-97b9-8394581d0ff3] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:56.900261 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dc670888-9ba7-481c-89dd-20befb10e6f7 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:56.901237 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dc670888-9ba7-481c-89dd-20befb10e6f7 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:56.902237 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dc670888-9ba7-481c-89dd-20befb10e6f7 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:56.902772 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dc670888-9ba7-481c-89dd-20befb10e6f7 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:57.168227 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-dc670888-9ba7-481c-89dd-20befb10e6f7 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:57.177142 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-dc670888-9ba7-481c-89dd-20befb10e6f7 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/176a8750-3a7e-4e6e-97b9-8394581d0ff3" status: 200 len: 1318 microversion: 2.1 time: 0.295364 Oct 29 01:13:57.177717 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 98/200] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:56 2021] GET /compute/v2.1/servers/176a8750-3a7e-4e6e-97b9-8394581d0ff3 => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:57.552631 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-7860b6f5-4ab0-409b-a767-ce7dec2058c6 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:57.553653 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-7860b6f5-4ab0-409b-a767-ce7dec2058c6 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:57.570373 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7860b6f5-4ab0-409b-a767-ce7dec2058c6 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:57.570909 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7860b6f5-4ab0-409b-a767-ce7dec2058c6 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:57.571944 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7860b6f5-4ab0-409b-a767-ce7dec2058c6 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:57.572481 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7860b6f5-4ab0-409b-a767-ce7dec2058c6 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:57.762155 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-7860b6f5-4ab0-409b-a767-ce7dec2058c6 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 200 len: 19342 microversion: 2.20 time: 0.214535 Oct 29 01:13:57.763078 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 103/201] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:13:57 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 19342 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:13:58.199168 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-bf5ce87d-57db-433c-8196-fb58d2dc73fa tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:58.200415 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-bf5ce87d-57db-433c-8196-fb58d2dc73fa tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 176a8750-3a7e-4e6e-97b9-8394581d0ff3] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:58.208353 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bf5ce87d-57db-433c-8196-fb58d2dc73fa tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:58.208787 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bf5ce87d-57db-433c-8196-fb58d2dc73fa tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:58.209552 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bf5ce87d-57db-433c-8196-fb58d2dc73fa tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:58.210010 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bf5ce87d-57db-433c-8196-fb58d2dc73fa tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:58.430051 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-bf5ce87d-57db-433c-8196-fb58d2dc73fa tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:58.438049 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-bf5ce87d-57db-433c-8196-fb58d2dc73fa tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/176a8750-3a7e-4e6e-97b9-8394581d0ff3" status: 200 len: 1318 microversion: 2.1 time: 0.245971 Oct 29 01:13:58.438654 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 99/202] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:58 2021] GET /compute/v2.1/servers/176a8750-3a7e-4e6e-97b9-8394581d0ff3 => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:58.774945 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-377dd9d4-ef7b-4f9a-8df3-ad2ce86662ef tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:58.776084 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-377dd9d4-ef7b-4f9a-8df3-ad2ce86662ef tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:58.785802 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-377dd9d4-ef7b-4f9a-8df3-ad2ce86662ef tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:58.786625 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-377dd9d4-ef7b-4f9a-8df3-ad2ce86662ef tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:58.787854 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-377dd9d4-ef7b-4f9a-8df3-ad2ce86662ef tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:58.789726 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-377dd9d4-ef7b-4f9a-8df3-ad2ce86662ef tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:58.916751 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-377dd9d4-ef7b-4f9a-8df3-ad2ce86662ef tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 200 len: 20991 microversion: 2.20 time: 0.146361 Oct 29 01:13:58.917703 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 104/203] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:13:58 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 20991 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:13:59.456193 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-7ef3ee02-0cc3-4ae0-b0bc-aa70571b30d4 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:59.456729 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-7ef3ee02-0cc3-4ae0-b0bc-aa70571b30d4 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 176a8750-3a7e-4e6e-97b9-8394581d0ff3] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:59.465856 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7ef3ee02-0cc3-4ae0-b0bc-aa70571b30d4 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:59.466308 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7ef3ee02-0cc3-4ae0-b0bc-aa70571b30d4 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:59.469844 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7ef3ee02-0cc3-4ae0-b0bc-aa70571b30d4 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:59.470600 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7ef3ee02-0cc3-4ae0-b0bc-aa70571b30d4 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:59.870043 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-7ef3ee02-0cc3-4ae0-b0bc-aa70571b30d4 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:59.879427 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-7ef3ee02-0cc3-4ae0-b0bc-aa70571b30d4 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/176a8750-3a7e-4e6e-97b9-8394581d0ff3" status: 200 len: 1318 microversion: 2.1 time: 0.427295 Oct 29 01:13:59.882929 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 100/204] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:13:59 2021] GET /compute/v2.1/servers/176a8750-3a7e-4e6e-97b9-8394581d0ff3 => generated 1318 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:59.931288 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-77d872c6-ad21-48f7-9612-d3a73aaf38ab tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:59.932354 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-77d872c6-ad21-48f7-9612-d3a73aaf38ab tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:13:59.945302 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-77d872c6-ad21-48f7-9612-d3a73aaf38ab tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:59.946016 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-77d872c6-ad21-48f7-9612-d3a73aaf38ab tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:13:59.949129 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-77d872c6-ad21-48f7-9612-d3a73aaf38ab tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:13:59.949579 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-77d872c6-ad21-48f7-9612-d3a73aaf38ab tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:00.087055 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-77d872c6-ad21-48f7-9612-d3a73aaf38ab tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 200 len: 22433 microversion: 2.20 time: 0.161314 Oct 29 01:14:00.094551 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 105/205] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:13:59 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 22433 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:14:00.897663 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c07a373b-997b-4b7c-9f17-8667f9b8ff6d tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:00.898738 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c07a373b-997b-4b7c-9f17-8667f9b8ff6d tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 176a8750-3a7e-4e6e-97b9-8394581d0ff3] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:00.906186 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c07a373b-997b-4b7c-9f17-8667f9b8ff6d tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:00.906670 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c07a373b-997b-4b7c-9f17-8667f9b8ff6d tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:00.907989 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c07a373b-997b-4b7c-9f17-8667f9b8ff6d tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:00.908428 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c07a373b-997b-4b7c-9f17-8667f9b8ff6d tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:01.083931 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-c07a373b-997b-4b7c-9f17-8667f9b8ff6d tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:01.091917 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c07a373b-997b-4b7c-9f17-8667f9b8ff6d tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/176a8750-3a7e-4e6e-97b9-8394581d0ff3" status: 200 len: 1318 microversion: 2.1 time: 0.199120 Oct 29 01:14:01.096346 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 101/206] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:00 2021] GET /compute/v2.1/servers/176a8750-3a7e-4e6e-97b9-8394581d0ff3 => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:01.103016 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c71cdc52-c2a9-4052-9467-9d0f058c913c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:01.104237 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c71cdc52-c2a9-4052-9467-9d0f058c913c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:01.127593 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c71cdc52-c2a9-4052-9467-9d0f058c913c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:01.128040 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c71cdc52-c2a9-4052-9467-9d0f058c913c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:01.128819 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c71cdc52-c2a9-4052-9467-9d0f058c913c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:01.132844 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c71cdc52-c2a9-4052-9467-9d0f058c913c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:01.308809 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c71cdc52-c2a9-4052-9467-9d0f058c913c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 200 len: 23197 microversion: 2.20 time: 0.211927 Oct 29 01:14:01.309643 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 106/207] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:14:01 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 23197 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:14:01.372904 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-4506c1ce-4a51-4ac7-a761-8944a6d909b6 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:01.373844 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-4506c1ce-4a51-4ac7-a761-8944a6d909b6 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:01.380421 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4506c1ce-4a51-4ac7-a761-8944a6d909b6 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:01.381183 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4506c1ce-4a51-4ac7-a761-8944a6d909b6 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:01.382097 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4506c1ce-4a51-4ac7-a761-8944a6d909b6 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:01.383658 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4506c1ce-4a51-4ac7-a761-8944a6d909b6 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:01.410458 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-4506c1ce-4a51-4ac7-a761-8944a6d909b6 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Going to try to terminate instance {{(pid=115748) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 01:14:01.517192 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-4506c1ce-4a51-4ac7-a761-8944a6d909b6 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "DELETE /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 204 len: 0 microversion: 2.1 time: 0.148808 Oct 29 01:14:01.517978 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 102/208] 10.222.0.90 () {58 vars in 1238 bytes} [Fri Oct 29 01:14:01 2021] DELETE /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:14:01.527646 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f9a2d3c2-f49f-4298-b44b-206218de3a8c tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:01.528258 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f9a2d3c2-f49f-4298-b44b-206218de3a8c tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:01.535589 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f9a2d3c2-f49f-4298-b44b-206218de3a8c tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:01.536313 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f9a2d3c2-f49f-4298-b44b-206218de3a8c tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:01.537085 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f9a2d3c2-f49f-4298-b44b-206218de3a8c tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:01.537511 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f9a2d3c2-f49f-4298-b44b-206218de3a8c tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:01.896729 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-f9a2d3c2-f49f-4298-b44b-206218de3a8c tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:01.906367 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f9a2d3c2-f49f-4298-b44b-206218de3a8c tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1554 microversion: 2.1 time: 0.383200 Oct 29 01:14:01.907018 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 107/209] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:01 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1554 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:02.110534 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-ba3ed0db-8440-4bf7-984d-0d73325a4d35 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:02.111339 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-ba3ed0db-8440-4bf7-984d-0d73325a4d35 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 176a8750-3a7e-4e6e-97b9-8394581d0ff3] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:02.119982 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ba3ed0db-8440-4bf7-984d-0d73325a4d35 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:02.120384 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ba3ed0db-8440-4bf7-984d-0d73325a4d35 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:02.124805 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ba3ed0db-8440-4bf7-984d-0d73325a4d35 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:02.125292 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ba3ed0db-8440-4bf7-984d-0d73325a4d35 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:02.274724 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-ba3ed0db-8440-4bf7-984d-0d73325a4d35 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:02.288464 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-ba3ed0db-8440-4bf7-984d-0d73325a4d35 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/176a8750-3a7e-4e6e-97b9-8394581d0ff3" status: 200 len: 1318 microversion: 2.1 time: 0.181938 Oct 29 01:14:02.305157 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 103/210] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:02 2021] GET /compute/v2.1/servers/176a8750-3a7e-4e6e-97b9-8394581d0ff3 => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:02.321734 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c87c1e7d-ccd0-4b4e-9abe-4d55ceb4f3da tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:02.322777 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c87c1e7d-ccd0-4b4e-9abe-4d55ceb4f3da tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:02.330075 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c87c1e7d-ccd0-4b4e-9abe-4d55ceb4f3da tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:02.330551 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c87c1e7d-ccd0-4b4e-9abe-4d55ceb4f3da tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:02.331526 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c87c1e7d-ccd0-4b4e-9abe-4d55ceb4f3da tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:02.332128 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c87c1e7d-ccd0-4b4e-9abe-4d55ceb4f3da tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:02.923418 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e4475c96-a0ad-4cbf-86ed-481d9eca3667 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:02.924159 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-e4475c96-a0ad-4cbf-86ed-481d9eca3667 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:02.931711 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e4475c96-a0ad-4cbf-86ed-481d9eca3667 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:02.932167 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e4475c96-a0ad-4cbf-86ed-481d9eca3667 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:02.932943 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e4475c96-a0ad-4cbf-86ed-481d9eca3667 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:02.933533 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e4475c96-a0ad-4cbf-86ed-481d9eca3667 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:03.108518 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-e4475c96-a0ad-4cbf-86ed-481d9eca3667 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:03.117660 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-e4475c96-a0ad-4cbf-86ed-481d9eca3667 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1554 microversion: 2.1 time: 0.197560 Oct 29 01:14:03.121497 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 104/211] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:02 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1554 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:03.311407 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-3e6ad6d7-7068-4291-acee-83f8dd7c5348 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:03.312240 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-3e6ad6d7-7068-4291-acee-83f8dd7c5348 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 176a8750-3a7e-4e6e-97b9-8394581d0ff3] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:03.318171 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3e6ad6d7-7068-4291-acee-83f8dd7c5348 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:03.319030 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3e6ad6d7-7068-4291-acee-83f8dd7c5348 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:03.319934 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3e6ad6d7-7068-4291-acee-83f8dd7c5348 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:03.320533 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3e6ad6d7-7068-4291-acee-83f8dd7c5348 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:03.464791 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-3e6ad6d7-7068-4291-acee-83f8dd7c5348 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:03.472745 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-3e6ad6d7-7068-4291-acee-83f8dd7c5348 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/176a8750-3a7e-4e6e-97b9-8394581d0ff3" status: 200 len: 1318 microversion: 2.1 time: 0.165126 Oct 29 01:14:03.481947 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 105/212] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:03 2021] GET /compute/v2.1/servers/176a8750-3a7e-4e6e-97b9-8394581d0ff3 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:04.136834 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-ca016b0e-5abc-4679-955c-8fc355ee18ec tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:04.138506 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-ca016b0e-5abc-4679-955c-8fc355ee18ec tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:04.147136 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ca016b0e-5abc-4679-955c-8fc355ee18ec tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:04.147599 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ca016b0e-5abc-4679-955c-8fc355ee18ec tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:04.149055 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ca016b0e-5abc-4679-955c-8fc355ee18ec tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:04.149489 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ca016b0e-5abc-4679-955c-8fc355ee18ec tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:04.278332 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-ca016b0e-5abc-4679-955c-8fc355ee18ec tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:04.288157 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-ca016b0e-5abc-4679-955c-8fc355ee18ec tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1554 microversion: 2.1 time: 0.157396 Oct 29 01:14:04.288758 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 106/213] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:04 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:04.490009 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2a563b5d-5a59-4e37-bfea-d2bed8c65e2e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:04.490966 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2a563b5d-5a59-4e37-bfea-d2bed8c65e2e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 176a8750-3a7e-4e6e-97b9-8394581d0ff3] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:04.497992 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2a563b5d-5a59-4e37-bfea-d2bed8c65e2e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:04.498568 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2a563b5d-5a59-4e37-bfea-d2bed8c65e2e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:04.499521 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2a563b5d-5a59-4e37-bfea-d2bed8c65e2e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:04.500114 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2a563b5d-5a59-4e37-bfea-d2bed8c65e2e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:04.643334 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-2a563b5d-5a59-4e37-bfea-d2bed8c65e2e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:04.654274 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2a563b5d-5a59-4e37-bfea-d2bed8c65e2e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/176a8750-3a7e-4e6e-97b9-8394581d0ff3" status: 200 len: 1318 microversion: 2.1 time: 0.168015 Oct 29 01:14:04.681025 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 107/214] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:04 2021] GET /compute/v2.1/servers/176a8750-3a7e-4e6e-97b9-8394581d0ff3 => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:04.749390 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c87c1e7d-ccd0-4b4e-9abe-4d55ceb4f3da tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 200 len: 25187 microversion: 2.20 time: 2.431715 Oct 29 01:14:04.750042 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 108/215] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:14:02 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 25187 bytes in 2433 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:14:04.793457 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [req-86ea0ecd-2dcd-460d-9f72-52919acfa5fa req-1feb16da-5108-465d-a158-283377b6cb0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "176a8750-3a7e-4e6e-97b9-8394581d0ff3", "name": "network-vif-plugged", "status": "completed", "tag": "cadc346c-7128-4011-9c14-1ca218295b4e"}]} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:04.796942 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:14:04.796942 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: warnings.warn(msg) Oct 29 01:14:04.813129 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-86ea0ecd-2dcd-460d-9f72-52919acfa5fa req-1feb16da-5108-465d-a158-283377b6cb0e service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:04.813723 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-86ea0ecd-2dcd-460d-9f72-52919acfa5fa req-1feb16da-5108-465d-a158-283377b6cb0e service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:04.856105 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.compute.server_external_events [req-86ea0ecd-2dcd-460d-9f72-52919acfa5fa req-1feb16da-5108-465d-a158-283377b6cb0e service nova] Creating event network-vif-plugged:cadc346c-7128-4011-9c14-1ca218295b4e for instance 176a8750-3a7e-4e6e-97b9-8394581d0ff3 on hv-cinder-81558 Oct 29 01:14:04.862801 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [req-86ea0ecd-2dcd-460d-9f72-52919acfa5fa req-1feb16da-5108-465d-a158-283377b6cb0e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077036 Oct 29 01:14:04.863574 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 108/216] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:14:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:14:05.306691 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-138a1de0-5ea2-46e3-9f52-e4901e84883d tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:05.307871 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-138a1de0-5ea2-46e3-9f52-e4901e84883d tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:05.315507 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-138a1de0-5ea2-46e3-9f52-e4901e84883d tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:05.316254 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-138a1de0-5ea2-46e3-9f52-e4901e84883d tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:05.317263 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-138a1de0-5ea2-46e3-9f52-e4901e84883d tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:05.318606 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-138a1de0-5ea2-46e3-9f52-e4901e84883d tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:05.554357 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-7176fe14-1ca3-4872-aff5-9058a0937c67 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1473308321", "imageRef": "3fef3f0d-d772-4999-b764-d6690634a06d", "flavorRef": "452", "networks": [{"uuid": "609cf7b7-302a-452c-a833-83730f05081a"}]}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:05.561264 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-138a1de0-5ea2-46e3-9f52-e4901e84883d tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:05.571646 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-138a1de0-5ea2-46e3-9f52-e4901e84883d tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1554 microversion: 2.1 time: 0.269996 Oct 29 01:14:05.572501 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 109/217] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:05 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1554 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:05.619361 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.network.neutron [None req-7176fe14-1ca3-4872-aff5-9058a0937c67 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] validate_networks() for [('609cf7b7-302a-452c-a833-83730f05081a', None, None, None, None, None)] {{(pid=115748) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 01:14:05.671328 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-32493c46-4239-4a20-8958-99fb531f7592 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:05.671937 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-32493c46-4239-4a20-8958-99fb531f7592 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 176a8750-3a7e-4e6e-97b9-8394581d0ff3] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:05.686450 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-32493c46-4239-4a20-8958-99fb531f7592 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:05.688751 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-32493c46-4239-4a20-8958-99fb531f7592 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:05.692651 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-32493c46-4239-4a20-8958-99fb531f7592 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:05.693912 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-32493c46-4239-4a20-8958-99fb531f7592 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:05.997642 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-32493c46-4239-4a20-8958-99fb531f7592 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:06.008491 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-32493c46-4239-4a20-8958-99fb531f7592 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/176a8750-3a7e-4e6e-97b9-8394581d0ff3" status: 200 len: 1318 microversion: 2.1 time: 0.340888 Oct 29 01:14:06.009082 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 110/218] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:05 2021] GET /compute/v2.1/servers/176a8750-3a7e-4e6e-97b9-8394581d0ff3 => generated 1318 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:06.014655 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-5ab9e6ee-c7d7-4dc2-9a00-0ea519b54055 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:06.015579 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-5ab9e6ee-c7d7-4dc2-9a00-0ea519b54055 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:06.022712 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5ab9e6ee-c7d7-4dc2-9a00-0ea519b54055 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:06.023574 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5ab9e6ee-c7d7-4dc2-9a00-0ea519b54055 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:06.024523 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5ab9e6ee-c7d7-4dc2-9a00-0ea519b54055 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:06.025118 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5ab9e6ee-c7d7-4dc2-9a00-0ea519b54055 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:06.165932 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-5ab9e6ee-c7d7-4dc2-9a00-0ea519b54055 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 200 len: 26042 microversion: 2.20 time: 0.155628 Oct 29 01:14:06.166983 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 111/219] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:14:06 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 26042 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:14:06.189966 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.virt.hardware [None req-7176fe14-1ca3-4872-aff5-9058a0937c67 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Flavor limits 0:0:0 {{(pid=115748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:14:06.190444 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.virt.hardware [None req-7176fe14-1ca3-4872-aff5-9058a0937c67 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Image limits 0:0:0 {{(pid=115748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:14:06.190889 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.virt.hardware [None req-7176fe14-1ca3-4872-aff5-9058a0937c67 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Flavor pref 0:0:0 {{(pid=115748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:14:06.191287 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.virt.hardware [None req-7176fe14-1ca3-4872-aff5-9058a0937c67 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Image pref 0:0:0 {{(pid=115748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:14:06.191724 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.virt.hardware [None req-7176fe14-1ca3-4872-aff5-9058a0937c67 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:14:06.201624 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7176fe14-1ca3-4872-aff5-9058a0937c67 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:06.202074 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7176fe14-1ca3-4872-aff5-9058a0937c67 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:06.202985 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7176fe14-1ca3-4872-aff5-9058a0937c67 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:06.203785 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7176fe14-1ca3-4872-aff5-9058a0937c67 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:06.224634 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.quota [None req-7176fe14-1ca3-4872-aff5-9058a0937c67 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Getting quotas for project 31e4811f3ecf4ced9941eb882d5eb8ba. Resources: {'instances', 'cores', 'ram'} {{(pid=115748) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:14:06.230441 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.quota [None req-7176fe14-1ca3-4872-aff5-9058a0937c67 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Getting quotas for user c1dc700311c748ba8a56dc4e9e831889 and project 31e4811f3ecf4ced9941eb882d5eb8ba. Resources: {'instances', 'cores', 'ram'} {{(pid=115748) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:14:06.242712 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-7176fe14-1ca3-4872-aff5-9058a0937c67 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Going to run 1 instances... {{(pid=115748) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 01:14:06.245580 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-7176fe14-1ca3-4872-aff5-9058a0937c67 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] [instance: 59ea62ca-c11d-4654-8c28-7d2ef75c8aad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3fef3f0d-d772-4999-b764-d6690634a06d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 01:14:06.296199 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-7176fe14-1ca3-4872-aff5-9058a0937c67 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.746361 Oct 29 01:14:06.297302 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 109/220] 10.222.0.90 () {60 vars in 1146 bytes} [Fri Oct 29 01:14:05 2021] POST /compute/v2.1/servers => generated 380 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:14:06.308124 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-babf2f70-458c-4a7e-a84a-00d5ec63833b tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:06.309060 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-babf2f70-458c-4a7e-a84a-00d5ec63833b tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] [instance: 59ea62ca-c11d-4654-8c28-7d2ef75c8aad] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:06.370542 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-babf2f70-458c-4a7e-a84a-00d5ec63833b tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dc700311c748ba8a56dc4e9e831889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e4811f3ecf4ced9941eb882d5eb8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:06.377335 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-babf2f70-458c-4a7e-a84a-00d5ec63833b tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] 10.222.0.90 "GET /compute/v2.1/servers/59ea62ca-c11d-4654-8c28-7d2ef75c8aad" status: 200 len: 1214 microversion: 2.1 time: 0.073991 Oct 29 01:14:06.387848 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 112/221] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:06 2021] GET /compute/v2.1/servers/59ea62ca-c11d-4654-8c28-7d2ef75c8aad => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:06.591161 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d07ba2f2-f8f4-4736-ac67-935320cc742f tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:06.592973 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d07ba2f2-f8f4-4736-ac67-935320cc742f tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:06.603947 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d07ba2f2-f8f4-4736-ac67-935320cc742f tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:06.604834 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d07ba2f2-f8f4-4736-ac67-935320cc742f tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:06.605753 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d07ba2f2-f8f4-4736-ac67-935320cc742f tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:06.606563 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d07ba2f2-f8f4-4736-ac67-935320cc742f tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:06.823490 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-d07ba2f2-f8f4-4736-ac67-935320cc742f tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:06.839191 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d07ba2f2-f8f4-4736-ac67-935320cc742f tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1554 microversion: 2.1 time: 0.254013 Oct 29 01:14:06.839933 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 110/222] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:06 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1554 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:07.079388 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-3a06038b-520f-4bf3-85a4-12d3fb8eedd0 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:07.081201 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-3a06038b-520f-4bf3-85a4-12d3fb8eedd0 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 176a8750-3a7e-4e6e-97b9-8394581d0ff3] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:07.108435 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3a06038b-520f-4bf3-85a4-12d3fb8eedd0 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:07.108944 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3a06038b-520f-4bf3-85a4-12d3fb8eedd0 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:07.109746 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3a06038b-520f-4bf3-85a4-12d3fb8eedd0 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:07.110177 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3a06038b-520f-4bf3-85a4-12d3fb8eedd0 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:07.177165 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-fd018adf-840e-4dff-8c8b-1744ed4180ab tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:07.178155 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-fd018adf-840e-4dff-8c8b-1744ed4180ab tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:07.184860 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fd018adf-840e-4dff-8c8b-1744ed4180ab tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:07.185231 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fd018adf-840e-4dff-8c8b-1744ed4180ab tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:07.185997 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fd018adf-840e-4dff-8c8b-1744ed4180ab tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:07.186438 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fd018adf-840e-4dff-8c8b-1744ed4180ab tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:07.362132 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-fd018adf-840e-4dff-8c8b-1744ed4180ab tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 200 len: 26578 microversion: 2.20 time: 0.188484 Oct 29 01:14:07.365397 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 111/223] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:14:07 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 26578 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:14:07.369992 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-3a06038b-520f-4bf3-85a4-12d3fb8eedd0 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:07.377367 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-3a06038b-520f-4bf3-85a4-12d3fb8eedd0 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/176a8750-3a7e-4e6e-97b9-8394581d0ff3" status: 200 len: 1507 microversion: 2.1 time: 0.303657 Oct 29 01:14:07.377938 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 113/224] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:07 2021] GET /compute/v2.1/servers/176a8750-3a7e-4e6e-97b9-8394581d0ff3 => generated 1507 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:07.397826 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-140ab286-119f-4f06-9335-923600a3198c tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:07.399254 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-140ab286-119f-4f06-9335-923600a3198c tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] [instance: 59ea62ca-c11d-4654-8c28-7d2ef75c8aad] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:07.413806 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-0840f242-7d6f-483b-b32b-1ce663990ead tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d37affa9-55e4-4782-a10e-837f26aad84c"}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:07.416886 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-140ab286-119f-4f06-9335-923600a3198c tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:07.417611 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-140ab286-119f-4f06-9335-923600a3198c tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:07.420476 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-140ab286-119f-4f06-9335-923600a3198c tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:07.421149 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-140ab286-119f-4f06-9335-923600a3198c tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:07.422487 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-0840f242-7d6f-483b-b32b-1ce663990ead tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 176a8750-3a7e-4e6e-97b9-8394581d0ff3] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:07.438916 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0840f242-7d6f-483b-b32b-1ce663990ead tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:07.445527 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0840f242-7d6f-483b-b32b-1ce663990ead tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:07.446541 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0840f242-7d6f-483b-b32b-1ce663990ead tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:07.447104 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0840f242-7d6f-483b-b32b-1ce663990ead tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:07.537032 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-140ab286-119f-4f06-9335-923600a3198c tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dc700311c748ba8a56dc4e9e831889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e4811f3ecf4ced9941eb882d5eb8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:07.546741 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-140ab286-119f-4f06-9335-923600a3198c tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] 10.222.0.90 "GET /compute/v2.1/servers/59ea62ca-c11d-4654-8c28-7d2ef75c8aad" status: 200 len: 1266 microversion: 2.1 time: 0.153461 Oct 29 01:14:07.552145 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 112/225] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:07 2021] GET /compute/v2.1/servers/59ea62ca-c11d-4654-8c28-7d2ef75c8aad => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:07.577448 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.wsgi [None req-0840f242-7d6f-483b-b32b-1ce663990ead tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] HTTP exception thrown: Invalid volume: volume d37affa9-55e4-4782-a10e-837f26aad84c is already attached to instances: e789e569-3570-483f-8768-27b5be53c535 Oct 29 01:14:07.580307 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-0840f242-7d6f-483b-b32b-1ce663990ead tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Returning 400 to user: Invalid volume: volume d37affa9-55e4-4782-a10e-837f26aad84c is already attached to instances: e789e569-3570-483f-8768-27b5be53c535 {{(pid=115747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:14:07.584005 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-0840f242-7d6f-483b-b32b-1ce663990ead tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "POST /compute/v2.1/servers/176a8750-3a7e-4e6e-97b9-8394581d0ff3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.177783 Oct 29 01:14:07.584783 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 114/226] 10.222.0.90 () {60 vars in 1322 bytes} [Fri Oct 29 01:14:07 2021] POST /compute/v2.1/servers/176a8750-3a7e-4e6e-97b9-8394581d0ff3/os-volume_attachments => generated 174 bytes in 181 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:14:07.666721 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c4542bac-3625-495b-bed0-b6afbf482886 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:07.667790 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c4542bac-3625-495b-bed0-b6afbf482886 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:07.675241 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c4542bac-3625-495b-bed0-b6afbf482886 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:07.675910 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c4542bac-3625-495b-bed0-b6afbf482886 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:07.676831 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c4542bac-3625-495b-bed0-b6afbf482886 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:07.677394 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c4542bac-3625-495b-bed0-b6afbf482886 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:07.849076 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.objects.instance [None req-c4542bac-3625-495b-bed0-b6afbf482886 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lazy-loading 'services' on Instance uuid e789e569-3570-483f-8768-27b5be53c535 {{(pid=115748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:14:07.857007 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d45f3196-71d8-45d4-a10c-b89bd0e47980 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:07.858207 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d45f3196-71d8-45d4-a10c-b89bd0e47980 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:07.874462 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d45f3196-71d8-45d4-a10c-b89bd0e47980 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:07.875683 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d45f3196-71d8-45d4-a10c-b89bd0e47980 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:07.880071 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d45f3196-71d8-45d4-a10c-b89bd0e47980 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:07.880542 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d45f3196-71d8-45d4-a10c-b89bd0e47980 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:08.039501 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c4542bac-3625-495b-bed0-b6afbf482886 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "DELETE /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535/os-volume_attachments/d37affa9-55e4-4782-a10e-837f26aad84c" status: 202 len: 0 microversion: 2.1 time: 0.375943 Oct 29 01:14:08.042070 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 113/227] 10.222.0.90 () {58 vars in 1415 bytes} [Fri Oct 29 01:14:07 2021] DELETE /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535/os-volume_attachments/d37affa9-55e4-4782-a10e-837f26aad84c => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:14:08.064962 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-09c40dde-2403-4f2f-a48f-f8958da6414c tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:08.070020 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-09c40dde-2403-4f2f-a48f-f8958da6414c tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:08.082263 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-09c40dde-2403-4f2f-a48f-f8958da6414c tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:08.082633 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-09c40dde-2403-4f2f-a48f-f8958da6414c tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:08.083408 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-09c40dde-2403-4f2f-a48f-f8958da6414c tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:08.083836 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-09c40dde-2403-4f2f-a48f-f8958da6414c tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:08.156372 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-d45f3196-71d8-45d4-a10c-b89bd0e47980 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:08.172685 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d45f3196-71d8-45d4-a10c-b89bd0e47980 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1554 microversion: 2.1 time: 0.319362 Oct 29 01:14:08.173633 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 115/228] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:07 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1554 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:08.372970 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-1cebbde3-00ff-46cf-be92-33a610e9f045 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:08.373947 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-1cebbde3-00ff-46cf-be92-33a610e9f045 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:08.396572 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1cebbde3-00ff-46cf-be92-33a610e9f045 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:08.397018 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1cebbde3-00ff-46cf-be92-33a610e9f045 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:08.398364 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1cebbde3-00ff-46cf-be92-33a610e9f045 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:08.398818 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1cebbde3-00ff-46cf-be92-33a610e9f045 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:08.446481 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-09c40dde-2403-4f2f-a48f-f8958da6414c tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.398990 Oct 29 01:14:08.450242 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 114/229] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:14:08 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535/os-volume_attachments => generated 197 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:14:08.567106 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-25ce03a5-aaf4-4176-a4da-1821f6037851 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:08.567903 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-25ce03a5-aaf4-4176-a4da-1821f6037851 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] [instance: 59ea62ca-c11d-4654-8c28-7d2ef75c8aad] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:08.576222 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-25ce03a5-aaf4-4176-a4da-1821f6037851 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:08.577069 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-25ce03a5-aaf4-4176-a4da-1821f6037851 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:08.579427 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-25ce03a5-aaf4-4176-a4da-1821f6037851 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:08.580071 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-25ce03a5-aaf4-4176-a4da-1821f6037851 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:08.611627 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-1cebbde3-00ff-46cf-be92-33a610e9f045 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 200 len: 27046 microversion: 2.20 time: 0.236631 Oct 29 01:14:08.611627 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 116/230] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:14:08 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 27046 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:14:08.708996 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-25ce03a5-aaf4-4176-a4da-1821f6037851 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dc700311c748ba8a56dc4e9e831889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e4811f3ecf4ced9941eb882d5eb8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:08.718848 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-25ce03a5-aaf4-4176-a4da-1821f6037851 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] 10.222.0.90 "GET /compute/v2.1/servers/59ea62ca-c11d-4654-8c28-7d2ef75c8aad" status: 200 len: 1272 microversion: 2.1 time: 0.155737 Oct 29 01:14:08.720048 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 115/231] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:08 2021] GET /compute/v2.1/servers/59ea62ca-c11d-4654-8c28-7d2ef75c8aad => generated 1272 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:09.192240 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-79fab431-c2b4-4e26-b16c-02c14ce4c575 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:09.193148 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-79fab431-c2b4-4e26-b16c-02c14ce4c575 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:09.215584 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-79fab431-c2b4-4e26-b16c-02c14ce4c575 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:09.219539 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-79fab431-c2b4-4e26-b16c-02c14ce4c575 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:09.221598 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-79fab431-c2b4-4e26-b16c-02c14ce4c575 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:09.222486 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-79fab431-c2b4-4e26-b16c-02c14ce4c575 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:09.458476 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f04114e4-373c-487b-811f-41f01e9263e3 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:09.461282 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f04114e4-373c-487b-811f-41f01e9263e3 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:09.469760 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f04114e4-373c-487b-811f-41f01e9263e3 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:09.473277 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f04114e4-373c-487b-811f-41f01e9263e3 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:09.474319 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f04114e4-373c-487b-811f-41f01e9263e3 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:09.475014 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f04114e4-373c-487b-811f-41f01e9263e3 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:09.517249 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f04114e4-373c-487b-811f-41f01e9263e3 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063491 Oct 29 01:14:09.518157 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 116/232] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:14:09 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:14:09.531490 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-79fab431-c2b4-4e26-b16c-02c14ce4c575 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:09.540644 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-79fab431-c2b4-4e26-b16c-02c14ce4c575 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1554 microversion: 2.1 time: 0.352977 Oct 29 01:14:09.541214 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 117/233] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:09 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1554 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:09.620640 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f941cc3c-4b5e-4e89-9e9b-402529e547f4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:09.621560 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f941cc3c-4b5e-4e89-9e9b-402529e547f4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:09.633256 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f941cc3c-4b5e-4e89-9e9b-402529e547f4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:09.633690 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f941cc3c-4b5e-4e89-9e9b-402529e547f4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:09.640484 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f941cc3c-4b5e-4e89-9e9b-402529e547f4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:09.640930 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f941cc3c-4b5e-4e89-9e9b-402529e547f4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:09.736576 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-bb5c8f70-312c-4623-8ac6-5587066e8bed tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:09.737363 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-bb5c8f70-312c-4623-8ac6-5587066e8bed tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] [instance: 59ea62ca-c11d-4654-8c28-7d2ef75c8aad] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:09.745617 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bb5c8f70-312c-4623-8ac6-5587066e8bed tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:09.748119 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bb5c8f70-312c-4623-8ac6-5587066e8bed tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:09.750282 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bb5c8f70-312c-4623-8ac6-5587066e8bed tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:09.751199 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bb5c8f70-312c-4623-8ac6-5587066e8bed tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:09.817933 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f941cc3c-4b5e-4e89-9e9b-402529e547f4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 200 len: 27493 microversion: 2.20 time: 0.201448 Oct 29 01:14:09.819115 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 117/234] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:14:09 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 27493 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:14:10.065863 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [req-3f2c4131-80fc-4027-b00e-9ec7d6dfc5dc req-928c2585-4345-41aa-b178-421afa7028c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2870eb8-76a6-4941-91c1-c2c7bacc911a", "name": "network-vif-deleted", "tag": "ea450e77-a3c8-4eae-9e5f-25aa0f97a447"}]} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:10.068019 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:14:10.068019 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: warnings.warn(msg) Oct 29 01:14:10.081646 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-3f2c4131-80fc-4027-b00e-9ec7d6dfc5dc req-928c2585-4345-41aa-b178-421afa7028c0 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:10.082344 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-3f2c4131-80fc-4027-b00e-9ec7d6dfc5dc req-928c2585-4345-41aa-b178-421afa7028c0 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:10.097157 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.compute.server_external_events [req-3f2c4131-80fc-4027-b00e-9ec7d6dfc5dc req-928c2585-4345-41aa-b178-421afa7028c0 service nova] Creating event network-vif-deleted:ea450e77-a3c8-4eae-9e5f-25aa0f97a447 for instance b2870eb8-76a6-4941-91c1-c2c7bacc911a on hv-cinder-81558 Oct 29 01:14:10.103165 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [req-3f2c4131-80fc-4027-b00e-9ec7d6dfc5dc req-928c2585-4345-41aa-b178-421afa7028c0 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041948 Oct 29 01:14:10.104336 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 118/235] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:14:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:14:10.177414 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-bb5c8f70-312c-4623-8ac6-5587066e8bed tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dc700311c748ba8a56dc4e9e831889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e4811f3ecf4ced9941eb882d5eb8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:10.185751 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-bb5c8f70-312c-4623-8ac6-5587066e8bed tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] 10.222.0.90 "GET /compute/v2.1/servers/59ea62ca-c11d-4654-8c28-7d2ef75c8aad" status: 200 len: 1314 microversion: 2.1 time: 0.454061 Oct 29 01:14:10.186318 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 118/236] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:09 2021] GET /compute/v2.1/servers/59ea62ca-c11d-4654-8c28-7d2ef75c8aad => generated 1314 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:10.459921 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [req-c2384d73-c8fd-438c-9084-a9679ccd77ef req-75f748a3-2023-457b-b924-6520376a6a1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59ea62ca-c11d-4654-8c28-7d2ef75c8aad", "tag": "472efa8c-8ad6-47a0-905d-d577af9411cf"}]} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:10.461632 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:14:10.461632 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: warnings.warn(msg) Oct 29 01:14:10.489064 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-c2384d73-c8fd-438c-9084-a9679ccd77ef req-75f748a3-2023-457b-b924-6520376a6a1f service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:10.489503 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-c2384d73-c8fd-438c-9084-a9679ccd77ef req-75f748a3-2023-457b-b924-6520376a6a1f service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:10.500700 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.compute.server_external_events [req-c2384d73-c8fd-438c-9084-a9679ccd77ef req-75f748a3-2023-457b-b924-6520376a6a1f service nova] Creating event network-changed:472efa8c-8ad6-47a0-905d-d577af9411cf for instance 59ea62ca-c11d-4654-8c28-7d2ef75c8aad on hv-cinder-81558 Oct 29 01:14:10.505989 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [req-c2384d73-c8fd-438c-9084-a9679ccd77ef req-75f748a3-2023-457b-b924-6520376a6a1f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049697 Oct 29 01:14:10.507240 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 119/237] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:14:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:14:10.533001 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9a3a2bc9-93ac-4af2-92df-f045355c2fc1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:10.534872 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9a3a2bc9-93ac-4af2-92df-f045355c2fc1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:10.541755 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9a3a2bc9-93ac-4af2-92df-f045355c2fc1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:10.542290 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9a3a2bc9-93ac-4af2-92df-f045355c2fc1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:10.543155 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9a3a2bc9-93ac-4af2-92df-f045355c2fc1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:10.543657 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9a3a2bc9-93ac-4af2-92df-f045355c2fc1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:10.560108 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f1c141da-e907-4097-865c-f293592604a7 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:10.561514 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f1c141da-e907-4097-865c-f293592604a7 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:10.573059 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f1c141da-e907-4097-865c-f293592604a7 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:10.573892 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f1c141da-e907-4097-865c-f293592604a7 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:10.575249 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f1c141da-e907-4097-865c-f293592604a7 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:10.576218 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f1c141da-e907-4097-865c-f293592604a7 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:10.578529 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9a3a2bc9-93ac-4af2-92df-f045355c2fc1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049180 Oct 29 01:14:10.579738 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 119/238] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:14:10 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:14:10.649701 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-f1c141da-e907-4097-865c-f293592604a7 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b56d6242f2f476583fc644ba9be1e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e81ffa504e64cd6801102af6c5c22fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:10.658747 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f1c141da-e907-4097-865c-f293592604a7 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 200 len: 1346 microversion: 2.1 time: 0.104780 Oct 29 01:14:10.659997 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 120/239] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:10 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 1346 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:10.787012 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-499cc767-97fa-4577-811f-a2206758f02e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-11822418", "imageRef": "3fef3f0d-d772-4999-b764-d6690634a06d", "flavorRef": "452", "networks": [{"uuid": "04819660-923b-4a69-94a5-8390cbffb752"}]}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:10.830418 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-54d55181-6356-4685-b1c4-251f5958af09 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:10.832819 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-54d55181-6356-4685-b1c4-251f5958af09 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:10.839513 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-54d55181-6356-4685-b1c4-251f5958af09 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:10.840654 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-54d55181-6356-4685-b1c4-251f5958af09 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:10.841628 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-54d55181-6356-4685-b1c4-251f5958af09 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:10.842254 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-54d55181-6356-4685-b1c4-251f5958af09 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:10.870731 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.network.neutron [None req-499cc767-97fa-4577-811f-a2206758f02e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] validate_networks() for [('04819660-923b-4a69-94a5-8390cbffb752', None, None, None, None, None)] {{(pid=115747) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 01:14:10.978085 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-54d55181-6356-4685-b1c4-251f5958af09 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 200 len: 27738 microversion: 2.20 time: 0.151377 Oct 29 01:14:10.982532 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 121/240] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:14:10 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 27738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:14:11.204179 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-dd95e2ce-47a0-4f17-ace7-157d9207e606 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:11.205149 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-dd95e2ce-47a0-4f17-ace7-157d9207e606 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] [instance: 59ea62ca-c11d-4654-8c28-7d2ef75c8aad] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:11.219655 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dd95e2ce-47a0-4f17-ace7-157d9207e606 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:11.221040 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dd95e2ce-47a0-4f17-ace7-157d9207e606 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:11.221991 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dd95e2ce-47a0-4f17-ace7-157d9207e606 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:11.222445 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dd95e2ce-47a0-4f17-ace7-157d9207e606 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:11.797272 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-dd95e2ce-47a0-4f17-ace7-157d9207e606 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dc700311c748ba8a56dc4e9e831889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e4811f3ecf4ced9941eb882d5eb8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:11.805136 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-dd95e2ce-47a0-4f17-ace7-157d9207e606 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] 10.222.0.90 "GET /compute/v2.1/servers/59ea62ca-c11d-4654-8c28-7d2ef75c8aad" status: 200 len: 1314 microversion: 2.1 time: 0.606106 Oct 29 01:14:11.805777 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 122/241] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:11 2021] GET /compute/v2.1/servers/59ea62ca-c11d-4654-8c28-7d2ef75c8aad => generated 1314 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:11.810235 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-1a1e3320-e5ff-4e00-99f0-4f7fb5827de8 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:11.811047 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-1a1e3320-e5ff-4e00-99f0-4f7fb5827de8 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:11.816505 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1a1e3320-e5ff-4e00-99f0-4f7fb5827de8 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:11.817040 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1a1e3320-e5ff-4e00-99f0-4f7fb5827de8 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:11.817867 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1a1e3320-e5ff-4e00-99f0-4f7fb5827de8 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:11.818366 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1a1e3320-e5ff-4e00-99f0-4f7fb5827de8 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:11.833764 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.wsgi [None req-1a1e3320-e5ff-4e00-99f0-4f7fb5827de8 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] HTTP exception thrown: Instance b2870eb8-76a6-4941-91c1-c2c7bacc911a could not be found. Oct 29 01:14:11.834432 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-1a1e3320-e5ff-4e00-99f0-4f7fb5827de8 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Returning 404 to user: Instance b2870eb8-76a6-4941-91c1-c2c7bacc911a could not be found. {{(pid=115748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:14:11.835216 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-1a1e3320-e5ff-4e00-99f0-4f7fb5827de8 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 404 len: 111 microversion: 2.1 time: 0.028360 Oct 29 01:14:11.835760 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 123/242] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:11 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:14:11.848791 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-499cc767-97fa-4577-811f-a2206758f02e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Flavor limits 0:0:0 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:14:11.849232 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-499cc767-97fa-4577-811f-a2206758f02e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Image limits 0:0:0 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:14:11.849655 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-499cc767-97fa-4577-811f-a2206758f02e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Flavor pref 0:0:0 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:14:11.850053 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-499cc767-97fa-4577-811f-a2206758f02e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Image pref 0:0:0 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:14:11.850491 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-499cc767-97fa-4577-811f-a2206758f02e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:14:11.859156 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-499cc767-97fa-4577-811f-a2206758f02e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:11.859597 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-499cc767-97fa-4577-811f-a2206758f02e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:11.860559 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-499cc767-97fa-4577-811f-a2206758f02e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:11.860993 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-499cc767-97fa-4577-811f-a2206758f02e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:11.878026 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.quota [None req-499cc767-97fa-4577-811f-a2206758f02e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Getting quotas for project 355f0948092d4f3c929575a405284599. Resources: {'instances', 'cores', 'ram'} {{(pid=115747) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:14:11.882578 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.quota [None req-499cc767-97fa-4577-811f-a2206758f02e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Getting quotas for user 8fe86a50674f4837bfcb81170f5fd253 and project 355f0948092d4f3c929575a405284599. Resources: {'instances', 'cores', 'ram'} {{(pid=115747) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:14:11.893493 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-499cc767-97fa-4577-811f-a2206758f02e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Going to run 1 instances... {{(pid=115747) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 01:14:11.895830 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-499cc767-97fa-4577-811f-a2206758f02e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: d5eacee8-861b-453e-bdec-260c354bc942] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3fef3f0d-d772-4999-b764-d6690634a06d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 01:14:11.936238 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-6f8cc45f-3194-4e02-a556-963bce454bb4 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:11.937145 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-6f8cc45f-3194-4e02-a556-963bce454bb4 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:11.945090 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-499cc767-97fa-4577-811f-a2206758f02e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.161101 Oct 29 01:14:11.945901 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 120/243] 10.222.0.90 () {60 vars in 1146 bytes} [Fri Oct 29 01:14:10 2021] POST /compute/v2.1/servers => generated 380 bytes in 1163 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:14:11.959947 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6f8cc45f-3194-4e02-a556-963bce454bb4 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:11.960398 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6f8cc45f-3194-4e02-a556-963bce454bb4 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:11.963425 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f37843b9-d240-4179-8a0b-1b7be08ee5ca tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:11.963588 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6f8cc45f-3194-4e02-a556-963bce454bb4 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:11.964331 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f37843b9-d240-4179-8a0b-1b7be08ee5ca tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: d5eacee8-861b-453e-bdec-260c354bc942] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:11.965064 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6f8cc45f-3194-4e02-a556-963bce454bb4 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:11.984720 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.wsgi [None req-6f8cc45f-3194-4e02-a556-963bce454bb4 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] HTTP exception thrown: Instance b2870eb8-76a6-4941-91c1-c2c7bacc911a could not be found. Oct 29 01:14:11.985554 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-6f8cc45f-3194-4e02-a556-963bce454bb4 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Returning 404 to user: Instance b2870eb8-76a6-4941-91c1-c2c7bacc911a could not be found. {{(pid=115748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:14:11.986412 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-6f8cc45f-3194-4e02-a556-963bce454bb4 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.054011 Oct 29 01:14:11.986973 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 124/244] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:14:11 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a/os-volume_attachments => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:14:11.993097 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-be990ff5-5a47-46f0-8406-bce186ca61b9 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:11.994335 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-be990ff5-5a47-46f0-8406-bce186ca61b9 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:12.020778 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-be990ff5-5a47-46f0-8406-bce186ca61b9 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:12.021240 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-be990ff5-5a47-46f0-8406-bce186ca61b9 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:12.022025 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-be990ff5-5a47-46f0-8406-bce186ca61b9 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:12.022542 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-be990ff5-5a47-46f0-8406-bce186ca61b9 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:12.064757 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-f37843b9-d240-4179-8a0b-1b7be08ee5ca tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:12.072944 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f37843b9-d240-4179-8a0b-1b7be08ee5ca tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/d5eacee8-861b-453e-bdec-260c354bc942" status: 200 len: 1216 microversion: 2.1 time: 0.120781 Oct 29 01:14:12.073678 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 121/245] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:11 2021] GET /compute/v2.1/servers/d5eacee8-861b-453e-bdec-260c354bc942 => generated 1216 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:12.206408 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-be990ff5-5a47-46f0-8406-bce186ca61b9 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 200 len: 27845 microversion: 2.20 time: 0.218046 Oct 29 01:14:12.207290 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 125/246] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:14:11 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 27845 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:14:12.820677 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-90b34400-5faa-42ff-9fcd-ad88afbf570b tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:12.821281 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-90b34400-5faa-42ff-9fcd-ad88afbf570b tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] [instance: 59ea62ca-c11d-4654-8c28-7d2ef75c8aad] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:12.827782 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-90b34400-5faa-42ff-9fcd-ad88afbf570b tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:12.828225 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-90b34400-5faa-42ff-9fcd-ad88afbf570b tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:12.829008 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-90b34400-5faa-42ff-9fcd-ad88afbf570b tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:12.829476 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-90b34400-5faa-42ff-9fcd-ad88afbf570b tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:12.949217 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-90b34400-5faa-42ff-9fcd-ad88afbf570b tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dc700311c748ba8a56dc4e9e831889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e4811f3ecf4ced9941eb882d5eb8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:12.956500 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-90b34400-5faa-42ff-9fcd-ad88afbf570b tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] 10.222.0.90 "GET /compute/v2.1/servers/59ea62ca-c11d-4654-8c28-7d2ef75c8aad" status: 200 len: 1314 microversion: 2.1 time: 0.139516 Oct 29 01:14:12.957069 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 122/247] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:12 2021] GET /compute/v2.1/servers/59ea62ca-c11d-4654-8c28-7d2ef75c8aad => generated 1314 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:13.090110 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-a26ea9d1-11e5-4122-a579-94ff2af4bd40 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:13.090886 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-a26ea9d1-11e5-4122-a579-94ff2af4bd40 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: d5eacee8-861b-453e-bdec-260c354bc942] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:13.098088 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a26ea9d1-11e5-4122-a579-94ff2af4bd40 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:13.098573 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a26ea9d1-11e5-4122-a579-94ff2af4bd40 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:13.099340 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a26ea9d1-11e5-4122-a579-94ff2af4bd40 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:13.099773 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a26ea9d1-11e5-4122-a579-94ff2af4bd40 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:13.160173 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-a26ea9d1-11e5-4122-a579-94ff2af4bd40 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:13.167787 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-a26ea9d1-11e5-4122-a579-94ff2af4bd40 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/d5eacee8-861b-453e-bdec-260c354bc942" status: 200 len: 1268 microversion: 2.1 time: 0.082137 Oct 29 01:14:13.168334 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 126/248] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:13 2021] GET /compute/v2.1/servers/d5eacee8-861b-453e-bdec-260c354bc942 => generated 1268 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:13.218586 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ac0a0ce1-957f-4716-b236-2a55cec86eb2 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:13.219579 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ac0a0ce1-957f-4716-b236-2a55cec86eb2 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:13.225494 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ac0a0ce1-957f-4716-b236-2a55cec86eb2 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:13.225940 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ac0a0ce1-957f-4716-b236-2a55cec86eb2 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:13.226717 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ac0a0ce1-957f-4716-b236-2a55cec86eb2 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:13.227147 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ac0a0ce1-957f-4716-b236-2a55cec86eb2 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:13.414055 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ac0a0ce1-957f-4716-b236-2a55cec86eb2 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 200 len: 27989 microversion: 2.20 time: 0.198758 Oct 29 01:14:13.414903 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 123/249] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:14:13 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 27989 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:14:13.974336 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-b08b2b26-affe-4038-a642-a792020fbe6c tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:13.975205 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-b08b2b26-affe-4038-a642-a792020fbe6c tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] [instance: 59ea62ca-c11d-4654-8c28-7d2ef75c8aad] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:13.982974 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b08b2b26-affe-4038-a642-a792020fbe6c tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:13.984405 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b08b2b26-affe-4038-a642-a792020fbe6c tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:13.986839 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b08b2b26-affe-4038-a642-a792020fbe6c tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:13.987558 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b08b2b26-affe-4038-a642-a792020fbe6c tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:14.206921 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-dde76898-185c-4348-9af7-7035b34cc18d tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:14.208229 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-dde76898-185c-4348-9af7-7035b34cc18d tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: d5eacee8-861b-453e-bdec-260c354bc942] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:14.220910 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dde76898-185c-4348-9af7-7035b34cc18d tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:14.222014 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dde76898-185c-4348-9af7-7035b34cc18d tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:14.225291 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dde76898-185c-4348-9af7-7035b34cc18d tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:14.226362 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dde76898-185c-4348-9af7-7035b34cc18d tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:14.300520 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-b08b2b26-affe-4038-a642-a792020fbe6c tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dc700311c748ba8a56dc4e9e831889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e4811f3ecf4ced9941eb882d5eb8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:14.309100 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-b08b2b26-affe-4038-a642-a792020fbe6c tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] 10.222.0.90 "GET /compute/v2.1/servers/59ea62ca-c11d-4654-8c28-7d2ef75c8aad" status: 200 len: 1314 microversion: 2.1 time: 0.338730 Oct 29 01:14:14.310460 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 127/250] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:13 2021] GET /compute/v2.1/servers/59ea62ca-c11d-4654-8c28-7d2ef75c8aad => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:14.318926 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e0ef3209-533b-419f-99ee-548c7b045fb4 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:14.320127 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-e0ef3209-533b-419f-99ee-548c7b045fb4 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:14.326267 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e0ef3209-533b-419f-99ee-548c7b045fb4 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:14.327072 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e0ef3209-533b-419f-99ee-548c7b045fb4 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:14.327755 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e0ef3209-533b-419f-99ee-548c7b045fb4 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:14.328290 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e0ef3209-533b-419f-99ee-548c7b045fb4 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:14.342833 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.wsgi [None req-e0ef3209-533b-419f-99ee-548c7b045fb4 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] HTTP exception thrown: Instance b2870eb8-76a6-4941-91c1-c2c7bacc911a could not be found. Oct 29 01:14:14.343582 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e0ef3209-533b-419f-99ee-548c7b045fb4 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Returning 404 to user: Instance b2870eb8-76a6-4941-91c1-c2c7bacc911a could not be found. {{(pid=115748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:14:14.344634 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-e0ef3209-533b-419f-99ee-548c7b045fb4 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "DELETE /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 404 len: 111 microversion: 2.1 time: 0.033047 Oct 29 01:14:14.345432 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 128/251] 10.222.0.90 () {58 vars in 1238 bytes} [Fri Oct 29 01:14:14 2021] DELETE /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:14:14.354522 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-77831ce7-a50c-4e68-ad6e-aea09fce0320 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:14.355360 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-77831ce7-a50c-4e68-ad6e-aea09fce0320 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] [instance: b2870eb8-76a6-4941-91c1-c2c7bacc911a] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:14.362267 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-77831ce7-a50c-4e68-ad6e-aea09fce0320 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:14.362882 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-77831ce7-a50c-4e68-ad6e-aea09fce0320 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:14.363757 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-77831ce7-a50c-4e68-ad6e-aea09fce0320 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:14.364439 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-77831ce7-a50c-4e68-ad6e-aea09fce0320 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:14.381398 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.wsgi [None req-77831ce7-a50c-4e68-ad6e-aea09fce0320 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] HTTP exception thrown: Instance b2870eb8-76a6-4941-91c1-c2c7bacc911a could not be found. Oct 29 01:14:14.382061 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-77831ce7-a50c-4e68-ad6e-aea09fce0320 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] Returning 404 to user: Instance b2870eb8-76a6-4941-91c1-c2c7bacc911a could not be found. {{(pid=115748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:14:14.383037 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-77831ce7-a50c-4e68-ad6e-aea09fce0320 tempest-DeleteServersTestJSON-1048114778 tempest-DeleteServersTestJSON-1048114778-project] 10.222.0.90 "GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a" status: 404 len: 111 microversion: 2.1 time: 0.033015 Oct 29 01:14:14.383724 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 129/252] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:14 2021] GET /compute/v2.1/servers/b2870eb8-76a6-4941-91c1-c2c7bacc911a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:14:14.428796 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f3badaf6-5925-41ef-b9b2-6f7170619e48 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:14.430509 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f3badaf6-5925-41ef-b9b2-6f7170619e48 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:14.440721 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f3badaf6-5925-41ef-b9b2-6f7170619e48 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:14.441532 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f3badaf6-5925-41ef-b9b2-6f7170619e48 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:14.442566 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f3badaf6-5925-41ef-b9b2-6f7170619e48 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:14.444088 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f3badaf6-5925-41ef-b9b2-6f7170619e48 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:14.539807 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-dde76898-185c-4348-9af7-7035b34cc18d tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:14.548414 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-dde76898-185c-4348-9af7-7035b34cc18d tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/d5eacee8-861b-453e-bdec-260c354bc942" status: 200 len: 1316 microversion: 2.1 time: 0.365876 Oct 29 01:14:14.556300 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 124/253] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:14 2021] GET /compute/v2.1/servers/d5eacee8-861b-453e-bdec-260c354bc942 => generated 1316 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:14.584528 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f3badaf6-5925-41ef-b9b2-6f7170619e48 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 200 len: 28158 microversion: 2.20 time: 0.160106 Oct 29 01:14:14.585580 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 130/254] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:14:14 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 28158 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:14:14.889387 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [req-6557396f-be34-44b4-8fbc-481093889e34 req-f9d38f8a-7f41-4c36-af0c-7d53d8341c14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5eacee8-861b-453e-bdec-260c354bc942", "tag": "5945ae54-9c50-4ec7-9b83-6f66146a5c21"}]} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:14.890962 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:14:14.890962 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: warnings.warn(msg) Oct 29 01:14:14.899444 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-6557396f-be34-44b4-8fbc-481093889e34 req-f9d38f8a-7f41-4c36-af0c-7d53d8341c14 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:14.899809 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-6557396f-be34-44b4-8fbc-481093889e34 req-f9d38f8a-7f41-4c36-af0c-7d53d8341c14 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:14.918371 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.compute.server_external_events [req-6557396f-be34-44b4-8fbc-481093889e34 req-f9d38f8a-7f41-4c36-af0c-7d53d8341c14 service nova] Creating event network-changed:5945ae54-9c50-4ec7-9b83-6f66146a5c21 for instance d5eacee8-861b-453e-bdec-260c354bc942 on hv-cinder-81558 Oct 29 01:14:14.923402 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [req-6557396f-be34-44b4-8fbc-481093889e34 req-f9d38f8a-7f41-4c36-af0c-7d53d8341c14 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037705 Oct 29 01:14:14.923926 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 125/255] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:14:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:14:15.328799 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-7e863074-a96f-4016-9291-61678ce6d467 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:15.330071 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-7e863074-a96f-4016-9291-61678ce6d467 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] [instance: 59ea62ca-c11d-4654-8c28-7d2ef75c8aad] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:15.344146 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7e863074-a96f-4016-9291-61678ce6d467 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:15.345048 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7e863074-a96f-4016-9291-61678ce6d467 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:15.345873 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7e863074-a96f-4016-9291-61678ce6d467 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:15.346314 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7e863074-a96f-4016-9291-61678ce6d467 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:15.568639 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-18c7cce1-ea7f-4c99-b245-270b372edcd1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:15.570156 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-18c7cce1-ea7f-4c99-b245-270b372edcd1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: d5eacee8-861b-453e-bdec-260c354bc942] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:15.585357 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-18c7cce1-ea7f-4c99-b245-270b372edcd1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:15.586054 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-18c7cce1-ea7f-4c99-b245-270b372edcd1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:15.586899 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-18c7cce1-ea7f-4c99-b245-270b372edcd1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:15.588259 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-18c7cce1-ea7f-4c99-b245-270b372edcd1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:15.627677 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-7e863074-a96f-4016-9291-61678ce6d467 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dc700311c748ba8a56dc4e9e831889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e4811f3ecf4ced9941eb882d5eb8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:15.641541 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-7e863074-a96f-4016-9291-61678ce6d467 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] 10.222.0.90 "GET /compute/v2.1/servers/59ea62ca-c11d-4654-8c28-7d2ef75c8aad" status: 200 len: 1314 microversion: 2.1 time: 0.317651 Oct 29 01:14:15.642493 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 131/256] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:15 2021] GET /compute/v2.1/servers/59ea62ca-c11d-4654-8c28-7d2ef75c8aad => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:15.656325 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-ca4b3df1-3435-4a0a-b7c6-f9ccce2b9666 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:15.658440 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-ca4b3df1-3435-4a0a-b7c6-f9ccce2b9666 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:15.665815 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ca4b3df1-3435-4a0a-b7c6-f9ccce2b9666 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:15.666620 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ca4b3df1-3435-4a0a-b7c6-f9ccce2b9666 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:15.667438 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ca4b3df1-3435-4a0a-b7c6-f9ccce2b9666 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:15.667879 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ca4b3df1-3435-4a0a-b7c6-f9ccce2b9666 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:15.837695 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-ca4b3df1-3435-4a0a-b7c6-f9ccce2b9666 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 200 len: 28158 microversion: 2.20 time: 0.192775 Oct 29 01:14:15.839566 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 132/257] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:14:15 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 28158 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:14:15.854143 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-18c7cce1-ea7f-4c99-b245-270b372edcd1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:15.865090 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-18c7cce1-ea7f-4c99-b245-270b372edcd1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/d5eacee8-861b-453e-bdec-260c354bc942" status: 200 len: 1316 microversion: 2.1 time: 0.302138 Oct 29 01:14:15.876022 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 126/258] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:15 2021] GET /compute/v2.1/servers/d5eacee8-861b-453e-bdec-260c354bc942 => generated 1316 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:16.659720 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-8af15c4c-1ed5-4cd7-98f2-7b87c2b07ea4 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:16.660505 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-8af15c4c-1ed5-4cd7-98f2-7b87c2b07ea4 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] [instance: 59ea62ca-c11d-4654-8c28-7d2ef75c8aad] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:16.670442 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8af15c4c-1ed5-4cd7-98f2-7b87c2b07ea4 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:16.671141 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8af15c4c-1ed5-4cd7-98f2-7b87c2b07ea4 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:16.672132 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8af15c4c-1ed5-4cd7-98f2-7b87c2b07ea4 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:16.672626 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8af15c4c-1ed5-4cd7-98f2-7b87c2b07ea4 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:16.822142 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-8af15c4c-1ed5-4cd7-98f2-7b87c2b07ea4 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dc700311c748ba8a56dc4e9e831889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e4811f3ecf4ced9941eb882d5eb8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:16.831101 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-8af15c4c-1ed5-4cd7-98f2-7b87c2b07ea4 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] 10.222.0.90 "GET /compute/v2.1/servers/59ea62ca-c11d-4654-8c28-7d2ef75c8aad" status: 200 len: 1314 microversion: 2.1 time: 0.175717 Oct 29 01:14:16.831746 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 133/259] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:16 2021] GET /compute/v2.1/servers/59ea62ca-c11d-4654-8c28-7d2ef75c8aad => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:16.850820 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-bf05d7a8-80c6-45c3-8e77-225da70cc5cc tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:16.851729 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-bf05d7a8-80c6-45c3-8e77-225da70cc5cc tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:16.858516 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bf05d7a8-80c6-45c3-8e77-225da70cc5cc tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:16.859014 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bf05d7a8-80c6-45c3-8e77-225da70cc5cc tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:16.859696 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bf05d7a8-80c6-45c3-8e77-225da70cc5cc tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:16.860376 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bf05d7a8-80c6-45c3-8e77-225da70cc5cc tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:16.882762 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2c87b728-8fa7-4560-a75a-20004c1ddcfb tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:16.883774 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2c87b728-8fa7-4560-a75a-20004c1ddcfb tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: d5eacee8-861b-453e-bdec-260c354bc942] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:16.890003 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2c87b728-8fa7-4560-a75a-20004c1ddcfb tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:16.890467 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2c87b728-8fa7-4560-a75a-20004c1ddcfb tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:16.891487 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2c87b728-8fa7-4560-a75a-20004c1ddcfb tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:16.892062 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2c87b728-8fa7-4560-a75a-20004c1ddcfb tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:16.980260 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-bf05d7a8-80c6-45c3-8e77-225da70cc5cc tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 200 len: 28286 microversion: 2.20 time: 0.134367 Oct 29 01:14:16.981030 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 127/260] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:14:16 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 28286 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:14:17.086506 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-2c87b728-8fa7-4560-a75a-20004c1ddcfb tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:17.096910 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2c87b728-8fa7-4560-a75a-20004c1ddcfb tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/d5eacee8-861b-453e-bdec-260c354bc942" status: 200 len: 1316 microversion: 2.1 time: 0.218693 Oct 29 01:14:17.097499 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 134/261] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:16 2021] GET /compute/v2.1/servers/d5eacee8-861b-453e-bdec-260c354bc942 => generated 1316 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:17.551446 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [req-6851c90f-9f92-42c0-b2bf-2c0ec3ebc8aa req-e08c56ff-e67c-4389-9a6e-33576c0fc193 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59ea62ca-c11d-4654-8c28-7d2ef75c8aad", "name": "network-vif-plugged", "status": "completed", "tag": "472efa8c-8ad6-47a0-905d-d577af9411cf"}]} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:17.554218 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:14:17.554218 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: warnings.warn(msg) Oct 29 01:14:17.565996 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-6851c90f-9f92-42c0-b2bf-2c0ec3ebc8aa req-e08c56ff-e67c-4389-9a6e-33576c0fc193 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:17.567657 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-6851c90f-9f92-42c0-b2bf-2c0ec3ebc8aa req-e08c56ff-e67c-4389-9a6e-33576c0fc193 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:17.581859 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.compute.server_external_events [req-6851c90f-9f92-42c0-b2bf-2c0ec3ebc8aa req-e08c56ff-e67c-4389-9a6e-33576c0fc193 service nova] Creating event network-vif-plugged:472efa8c-8ad6-47a0-905d-d577af9411cf for instance 59ea62ca-c11d-4654-8c28-7d2ef75c8aad on hv-cinder-81558 Oct 29 01:14:17.589942 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [req-6851c90f-9f92-42c0-b2bf-2c0ec3ebc8aa req-e08c56ff-e67c-4389-9a6e-33576c0fc193 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044599 Oct 29 01:14:17.591334 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 128/262] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:14:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:14:17.848342 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-a74b295e-43b4-4835-9f69-67f698192b4c tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:17.850883 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-a74b295e-43b4-4835-9f69-67f698192b4c tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] [instance: 59ea62ca-c11d-4654-8c28-7d2ef75c8aad] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:17.859127 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a74b295e-43b4-4835-9f69-67f698192b4c tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:17.859758 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a74b295e-43b4-4835-9f69-67f698192b4c tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:17.860776 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a74b295e-43b4-4835-9f69-67f698192b4c tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:17.861383 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a74b295e-43b4-4835-9f69-67f698192b4c tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:17.994753 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c8037381-9f2a-434c-a47a-9d1e3e7098c7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:17.996725 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c8037381-9f2a-434c-a47a-9d1e3e7098c7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:18.011649 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c8037381-9f2a-434c-a47a-9d1e3e7098c7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:18.013995 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c8037381-9f2a-434c-a47a-9d1e3e7098c7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:18.016467 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c8037381-9f2a-434c-a47a-9d1e3e7098c7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:18.017701 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c8037381-9f2a-434c-a47a-9d1e3e7098c7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:18.138236 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c8037381-9f2a-434c-a47a-9d1e3e7098c7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 200 len: 28448 microversion: 2.20 time: 0.147762 Oct 29 01:14:18.142052 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 129/263] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:14:17 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 28448 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:14:18.147944 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-62bf7597-eb77-414e-b3ff-ebc3839999bb tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:18.149012 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-62bf7597-eb77-414e-b3ff-ebc3839999bb tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: d5eacee8-861b-453e-bdec-260c354bc942] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:18.156390 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-62bf7597-eb77-414e-b3ff-ebc3839999bb tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:18.157085 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-62bf7597-eb77-414e-b3ff-ebc3839999bb tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:18.158729 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-62bf7597-eb77-414e-b3ff-ebc3839999bb tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:18.159454 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-62bf7597-eb77-414e-b3ff-ebc3839999bb tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:18.449957 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-a74b295e-43b4-4835-9f69-67f698192b4c tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dc700311c748ba8a56dc4e9e831889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e4811f3ecf4ced9941eb882d5eb8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:18.457292 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-a74b295e-43b4-4835-9f69-67f698192b4c tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] 10.222.0.90 "GET /compute/v2.1/servers/59ea62ca-c11d-4654-8c28-7d2ef75c8aad" status: 200 len: 1314 microversion: 2.1 time: 0.613050 Oct 29 01:14:18.458054 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 135/264] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:17 2021] GET /compute/v2.1/servers/59ea62ca-c11d-4654-8c28-7d2ef75c8aad => generated 1314 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:18.475920 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-62bf7597-eb77-414e-b3ff-ebc3839999bb tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:18.484415 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-62bf7597-eb77-414e-b3ff-ebc3839999bb tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/d5eacee8-861b-453e-bdec-260c354bc942" status: 200 len: 1316 microversion: 2.1 time: 0.340788 Oct 29 01:14:18.498150 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 130/265] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:18 2021] GET /compute/v2.1/servers/d5eacee8-861b-453e-bdec-260c354bc942 => generated 1316 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:19.152445 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-384c5944-5b04-4f69-9982-7dbf6fdc3610 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:19.153592 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-384c5944-5b04-4f69-9982-7dbf6fdc3610 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:19.160096 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-384c5944-5b04-4f69-9982-7dbf6fdc3610 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:19.160670 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-384c5944-5b04-4f69-9982-7dbf6fdc3610 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:19.161573 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-384c5944-5b04-4f69-9982-7dbf6fdc3610 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:19.162108 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-384c5944-5b04-4f69-9982-7dbf6fdc3610 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:19.311202 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-384c5944-5b04-4f69-9982-7dbf6fdc3610 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 200 len: 28616 microversion: 2.20 time: 0.162417 Oct 29 01:14:19.311921 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 136/266] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:14:19 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 28616 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:14:19.476122 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d4916587-7506-4ce0-ac2d-55b5ba4a3761 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:19.476898 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d4916587-7506-4ce0-ac2d-55b5ba4a3761 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] [instance: 59ea62ca-c11d-4654-8c28-7d2ef75c8aad] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:19.485207 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d4916587-7506-4ce0-ac2d-55b5ba4a3761 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:19.485856 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d4916587-7506-4ce0-ac2d-55b5ba4a3761 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:19.487490 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d4916587-7506-4ce0-ac2d-55b5ba4a3761 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:19.488080 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d4916587-7506-4ce0-ac2d-55b5ba4a3761 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:19.515163 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-17aa2049-bb9e-48a1-8bb9-739e1f7025be tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:19.515970 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-17aa2049-bb9e-48a1-8bb9-739e1f7025be tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: d5eacee8-861b-453e-bdec-260c354bc942] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:19.526600 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-17aa2049-bb9e-48a1-8bb9-739e1f7025be tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:19.531343 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-17aa2049-bb9e-48a1-8bb9-739e1f7025be tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:19.532390 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-17aa2049-bb9e-48a1-8bb9-739e1f7025be tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:19.533015 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-17aa2049-bb9e-48a1-8bb9-739e1f7025be tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:19.846928 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-d4916587-7506-4ce0-ac2d-55b5ba4a3761 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dc700311c748ba8a56dc4e9e831889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e4811f3ecf4ced9941eb882d5eb8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:19.855680 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-17aa2049-bb9e-48a1-8bb9-739e1f7025be tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:19.858226 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d4916587-7506-4ce0-ac2d-55b5ba4a3761 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] 10.222.0.90 "GET /compute/v2.1/servers/59ea62ca-c11d-4654-8c28-7d2ef75c8aad" status: 200 len: 1314 microversion: 2.1 time: 0.387394 Oct 29 01:14:19.869507 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 131/267] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:19 2021] GET /compute/v2.1/servers/59ea62ca-c11d-4654-8c28-7d2ef75c8aad => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:19.869779 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-17aa2049-bb9e-48a1-8bb9-739e1f7025be tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/d5eacee8-861b-453e-bdec-260c354bc942" status: 200 len: 1316 microversion: 2.1 time: 0.355104 Oct 29 01:14:19.875564 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 137/268] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:19 2021] GET /compute/v2.1/servers/d5eacee8-861b-453e-bdec-260c354bc942 => generated 1316 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:20.323238 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-fb1b0f07-969b-4cc4-94f0-6ec080bbf81b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:20.324572 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-fb1b0f07-969b-4cc4-94f0-6ec080bbf81b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:20.335619 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fb1b0f07-969b-4cc4-94f0-6ec080bbf81b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:20.337987 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fb1b0f07-969b-4cc4-94f0-6ec080bbf81b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:20.340473 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fb1b0f07-969b-4cc4-94f0-6ec080bbf81b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:20.341322 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fb1b0f07-969b-4cc4-94f0-6ec080bbf81b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:20.485945 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-fb1b0f07-969b-4cc4-94f0-6ec080bbf81b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 200 len: 28616 microversion: 2.20 time: 0.166803 Oct 29 01:14:20.490524 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 132/269] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:14:20 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 28616 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:14:20.876301 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-b7881126-f86f-43e2-bd25-f1f86e3d3748 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:20.876892 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-b7881126-f86f-43e2-bd25-f1f86e3d3748 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] [instance: 59ea62ca-c11d-4654-8c28-7d2ef75c8aad] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:20.887675 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b7881126-f86f-43e2-bd25-f1f86e3d3748 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:20.888043 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-7d362b52-8ab3-4a33-8ca4-4af97bdf144c tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:20.888901 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-7d362b52-8ab3-4a33-8ca4-4af97bdf144c tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: d5eacee8-861b-453e-bdec-260c354bc942] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:20.895103 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b7881126-f86f-43e2-bd25-f1f86e3d3748 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:20.896565 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b7881126-f86f-43e2-bd25-f1f86e3d3748 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:20.897754 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7d362b52-8ab3-4a33-8ca4-4af97bdf144c tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:20.898238 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7d362b52-8ab3-4a33-8ca4-4af97bdf144c tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:20.898455 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b7881126-f86f-43e2-bd25-f1f86e3d3748 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:20.899630 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7d362b52-8ab3-4a33-8ca4-4af97bdf144c tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:20.900319 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7d362b52-8ab3-4a33-8ca4-4af97bdf144c tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:21.214491 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-b7881126-f86f-43e2-bd25-f1f86e3d3748 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dc700311c748ba8a56dc4e9e831889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e4811f3ecf4ced9941eb882d5eb8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:21.246898 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-7d362b52-8ab3-4a33-8ca4-4af97bdf144c tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:21.249352 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-b7881126-f86f-43e2-bd25-f1f86e3d3748 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] 10.222.0.90 "GET /compute/v2.1/servers/59ea62ca-c11d-4654-8c28-7d2ef75c8aad" status: 200 len: 1498 microversion: 2.1 time: 0.377662 Oct 29 01:14:21.251313 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 138/270] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:20 2021] GET /compute/v2.1/servers/59ea62ca-c11d-4654-8c28-7d2ef75c8aad => generated 1498 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:21.255518 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-7d362b52-8ab3-4a33-8ca4-4af97bdf144c tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/d5eacee8-861b-453e-bdec-260c354bc942" status: 200 len: 1316 microversion: 2.1 time: 0.372044 Oct 29 01:14:21.261807 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 133/271] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:20 2021] GET /compute/v2.1/servers/d5eacee8-861b-453e-bdec-260c354bc942 => generated 1316 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:21.497757 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-00860152-087b-4542-8c18-6e4848db6c75 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:21.498779 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-00860152-087b-4542-8c18-6e4848db6c75 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:21.505163 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-00860152-087b-4542-8c18-6e4848db6c75 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:21.506456 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-00860152-087b-4542-8c18-6e4848db6c75 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:21.507560 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-00860152-087b-4542-8c18-6e4848db6c75 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:21.508055 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-00860152-087b-4542-8c18-6e4848db6c75 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:21.664498 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-00860152-087b-4542-8c18-6e4848db6c75 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 200 len: 28616 microversion: 2.20 time: 0.168327 Oct 29 01:14:21.665170 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 139/272] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:14:21 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 28616 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:14:22.273624 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ff7a060d-b2e7-4075-ae02-c1e55d95ce83 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:22.274273 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ff7a060d-b2e7-4075-ae02-c1e55d95ce83 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: d5eacee8-861b-453e-bdec-260c354bc942] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:22.282903 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ff7a060d-b2e7-4075-ae02-c1e55d95ce83 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:22.283369 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ff7a060d-b2e7-4075-ae02-c1e55d95ce83 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:22.284135 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ff7a060d-b2e7-4075-ae02-c1e55d95ce83 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:22.284572 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ff7a060d-b2e7-4075-ae02-c1e55d95ce83 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:22.304164 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f8a6a2dc-58e9-4809-a333-577b63b6b6c7 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:22.304847 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f8a6a2dc-58e9-4809-a333-577b63b6b6c7 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] [instance: 59ea62ca-c11d-4654-8c28-7d2ef75c8aad] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:22.333249 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f8a6a2dc-58e9-4809-a333-577b63b6b6c7 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:22.341949 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f8a6a2dc-58e9-4809-a333-577b63b6b6c7 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:22.343401 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f8a6a2dc-58e9-4809-a333-577b63b6b6c7 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:22.345148 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f8a6a2dc-58e9-4809-a333-577b63b6b6c7 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:22.398877 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f8a6a2dc-58e9-4809-a333-577b63b6b6c7 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] [instance: 59ea62ca-c11d-4654-8c28-7d2ef75c8aad] Going to try to terminate instance {{(pid=115748) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 01:14:22.528035 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f8a6a2dc-58e9-4809-a333-577b63b6b6c7 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] 10.222.0.90 "DELETE /compute/v2.1/servers/59ea62ca-c11d-4654-8c28-7d2ef75c8aad" status: 204 len: 0 microversion: 2.1 time: 0.227719 Oct 29 01:14:22.528711 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 140/273] 10.222.0.90 () {58 vars in 1238 bytes} [Fri Oct 29 01:14:22 2021] DELETE /compute/v2.1/servers/59ea62ca-c11d-4654-8c28-7d2ef75c8aad => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 01:14:22.560204 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-ff7a060d-b2e7-4075-ae02-c1e55d95ce83 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:22.568806 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ff7a060d-b2e7-4075-ae02-c1e55d95ce83 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/d5eacee8-861b-453e-bdec-260c354bc942" status: 200 len: 1316 microversion: 2.1 time: 0.300593 Oct 29 01:14:22.580136 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 134/274] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:22 2021] GET /compute/v2.1/servers/d5eacee8-861b-453e-bdec-260c354bc942 => generated 1316 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:22.580136 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d08389fa-5d20-460f-9977-c1e1ebd3733f tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:22.580136 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d08389fa-5d20-460f-9977-c1e1ebd3733f tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] [instance: 59ea62ca-c11d-4654-8c28-7d2ef75c8aad] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:22.585881 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d08389fa-5d20-460f-9977-c1e1ebd3733f tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:22.586424 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d08389fa-5d20-460f-9977-c1e1ebd3733f tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:22.587922 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d08389fa-5d20-460f-9977-c1e1ebd3733f tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:22.588416 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d08389fa-5d20-460f-9977-c1e1ebd3733f tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:22.717036 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d50b5bd1-577f-4a93-91e8-b73b233c43f8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1389907364", "imageRef": "3fef3f0d-d772-4999-b764-d6690634a06d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0ebb49d4-28db-41b8-a63e-ce03ec055cb1"}]}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:22.772644 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.network.neutron [None req-d50b5bd1-577f-4a93-91e8-b73b233c43f8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] validate_networks() for [('0ebb49d4-28db-41b8-a63e-ce03ec055cb1', None, None, None, None, None)] {{(pid=115748) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 01:14:22.861304 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-d08389fa-5d20-460f-9977-c1e1ebd3733f tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dc700311c748ba8a56dc4e9e831889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e4811f3ecf4ced9941eb882d5eb8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:22.868646 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d08389fa-5d20-460f-9977-c1e1ebd3733f tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] 10.222.0.90 "GET /compute/v2.1/servers/59ea62ca-c11d-4654-8c28-7d2ef75c8aad" status: 200 len: 1504 microversion: 2.1 time: 0.294593 Oct 29 01:14:22.869332 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 135/275] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:22 2021] GET /compute/v2.1/servers/59ea62ca-c11d-4654-8c28-7d2ef75c8aad => generated 1504 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:22.873828 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-40c2fcc2-af2c-47fe-88c1-0af25fe13a61 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:22.874791 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-40c2fcc2-af2c-47fe-88c1-0af25fe13a61 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:22.881058 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-40c2fcc2-af2c-47fe-88c1-0af25fe13a61 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:22.881514 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-40c2fcc2-af2c-47fe-88c1-0af25fe13a61 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:22.882276 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-40c2fcc2-af2c-47fe-88c1-0af25fe13a61 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:22.882733 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-40c2fcc2-af2c-47fe-88c1-0af25fe13a61 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:22.980231 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-40c2fcc2-af2c-47fe-88c1-0af25fe13a61 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 200 len: 28616 microversion: 2.20 time: 0.109587 Oct 29 01:14:22.980883 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 136/276] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:14:22 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 28616 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:14:23.218887 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.virt.hardware [None req-d50b5bd1-577f-4a93-91e8-b73b233c43f8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Flavor limits 0:0:0 {{(pid=115748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:14:23.219453 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.virt.hardware [None req-d50b5bd1-577f-4a93-91e8-b73b233c43f8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Image limits 0:0:0 {{(pid=115748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:14:23.219927 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.virt.hardware [None req-d50b5bd1-577f-4a93-91e8-b73b233c43f8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Flavor pref 0:0:0 {{(pid=115748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:14:23.220328 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.virt.hardware [None req-d50b5bd1-577f-4a93-91e8-b73b233c43f8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Image pref 0:0:0 {{(pid=115748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:14:23.221011 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.virt.hardware [None req-d50b5bd1-577f-4a93-91e8-b73b233c43f8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:14:23.230123 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d50b5bd1-577f-4a93-91e8-b73b233c43f8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:23.230683 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d50b5bd1-577f-4a93-91e8-b73b233c43f8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:23.231441 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d50b5bd1-577f-4a93-91e8-b73b233c43f8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:23.231962 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d50b5bd1-577f-4a93-91e8-b73b233c43f8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:23.260583 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.quota [None req-d50b5bd1-577f-4a93-91e8-b73b233c43f8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Getting quotas for project 31da6d496ca244679f9c7cfc129ca1c4. Resources: {'instances', 'cores', 'ram'} {{(pid=115748) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:14:23.264992 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.quota [None req-d50b5bd1-577f-4a93-91e8-b73b233c43f8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Getting quotas for user a6a83b53318d4a5c8e9ed1e42647d5db and project 31da6d496ca244679f9c7cfc129ca1c4. Resources: {'instances', 'cores', 'ram'} {{(pid=115748) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:14:23.279917 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d50b5bd1-577f-4a93-91e8-b73b233c43f8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Going to run 1 instances... {{(pid=115748) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 01:14:23.282506 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d50b5bd1-577f-4a93-91e8-b73b233c43f8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3fef3f0d-d772-4999-b764-d6690634a06d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 01:14:23.334537 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d50b5bd1-577f-4a93-91e8-b73b233c43f8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.800732 Oct 29 01:14:23.340457 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 141/277] 10.222.0.90 () {60 vars in 1146 bytes} [Fri Oct 29 01:14:22 2021] POST /compute/v2.1/servers => generated 383 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:14:23.346265 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-2c28a8ea-8a5d-4d33-a674-47d96126092b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:23.347026 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-2c28a8ea-8a5d-4d33-a674-47d96126092b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:23.449700 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-3fd10183-b9ff-4164-a6dd-62ce59cb6d21 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-139767123", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1011925652", "security_groups": [{"name": "tempest-secgroup-smoke-1001540421"}], "networks": [{"uuid": "ac0a53ed-961e-48a4-b546-071378d14115"}], "block_device_mapping_v2": [{"uuid": "bbaab3f1-c0eb-4bc4-aef8-17822d1a39b4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:23.468755 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-2c28a8ea-8a5d-4d33-a674-47d96126092b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:23.479584 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-2c28a8ea-8a5d-4d33-a674-47d96126092b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1222 microversion: 2.1 time: 0.137218 Oct 29 01:14:23.480538 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 137/278] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:23 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1222 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:23.525630 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [req-e1196269-28e1-4e5b-afea-a0c25cb4547a req-c4186085-572e-4148-a642-75056c5576d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5eacee8-861b-453e-bdec-260c354bc942", "name": "network-vif-plugged", "status": "completed", "tag": "5945ae54-9c50-4ec7-9b83-6f66146a5c21"}]} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:23.527374 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:14:23.527374 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: warnings.warn(msg) Oct 29 01:14:23.540918 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-e1196269-28e1-4e5b-afea-a0c25cb4547a req-c4186085-572e-4148-a642-75056c5576d9 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:23.541371 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-e1196269-28e1-4e5b-afea-a0c25cb4547a req-c4186085-572e-4148-a642-75056c5576d9 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:23.591727 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.compute.server_external_events [req-e1196269-28e1-4e5b-afea-a0c25cb4547a req-c4186085-572e-4148-a642-75056c5576d9 service nova] Creating event network-vif-plugged:5945ae54-9c50-4ec7-9b83-6f66146a5c21 for instance d5eacee8-861b-453e-bdec-260c354bc942 on hv-cinder-81558 Oct 29 01:14:23.597202 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [req-e1196269-28e1-4e5b-afea-a0c25cb4547a req-c4186085-572e-4148-a642-75056c5576d9 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075017 Oct 29 01:14:23.597806 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 138/279] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:14:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:14:23.616251 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-26d50bea-6d9f-45b1-a8d9-629690572f95 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1239463127", "imageRef": "3fef3f0d-d772-4999-b764-d6690634a06d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0ebb49d4-28db-41b8-a63e-ce03ec055cb1"}]}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:23.713143 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.network.neutron [None req-26d50bea-6d9f-45b1-a8d9-629690572f95 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] validate_networks() for [('0ebb49d4-28db-41b8-a63e-ce03ec055cb1', None, None, None, None, None)] {{(pid=115747) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 01:14:24.136716 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.network.neutron [None req-3fd10183-b9ff-4164-a6dd-62ce59cb6d21 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] validate_networks() for [('ac0a53ed-961e-48a4-b546-071378d14115', None, None, None, None, None)] {{(pid=115748) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 01:14:25.089393 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-26d50bea-6d9f-45b1-a8d9-629690572f95 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Flavor limits 0:0:0 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:14:25.090746 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-26d50bea-6d9f-45b1-a8d9-629690572f95 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Image limits 0:0:0 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:14:25.091979 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-26d50bea-6d9f-45b1-a8d9-629690572f95 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Flavor pref 0:0:0 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:14:25.092572 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-26d50bea-6d9f-45b1-a8d9-629690572f95 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Image pref 0:0:0 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:14:25.093166 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-26d50bea-6d9f-45b1-a8d9-629690572f95 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:14:25.111224 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-26d50bea-6d9f-45b1-a8d9-629690572f95 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:25.112700 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-26d50bea-6d9f-45b1-a8d9-629690572f95 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:25.114314 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-26d50bea-6d9f-45b1-a8d9-629690572f95 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:25.116730 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-26d50bea-6d9f-45b1-a8d9-629690572f95 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:25.146726 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.quota [None req-26d50bea-6d9f-45b1-a8d9-629690572f95 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Getting quotas for project 31da6d496ca244679f9c7cfc129ca1c4. Resources: {'instances', 'cores', 'ram'} {{(pid=115747) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:14:25.153548 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.quota [None req-26d50bea-6d9f-45b1-a8d9-629690572f95 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Getting quotas for user a6a83b53318d4a5c8e9ed1e42647d5db and project 31da6d496ca244679f9c7cfc129ca1c4. Resources: {'instances', 'cores', 'ram'} {{(pid=115747) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:14:25.154157 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.virt.hardware [None req-3fd10183-b9ff-4164-a6dd-62ce59cb6d21 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Flavor limits 0:0:0 {{(pid=115748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:14:25.154667 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.virt.hardware [None req-3fd10183-b9ff-4164-a6dd-62ce59cb6d21 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Image limits 0:0:0 {{(pid=115748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:14:25.156338 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.virt.hardware [None req-3fd10183-b9ff-4164-a6dd-62ce59cb6d21 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Flavor pref 0:0:0 {{(pid=115748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:14:25.157074 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.virt.hardware [None req-3fd10183-b9ff-4164-a6dd-62ce59cb6d21 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Image pref 0:0:0 {{(pid=115748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:14:25.157840 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.virt.hardware [None req-3fd10183-b9ff-4164-a6dd-62ce59cb6d21 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:14:25.168877 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-26d50bea-6d9f-45b1-a8d9-629690572f95 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Going to run 1 instances... {{(pid=115747) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 01:14:25.173099 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-26d50bea-6d9f-45b1-a8d9-629690572f95 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3fef3f0d-d772-4999-b764-d6690634a06d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 01:14:25.191040 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3fd10183-b9ff-4164-a6dd-62ce59cb6d21 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:25.192712 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3fd10183-b9ff-4164-a6dd-62ce59cb6d21 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:25.197135 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3fd10183-b9ff-4164-a6dd-62ce59cb6d21 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:25.197919 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3fd10183-b9ff-4164-a6dd-62ce59cb6d21 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:25.228102 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-26d50bea-6d9f-45b1-a8d9-629690572f95 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.628492 Oct 29 01:14:25.229087 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 139/280] 10.222.0.90 () {60 vars in 1146 bytes} [Fri Oct 29 01:14:23 2021] POST /compute/v2.1/servers => generated 383 bytes in 1631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:14:25.234921 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d678215d-5fc6-4f0f-a2f9-d050ddb9c967 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:25.235662 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d678215d-5fc6-4f0f-a2f9-d050ddb9c967 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: d5eacee8-861b-453e-bdec-260c354bc942] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:25.243608 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d678215d-5fc6-4f0f-a2f9-d050ddb9c967 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:25.244138 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d678215d-5fc6-4f0f-a2f9-d050ddb9c967 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:25.245156 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d678215d-5fc6-4f0f-a2f9-d050ddb9c967 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:25.245269 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.quota [None req-3fd10183-b9ff-4164-a6dd-62ce59cb6d21 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Getting quotas for project 7c4db728610349e3b7f324f37a51b58c. Resources: {'instances', 'cores', 'ram'} {{(pid=115748) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:14:25.246070 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d678215d-5fc6-4f0f-a2f9-d050ddb9c967 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:25.256097 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.quota [None req-3fd10183-b9ff-4164-a6dd-62ce59cb6d21 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Getting quotas for user 306798b38f4f419aaf5472650c2c1ea5 and project 7c4db728610349e3b7f324f37a51b58c. Resources: {'instances', 'cores', 'ram'} {{(pid=115748) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:14:25.326966 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-3fd10183-b9ff-4164-a6dd-62ce59cb6d21 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Going to run 1 instances... {{(pid=115748) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 01:14:25.329512 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-3fd10183-b9ff-4164-a6dd-62ce59cb6d21 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bbaab3f1-c0eb-4bc4-aef8-17822d1a39b4',volume_size=None,volume_type=None)] {{(pid=115748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 01:14:25.656739 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-d678215d-5fc6-4f0f-a2f9-d050ddb9c967 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:25.682935 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d678215d-5fc6-4f0f-a2f9-d050ddb9c967 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/d5eacee8-861b-453e-bdec-260c354bc942" status: 200 len: 1316 microversion: 2.1 time: 0.452581 Oct 29 01:14:25.687509 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 140/281] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:25 2021] GET /compute/v2.1/servers/d5eacee8-861b-453e-bdec-260c354bc942 => generated 1316 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:25.698335 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-3fd10183-b9ff-4164-a6dd-62ce59cb6d21 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.242052 Oct 29 01:14:25.700147 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 142/282] 10.222.0.90 () {60 vars in 1146 bytes} [Fri Oct 29 01:14:23 2021] POST /compute/v2.1/servers => generated 406 bytes in 2255 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:14:25.708198 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-6087144c-fecb-45f8-8430-ee55363f1a82 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:25.710587 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-95f645c1-7cea-47a9-8744-e3862ef2f6fc tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:25.714239 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-6087144c-fecb-45f8-8430-ee55363f1a82 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:25.725471 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6087144c-fecb-45f8-8430-ee55363f1a82 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:25.726316 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6087144c-fecb-45f8-8430-ee55363f1a82 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:25.727439 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6087144c-fecb-45f8-8430-ee55363f1a82 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:25.727960 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-95f645c1-7cea-47a9-8744-e3862ef2f6fc tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] [instance: 59ea62ca-c11d-4654-8c28-7d2ef75c8aad] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:25.728198 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6087144c-fecb-45f8-8430-ee55363f1a82 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:25.737585 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-95f645c1-7cea-47a9-8744-e3862ef2f6fc tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:25.738215 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-95f645c1-7cea-47a9-8744-e3862ef2f6fc tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:25.740713 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-95f645c1-7cea-47a9-8744-e3862ef2f6fc tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:25.741311 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-95f645c1-7cea-47a9-8744-e3862ef2f6fc tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:25.864250 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-6087144c-fecb-45f8-8430-ee55363f1a82 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 200 len: 28616 microversion: 2.20 time: 0.162599 Oct 29 01:14:25.865647 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 143/283] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:14:25 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 28616 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:14:25.875223 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-15be8e0f-d7c9-431b-a39f-1649525952e5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:25.878593 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-15be8e0f-d7c9-431b-a39f-1649525952e5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:26.173197 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-15be8e0f-d7c9-431b-a39f-1649525952e5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:26.184605 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-15be8e0f-d7c9-431b-a39f-1649525952e5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1222 microversion: 2.1 time: 0.314045 Oct 29 01:14:26.195197 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 144/284] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:25 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1222 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:26.201008 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-99d36a36-f645-44a3-a381-5dd4134a40e3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:26.201838 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-99d36a36-f645-44a3-a381-5dd4134a40e3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:26.330029 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-95f645c1-7cea-47a9-8744-e3862ef2f6fc tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dc700311c748ba8a56dc4e9e831889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e4811f3ecf4ced9941eb882d5eb8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:26.338171 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-95f645c1-7cea-47a9-8744-e3862ef2f6fc tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] 10.222.0.90 "GET /compute/v2.1/servers/59ea62ca-c11d-4654-8c28-7d2ef75c8aad" status: 200 len: 1504 microversion: 2.1 time: 0.647678 Oct 29 01:14:26.338810 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 141/285] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:25 2021] GET /compute/v2.1/servers/59ea62ca-c11d-4654-8c28-7d2ef75c8aad => generated 1504 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:26.433065 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-99d36a36-f645-44a3-a381-5dd4134a40e3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:26.442607 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-99d36a36-f645-44a3-a381-5dd4134a40e3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1088 microversion: 2.1 time: 0.244729 Oct 29 01:14:26.444834 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 145/286] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:26 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1088 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:26.702785 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-52b6115c-f462-40b9-b1e4-913346191d28 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:26.703410 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-52b6115c-f462-40b9-b1e4-913346191d28 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: d5eacee8-861b-453e-bdec-260c354bc942] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:26.717554 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-52b6115c-f462-40b9-b1e4-913346191d28 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:26.718093 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-52b6115c-f462-40b9-b1e4-913346191d28 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:26.718921 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-52b6115c-f462-40b9-b1e4-913346191d28 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:26.719352 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-52b6115c-f462-40b9-b1e4-913346191d28 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:26.878188 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-43468549-798c-40ca-ba32-cfaa0d50e001 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:26.879202 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-43468549-798c-40ca-ba32-cfaa0d50e001 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:26.893399 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-43468549-798c-40ca-ba32-cfaa0d50e001 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:26.895671 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-43468549-798c-40ca-ba32-cfaa0d50e001 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:26.900127 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-43468549-798c-40ca-ba32-cfaa0d50e001 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:26.902902 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-43468549-798c-40ca-ba32-cfaa0d50e001 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:27.071588 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-43468549-798c-40ca-ba32-cfaa0d50e001 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 200 len: 29421 microversion: 2.20 time: 0.197990 Oct 29 01:14:27.072830 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 146/287] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:14:26 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 29421 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:14:27.080947 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [req-7942765d-a9fc-47f5-987b-db1ad54e02b4 req-8a6dbf05-c2be-4e89-81d4-2da60fb9efc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59ea62ca-c11d-4654-8c28-7d2ef75c8aad", "name": "network-vif-deleted", "tag": "472efa8c-8ad6-47a0-905d-d577af9411cf"}]} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:27.082486 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:14:27.082486 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: warnings.warn(msg) Oct 29 01:14:27.082706 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-52b6115c-f462-40b9-b1e4-913346191d28 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:27.094552 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-52b6115c-f462-40b9-b1e4-913346191d28 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/d5eacee8-861b-453e-bdec-260c354bc942" status: 200 len: 1505 microversion: 2.1 time: 0.395659 Oct 29 01:14:27.099691 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 142/288] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:26 2021] GET /compute/v2.1/servers/d5eacee8-861b-453e-bdec-260c354bc942 => generated 1505 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:27.109621 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-7942765d-a9fc-47f5-987b-db1ad54e02b4 req-8a6dbf05-c2be-4e89-81d4-2da60fb9efc6 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:27.111598 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-7942765d-a9fc-47f5-987b-db1ad54e02b4 req-8a6dbf05-c2be-4e89-81d4-2da60fb9efc6 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:27.139146 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.compute.server_external_events [req-7942765d-a9fc-47f5-987b-db1ad54e02b4 req-8a6dbf05-c2be-4e89-81d4-2da60fb9efc6 service nova] Creating event network-vif-deleted:472efa8c-8ad6-47a0-905d-d577af9411cf for instance 59ea62ca-c11d-4654-8c28-7d2ef75c8aad on hv-cinder-81558 Oct 29 01:14:27.146726 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [req-7942765d-a9fc-47f5-987b-db1ad54e02b4 req-8a6dbf05-c2be-4e89-81d4-2da60fb9efc6 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070512 Oct 29 01:14:27.147688 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 147/289] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:14:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:14:27.202470 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-781886c2-9930-4ffb-a6b1-7f92043b6b7c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:27.203197 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-781886c2-9930-4ffb-a6b1-7f92043b6b7c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:27.214471 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-781886c2-9930-4ffb-a6b1-7f92043b6b7c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:27.215601 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-781886c2-9930-4ffb-a6b1-7f92043b6b7c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:27.217271 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-781886c2-9930-4ffb-a6b1-7f92043b6b7c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:27.217973 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-781886c2-9930-4ffb-a6b1-7f92043b6b7c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:27.357634 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-781886c2-9930-4ffb-a6b1-7f92043b6b7c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:27.362349 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c6b81d36-7364-413e-b34f-de711daae729 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:27.363576 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c6b81d36-7364-413e-b34f-de711daae729 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] [instance: 59ea62ca-c11d-4654-8c28-7d2ef75c8aad] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:27.369853 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-781886c2-9930-4ffb-a6b1-7f92043b6b7c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1274 microversion: 2.1 time: 0.171081 Oct 29 01:14:27.370452 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 143/290] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:27 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1274 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:27.377630 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c6b81d36-7364-413e-b34f-de711daae729 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:27.379289 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c6b81d36-7364-413e-b34f-de711daae729 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:27.380968 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c6b81d36-7364-413e-b34f-de711daae729 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:27.383557 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c6b81d36-7364-413e-b34f-de711daae729 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:27.436078 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c6b81d36-7364-413e-b34f-de711daae729 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:27.436529 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c6b81d36-7364-413e-b34f-de711daae729 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:27.437066 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.objects.instance [None req-c6b81d36-7364-413e-b34f-de711daae729 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lazy-loading 'fault' on Instance uuid 59ea62ca-c11d-4654-8c28-7d2ef75c8aad {{(pid=115748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:14:27.460905 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-0bc79273-9c43-4225-8cba-879f5b0e6e73 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:27.461993 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-0bc79273-9c43-4225-8cba-879f5b0e6e73 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:27.478488 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0bc79273-9c43-4225-8cba-879f5b0e6e73 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:27.481484 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0bc79273-9c43-4225-8cba-879f5b0e6e73 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:27.482266 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0bc79273-9c43-4225-8cba-879f5b0e6e73 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:27.482739 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0bc79273-9c43-4225-8cba-879f5b0e6e73 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:27.575044 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-c6b81d36-7364-413e-b34f-de711daae729 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dc700311c748ba8a56dc4e9e831889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e4811f3ecf4ced9941eb882d5eb8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:27.592469 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c6b81d36-7364-413e-b34f-de711daae729 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] 10.222.0.90 "GET /compute/v2.1/servers/59ea62ca-c11d-4654-8c28-7d2ef75c8aad" status: 200 len: 1304 microversion: 2.1 time: 0.239247 Oct 29 01:14:27.596104 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 148/291] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:27 2021] GET /compute/v2.1/servers/59ea62ca-c11d-4654-8c28-7d2ef75c8aad => generated 1304 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:27.761830 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-0bc79273-9c43-4225-8cba-879f5b0e6e73 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:27.779724 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-0bc79273-9c43-4225-8cba-879f5b0e6e73 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1130 microversion: 2.1 time: 0.318774 Oct 29 01:14:27.783147 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 144/292] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:27 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1130 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:28.083292 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d409e668-7ca2-43d8-9290-29c64c628853 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:28.084226 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d409e668-7ca2-43d8-9290-29c64c628853 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:28.094220 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d409e668-7ca2-43d8-9290-29c64c628853 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:28.094666 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d409e668-7ca2-43d8-9290-29c64c628853 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:28.095695 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d409e668-7ca2-43d8-9290-29c64c628853 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:28.096341 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d409e668-7ca2-43d8-9290-29c64c628853 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:28.271429 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [req-8c998871-f6f1-43e9-a396-83056f7c52e2 req-e9432c46-8e19-4803-b2b6-904f4ca1d8e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ff6277c-b59e-467c-82d4-631046fb03d9", "tag": "087af4cc-fcd8-4ae5-a1ad-de9edef4df73"}]} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:28.273078 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:14:28.273078 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: warnings.warn(msg) Oct 29 01:14:28.288905 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-8c998871-f6f1-43e9-a396-83056f7c52e2 req-e9432c46-8e19-4803-b2b6-904f4ca1d8e9 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:28.290930 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-8c998871-f6f1-43e9-a396-83056f7c52e2 req-e9432c46-8e19-4803-b2b6-904f4ca1d8e9 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:28.318108 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.compute.server_external_events [req-8c998871-f6f1-43e9-a396-83056f7c52e2 req-e9432c46-8e19-4803-b2b6-904f4ca1d8e9 service nova] Creating event network-changed:087af4cc-fcd8-4ae5-a1ad-de9edef4df73 for instance 0ff6277c-b59e-467c-82d4-631046fb03d9 on hv-cinder-81558 Oct 29 01:14:28.332099 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [req-8c998871-f6f1-43e9-a396-83056f7c52e2 req-e9432c46-8e19-4803-b2b6-904f4ca1d8e9 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067452 Oct 29 01:14:28.338483 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 145/293] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:14:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:14:28.383098 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d409e668-7ca2-43d8-9290-29c64c628853 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 200 len: 30775 microversion: 2.20 time: 0.303002 Oct 29 01:14:28.387249 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 149/294] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:14:28 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 30775 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:14:28.387591 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-6def3334-c20e-4d80-8d10-507e11a3a4a5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:28.388318 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-6def3334-c20e-4d80-8d10-507e11a3a4a5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:28.394715 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6def3334-c20e-4d80-8d10-507e11a3a4a5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:28.395163 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6def3334-c20e-4d80-8d10-507e11a3a4a5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:28.396471 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6def3334-c20e-4d80-8d10-507e11a3a4a5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:28.396907 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6def3334-c20e-4d80-8d10-507e11a3a4a5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:28.461170 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-6def3334-c20e-4d80-8d10-507e11a3a4a5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:28.468977 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-6def3334-c20e-4d80-8d10-507e11a3a4a5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1280 microversion: 2.1 time: 0.085602 Oct 29 01:14:28.471664 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 146/295] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:28 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1280 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:28.610853 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-ab1c69df-4d41-4249-86fe-2a7b7f1d8db9 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:28.611737 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-ab1c69df-4d41-4249-86fe-2a7b7f1d8db9 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] [instance: 59ea62ca-c11d-4654-8c28-7d2ef75c8aad] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:28.627609 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ab1c69df-4d41-4249-86fe-2a7b7f1d8db9 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:28.628578 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ab1c69df-4d41-4249-86fe-2a7b7f1d8db9 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:28.629760 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ab1c69df-4d41-4249-86fe-2a7b7f1d8db9 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:28.630729 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ab1c69df-4d41-4249-86fe-2a7b7f1d8db9 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:28.712056 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ab1c69df-4d41-4249-86fe-2a7b7f1d8db9 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:28.713344 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ab1c69df-4d41-4249-86fe-2a7b7f1d8db9 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:28.714825 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.objects.instance [None req-ab1c69df-4d41-4249-86fe-2a7b7f1d8db9 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lazy-loading 'fault' on Instance uuid 59ea62ca-c11d-4654-8c28-7d2ef75c8aad {{(pid=115748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:14:28.723391 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-333301f3-2a86-4593-835a-c6caba42910a tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c4bf855-9aeb-4766-b2cd-036dfc73ee66"}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:28.724632 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-333301f3-2a86-4593-835a-c6caba42910a tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: d5eacee8-861b-453e-bdec-260c354bc942] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:28.736220 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-333301f3-2a86-4593-835a-c6caba42910a tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:28.737248 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-333301f3-2a86-4593-835a-c6caba42910a tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:28.740083 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-333301f3-2a86-4593-835a-c6caba42910a tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:28.740754 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-333301f3-2a86-4593-835a-c6caba42910a tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:28.879648 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-ab1c69df-4d41-4249-86fe-2a7b7f1d8db9 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dc700311c748ba8a56dc4e9e831889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e4811f3ecf4ced9941eb882d5eb8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:28.892056 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-ab1c69df-4d41-4249-86fe-2a7b7f1d8db9 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] 10.222.0.90 "GET /compute/v2.1/servers/59ea62ca-c11d-4654-8c28-7d2ef75c8aad" status: 200 len: 1304 microversion: 2.1 time: 0.285832 Oct 29 01:14:28.902944 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 150/296] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:28 2021] GET /compute/v2.1/servers/59ea62ca-c11d-4654-8c28-7d2ef75c8aad => generated 1304 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:28.911196 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-91564c23-3517-4a00-b0ca-0f43aec410cc tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:28.912053 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-91564c23-3517-4a00-b0ca-0f43aec410cc tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:28.937154 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-91564c23-3517-4a00-b0ca-0f43aec410cc tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:28.937894 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-91564c23-3517-4a00-b0ca-0f43aec410cc tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:28.938920 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-91564c23-3517-4a00-b0ca-0f43aec410cc tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:28.939544 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-91564c23-3517-4a00-b0ca-0f43aec410cc tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:29.098179 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-91564c23-3517-4a00-b0ca-0f43aec410cc tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:29.123641 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-91564c23-3517-4a00-b0ca-0f43aec410cc tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1204 microversion: 2.1 time: 0.210141 Oct 29 01:14:29.124529 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 151/297] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:28 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1204 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:29.358595 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-333301f3-2a86-4593-835a-c6caba42910a tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "POST /compute/v2.1/servers/d5eacee8-861b-453e-bdec-260c354bc942/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.638965 Oct 29 01:14:29.359831 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 147/298] 10.222.0.90 () {60 vars in 1322 bytes} [Fri Oct 29 01:14:28 2021] POST /compute/v2.1/servers/d5eacee8-861b-453e-bdec-260c354bc942/os-volume_attachments => generated 194 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:14:29.396714 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2c631828-ec83-4eca-b440-13695b60948e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:29.400045 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2c631828-ec83-4eca-b440-13695b60948e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:29.409577 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2c631828-ec83-4eca-b440-13695b60948e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:29.410173 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2c631828-ec83-4eca-b440-13695b60948e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:29.411847 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2c631828-ec83-4eca-b440-13695b60948e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:29.412423 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2c631828-ec83-4eca-b440-13695b60948e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:29.488703 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9cf7cbc9-affe-4c4c-96f5-98b9d111075d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:29.490331 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9cf7cbc9-affe-4c4c-96f5-98b9d111075d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:29.505330 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9cf7cbc9-affe-4c4c-96f5-98b9d111075d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:29.505824 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9cf7cbc9-affe-4c4c-96f5-98b9d111075d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:29.514433 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9cf7cbc9-affe-4c4c-96f5-98b9d111075d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:29.514828 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9cf7cbc9-affe-4c4c-96f5-98b9d111075d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:29.599576 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2c631828-ec83-4eca-b440-13695b60948e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 200 len: 31910 microversion: 2.20 time: 0.207495 Oct 29 01:14:29.600869 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 152/299] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:14:29 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 31910 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:14:29.806690 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-9cf7cbc9-affe-4c4c-96f5-98b9d111075d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:29.821671 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9cf7cbc9-affe-4c4c-96f5-98b9d111075d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1322 microversion: 2.1 time: 0.339087 Oct 29 01:14:29.822268 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 148/300] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:29 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1322 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:29.909774 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-21c99864-a793-4112-a9b4-a1d7981600cc tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:29.910598 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-21c99864-a793-4112-a9b4-a1d7981600cc tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] [instance: 59ea62ca-c11d-4654-8c28-7d2ef75c8aad] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:29.927658 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-21c99864-a793-4112-a9b4-a1d7981600cc tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:29.928231 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-21c99864-a793-4112-a9b4-a1d7981600cc tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:29.929052 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-21c99864-a793-4112-a9b4-a1d7981600cc tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:29.929489 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-21c99864-a793-4112-a9b4-a1d7981600cc tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:29.989202 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.wsgi [None req-21c99864-a793-4112-a9b4-a1d7981600cc tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] HTTP exception thrown: Instance 59ea62ca-c11d-4654-8c28-7d2ef75c8aad could not be found. Oct 29 01:14:29.990318 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-21c99864-a793-4112-a9b4-a1d7981600cc tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Returning 404 to user: Instance 59ea62ca-c11d-4654-8c28-7d2ef75c8aad could not be found. {{(pid=115748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:14:29.991313 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-21c99864-a793-4112-a9b4-a1d7981600cc tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] 10.222.0.90 "GET /compute/v2.1/servers/59ea62ca-c11d-4654-8c28-7d2ef75c8aad" status: 404 len: 111 microversion: 2.1 time: 0.085744 Oct 29 01:14:29.992467 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 153/301] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:29 2021] GET /compute/v2.1/servers/59ea62ca-c11d-4654-8c28-7d2ef75c8aad => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:14:30.141140 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-e0189172-ee03-4b9b-b5fe-ecda2c41a3cd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:30.141965 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-e0189172-ee03-4b9b-b5fe-ecda2c41a3cd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:30.152282 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e0189172-ee03-4b9b-b5fe-ecda2c41a3cd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:30.157668 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-1cdb726b-5570-4861-88e8-e54c65244e9b tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-497501198", "imageRef": "3fef3f0d-d772-4999-b764-d6690634a06d", "flavorRef": "452", "networks": [{"uuid": "609cf7b7-302a-452c-a833-83730f05081a"}]}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:30.162841 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e0189172-ee03-4b9b-b5fe-ecda2c41a3cd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:30.164220 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e0189172-ee03-4b9b-b5fe-ecda2c41a3cd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:30.164912 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e0189172-ee03-4b9b-b5fe-ecda2c41a3cd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:30.274917 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.network.neutron [None req-1cdb726b-5570-4861-88e8-e54c65244e9b tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] validate_networks() for [('609cf7b7-302a-452c-a833-83730f05081a', None, None, None, None, None)] {{(pid=115748) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 01:14:30.635825 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-e0189172-ee03-4b9b-b5fe-ecda2c41a3cd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:30.647222 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-e0189172-ee03-4b9b-b5fe-ecda2c41a3cd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1272 microversion: 2.1 time: 0.509923 Oct 29 01:14:30.660714 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 149/302] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:30 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1272 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:30.673454 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-1962604b-83c6-4519-963d-14bc5e10c830 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:30.675052 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-1962604b-83c6-4519-963d-14bc5e10c830 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:30.687403 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1962604b-83c6-4519-963d-14bc5e10c830 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:30.688317 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1962604b-83c6-4519-963d-14bc5e10c830 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:30.689551 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1962604b-83c6-4519-963d-14bc5e10c830 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:30.690845 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1962604b-83c6-4519-963d-14bc5e10c830 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:30.821636 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-1962604b-83c6-4519-963d-14bc5e10c830 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 200 len: 32790 microversion: 2.20 time: 0.158763 Oct 29 01:14:30.823520 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 150/303] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:14:30 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 32790 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:14:30.841297 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-21c34ece-fb07-45c2-aa8e-7fab63f85a64 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:30.843150 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-21c34ece-fb07-45c2-aa8e-7fab63f85a64 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:30.853759 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-21c34ece-fb07-45c2-aa8e-7fab63f85a64 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:30.861143 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-21c34ece-fb07-45c2-aa8e-7fab63f85a64 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:30.862332 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-21c34ece-fb07-45c2-aa8e-7fab63f85a64 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:30.863743 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-21c34ece-fb07-45c2-aa8e-7fab63f85a64 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:31.064644 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.virt.hardware [None req-1cdb726b-5570-4861-88e8-e54c65244e9b tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Flavor limits 0:0:0 {{(pid=115748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:14:31.065514 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.virt.hardware [None req-1cdb726b-5570-4861-88e8-e54c65244e9b tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Image limits 0:0:0 {{(pid=115748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:14:31.067566 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.virt.hardware [None req-1cdb726b-5570-4861-88e8-e54c65244e9b tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Flavor pref 0:0:0 {{(pid=115748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:14:31.068531 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.virt.hardware [None req-1cdb726b-5570-4861-88e8-e54c65244e9b tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Image pref 0:0:0 {{(pid=115748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:14:31.069415 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.virt.hardware [None req-1cdb726b-5570-4861-88e8-e54c65244e9b tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:14:31.083657 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1cdb726b-5570-4861-88e8-e54c65244e9b tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:31.084281 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1cdb726b-5570-4861-88e8-e54c65244e9b tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:31.085504 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1cdb726b-5570-4861-88e8-e54c65244e9b tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:31.086402 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1cdb726b-5570-4861-88e8-e54c65244e9b tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:31.128786 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.quota [None req-1cdb726b-5570-4861-88e8-e54c65244e9b tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Getting quotas for project 31e4811f3ecf4ced9941eb882d5eb8ba. Resources: {'instances', 'cores', 'ram'} {{(pid=115748) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:14:31.139732 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.quota [None req-1cdb726b-5570-4861-88e8-e54c65244e9b tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Getting quotas for user c1dc700311c748ba8a56dc4e9e831889 and project 31e4811f3ecf4ced9941eb882d5eb8ba. Resources: {'instances', 'cores', 'ram'} {{(pid=115748) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:14:31.158540 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-1cdb726b-5570-4861-88e8-e54c65244e9b tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Going to run 1 instances... {{(pid=115748) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 01:14:31.163056 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-1cdb726b-5570-4861-88e8-e54c65244e9b tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] [instance: a8c2e462-7829-4a03-bca5-01438c78bca2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3fef3f0d-d772-4999-b764-d6690634a06d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 01:14:31.194262 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-21c34ece-fb07-45c2-aa8e-7fab63f85a64 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:31.202121 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-21c34ece-fb07-45c2-aa8e-7fab63f85a64 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1322 microversion: 2.1 time: 0.366628 Oct 29 01:14:31.207221 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 151/304] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:30 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1322 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:31.216602 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [req-825c0cab-4a1b-48a2-9e01-5d8357889d81 req-c99de518-475a-43aa-9bd5-e763b1e2c3ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d46f88d3-603a-4019-8233-a3a1217bb756", "tag": "e474fbf6-067d-4c7e-9464-2262ab46d614"}]} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:31.224903 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:14:31.224903 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: warnings.warn(msg) Oct 29 01:14:31.241586 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-825c0cab-4a1b-48a2-9e01-5d8357889d81 req-c99de518-475a-43aa-9bd5-e763b1e2c3ab service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:31.242540 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-825c0cab-4a1b-48a2-9e01-5d8357889d81 req-c99de518-475a-43aa-9bd5-e763b1e2c3ab service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:31.250743 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-1cdb726b-5570-4861-88e8-e54c65244e9b tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.096442 Oct 29 01:14:31.251392 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 154/305] 10.222.0.90 () {60 vars in 1146 bytes} [Fri Oct 29 01:14:30 2021] POST /compute/v2.1/servers => generated 380 bytes in 1098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 01:14:31.262004 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-a5b91d85-aa25-4284-b820-be88726f731e tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:31.262743 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-a5b91d85-aa25-4284-b820-be88726f731e tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] [instance: a8c2e462-7829-4a03-bca5-01438c78bca2] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:31.264500 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.compute.server_external_events [req-825c0cab-4a1b-48a2-9e01-5d8357889d81 req-c99de518-475a-43aa-9bd5-e763b1e2c3ab service nova] Creating event network-changed:e474fbf6-067d-4c7e-9464-2262ab46d614 for instance d46f88d3-603a-4019-8233-a3a1217bb756 on hv-cinder-81558 Oct 29 01:14:31.282842 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [req-825c0cab-4a1b-48a2-9e01-5d8357889d81 req-c99de518-475a-43aa-9bd5-e763b1e2c3ab service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074355 Oct 29 01:14:31.283455 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 152/306] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:14:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:14:31.411968 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-a5b91d85-aa25-4284-b820-be88726f731e tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dc700311c748ba8a56dc4e9e831889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e4811f3ecf4ced9941eb882d5eb8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:31.419370 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [req-894eecea-d1f8-47cb-8ab2-eff1603013f4 req-2884c3f3-6a78-44f5-8587-dcfa59ff5aef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd", "tag": "8d56de6a-a409-4dde-8299-b4d26a45fc41"}]} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:31.420850 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:14:31.420850 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: warnings.warn(msg) Oct 29 01:14:31.423284 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-a5b91d85-aa25-4284-b820-be88726f731e tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] 10.222.0.90 "GET /compute/v2.1/servers/a8c2e462-7829-4a03-bca5-01438c78bca2" status: 200 len: 1213 microversion: 2.1 time: 0.163376 Oct 29 01:14:31.424732 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 155/307] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:31 2021] GET /compute/v2.1/servers/a8c2e462-7829-4a03-bca5-01438c78bca2 => generated 1213 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:31.437446 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-894eecea-d1f8-47cb-8ab2-eff1603013f4 req-2884c3f3-6a78-44f5-8587-dcfa59ff5aef service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:31.437827 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-894eecea-d1f8-47cb-8ab2-eff1603013f4 req-2884c3f3-6a78-44f5-8587-dcfa59ff5aef service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:31.467232 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.compute.server_external_events [req-894eecea-d1f8-47cb-8ab2-eff1603013f4 req-2884c3f3-6a78-44f5-8587-dcfa59ff5aef service nova] Creating event network-changed:8d56de6a-a409-4dde-8299-b4d26a45fc41 for instance efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd on hv-cinder-81558 Oct 29 01:14:31.483950 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [req-894eecea-d1f8-47cb-8ab2-eff1603013f4 req-2884c3f3-6a78-44f5-8587-dcfa59ff5aef service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070421 Oct 29 01:14:31.484501 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 153/308] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:14:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:14:31.667499 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-cf5e681e-1629-4294-b5d2-63c9582f53c2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:31.668130 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-cf5e681e-1629-4294-b5d2-63c9582f53c2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:31.675238 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cf5e681e-1629-4294-b5d2-63c9582f53c2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:31.675878 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cf5e681e-1629-4294-b5d2-63c9582f53c2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:31.676962 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cf5e681e-1629-4294-b5d2-63c9582f53c2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:31.678050 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cf5e681e-1629-4294-b5d2-63c9582f53c2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:31.841991 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-99b4dc41-852c-4082-b2c5-fb7feca8cb32 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:31.844575 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-99b4dc41-852c-4082-b2c5-fb7feca8cb32 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:31.851381 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-99b4dc41-852c-4082-b2c5-fb7feca8cb32 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:31.852104 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-99b4dc41-852c-4082-b2c5-fb7feca8cb32 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:31.853092 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-99b4dc41-852c-4082-b2c5-fb7feca8cb32 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:31.853821 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-99b4dc41-852c-4082-b2c5-fb7feca8cb32 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:31.985564 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-99b4dc41-852c-4082-b2c5-fb7feca8cb32 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 200 len: 33199 microversion: 2.20 time: 0.150712 Oct 29 01:14:31.986798 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 154/309] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:14:31 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 33199 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:14:31.999297 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-cf5e681e-1629-4294-b5d2-63c9582f53c2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:32.007341 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-cf5e681e-1629-4294-b5d2-63c9582f53c2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1260 microversion: 2.1 time: 0.343609 Oct 29 01:14:32.010556 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 156/310] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:31 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1260 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:32.224557 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d86793e8-da9c-4ebc-9f34-a6d175711716 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:32.225333 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d86793e8-da9c-4ebc-9f34-a6d175711716 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:32.237345 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d86793e8-da9c-4ebc-9f34-a6d175711716 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:32.237790 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d86793e8-da9c-4ebc-9f34-a6d175711716 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:32.239023 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d86793e8-da9c-4ebc-9f34-a6d175711716 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:32.240139 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d86793e8-da9c-4ebc-9f34-a6d175711716 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:32.405395 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-d86793e8-da9c-4ebc-9f34-a6d175711716 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:32.415963 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d86793e8-da9c-4ebc-9f34-a6d175711716 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1322 microversion: 2.1 time: 0.196077 Oct 29 01:14:32.436244 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 155/311] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:32 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:32.442342 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-7176117c-7172-4320-abb8-57c4fc6283cd tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:32.443724 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-7176117c-7172-4320-abb8-57c4fc6283cd tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] [instance: a8c2e462-7829-4a03-bca5-01438c78bca2] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:32.452508 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7176117c-7172-4320-abb8-57c4fc6283cd tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:32.456122 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7176117c-7172-4320-abb8-57c4fc6283cd tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:32.460097 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7176117c-7172-4320-abb8-57c4fc6283cd tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:32.460645 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7176117c-7172-4320-abb8-57c4fc6283cd tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:32.534584 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-7176117c-7172-4320-abb8-57c4fc6283cd tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dc700311c748ba8a56dc4e9e831889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e4811f3ecf4ced9941eb882d5eb8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:32.546944 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-7176117c-7172-4320-abb8-57c4fc6283cd tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] 10.222.0.90 "GET /compute/v2.1/servers/a8c2e462-7829-4a03-bca5-01438c78bca2" status: 200 len: 1265 microversion: 2.1 time: 0.108963 Oct 29 01:14:32.555263 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 157/312] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:32 2021] GET /compute/v2.1/servers/a8c2e462-7829-4a03-bca5-01438c78bca2 => generated 1265 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:32.998800 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f292f3ba-e038-4d69-ab26-67d0024716e0 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:33.001498 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f292f3ba-e038-4d69-ab26-67d0024716e0 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:33.008090 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f292f3ba-e038-4d69-ab26-67d0024716e0 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:33.009092 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f292f3ba-e038-4d69-ab26-67d0024716e0 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:33.010215 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f292f3ba-e038-4d69-ab26-67d0024716e0 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:33.011394 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f292f3ba-e038-4d69-ab26-67d0024716e0 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:33.025020 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-dd3f72e7-0c5b-463a-8502-cc5b5b58df3b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:33.025732 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-dd3f72e7-0c5b-463a-8502-cc5b5b58df3b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:33.037850 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dd3f72e7-0c5b-463a-8502-cc5b5b58df3b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:33.038605 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dd3f72e7-0c5b-463a-8502-cc5b5b58df3b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:33.039567 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dd3f72e7-0c5b-463a-8502-cc5b5b58df3b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:33.040003 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dd3f72e7-0c5b-463a-8502-cc5b5b58df3b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:33.175583 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-dd3f72e7-0c5b-463a-8502-cc5b5b58df3b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:33.182872 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-dd3f72e7-0c5b-463a-8502-cc5b5b58df3b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1260 microversion: 2.1 time: 0.162270 Oct 29 01:14:33.183437 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 158/313] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:33 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:33.231855 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f292f3ba-e038-4d69-ab26-67d0024716e0 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 200 len: 33648 microversion: 2.20 time: 0.237297 Oct 29 01:14:33.232500 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 156/314] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:14:32 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 33648 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:14:33.438329 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-3d775d48-7381-4731-baee-d936d88ff16b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:33.439287 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-3d775d48-7381-4731-baee-d936d88ff16b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:33.447064 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3d775d48-7381-4731-baee-d936d88ff16b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:33.447771 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3d775d48-7381-4731-baee-d936d88ff16b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:33.448631 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3d775d48-7381-4731-baee-d936d88ff16b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:33.449140 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3d775d48-7381-4731-baee-d936d88ff16b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:33.568708 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f6ac0323-11c8-42f7-982e-776263a48b64 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:33.569422 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f6ac0323-11c8-42f7-982e-776263a48b64 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] [instance: a8c2e462-7829-4a03-bca5-01438c78bca2] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:33.578360 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f6ac0323-11c8-42f7-982e-776263a48b64 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:33.578830 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f6ac0323-11c8-42f7-982e-776263a48b64 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:33.579785 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f6ac0323-11c8-42f7-982e-776263a48b64 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:33.580372 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f6ac0323-11c8-42f7-982e-776263a48b64 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:33.592329 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-3d775d48-7381-4731-baee-d936d88ff16b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:33.608232 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-3d775d48-7381-4731-baee-d936d88ff16b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1322 microversion: 2.1 time: 0.174281 Oct 29 01:14:33.609543 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 159/315] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:33 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:33.730452 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-f6ac0323-11c8-42f7-982e-776263a48b64 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dc700311c748ba8a56dc4e9e831889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e4811f3ecf4ced9941eb882d5eb8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:33.737785 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f6ac0323-11c8-42f7-982e-776263a48b64 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] 10.222.0.90 "GET /compute/v2.1/servers/a8c2e462-7829-4a03-bca5-01438c78bca2" status: 200 len: 1313 microversion: 2.1 time: 0.175251 Oct 29 01:14:33.738332 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 157/316] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:33 2021] GET /compute/v2.1/servers/a8c2e462-7829-4a03-bca5-01438c78bca2 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:34.200676 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2a1af7f0-e603-43d6-9ef5-36514ded8459 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:34.201183 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2a1af7f0-e603-43d6-9ef5-36514ded8459 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:34.207408 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2a1af7f0-e603-43d6-9ef5-36514ded8459 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:34.207877 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2a1af7f0-e603-43d6-9ef5-36514ded8459 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:34.209197 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2a1af7f0-e603-43d6-9ef5-36514ded8459 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:34.209621 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2a1af7f0-e603-43d6-9ef5-36514ded8459 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:34.244553 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-2304d6ba-451f-4707-9d67-170e1ba110a5 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:34.245534 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-2304d6ba-451f-4707-9d67-170e1ba110a5 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:34.253802 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2304d6ba-451f-4707-9d67-170e1ba110a5 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:34.254549 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2304d6ba-451f-4707-9d67-170e1ba110a5 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:34.256066 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2304d6ba-451f-4707-9d67-170e1ba110a5 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:34.256700 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2304d6ba-451f-4707-9d67-170e1ba110a5 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:34.341345 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-2a1af7f0-e603-43d6-9ef5-36514ded8459 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:34.348855 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2a1af7f0-e603-43d6-9ef5-36514ded8459 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1260 microversion: 2.1 time: 0.151884 Oct 29 01:14:34.349421 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 160/317] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:34 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:34.382142 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-2304d6ba-451f-4707-9d67-170e1ba110a5 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 200 len: 34292 microversion: 2.20 time: 0.141080 Oct 29 01:14:34.383072 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 158/318] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:14:34 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 34292 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:14:34.534083 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [req-845784d2-9c44-4093-8548-f255fcaac7be req-7e97ce4c-0319-4f9a-b702-494a691caca8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8c2e462-7829-4a03-bca5-01438c78bca2", "tag": "b2294f48-2709-4187-ba15-9d492bc8e846"}]} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:34.535866 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:14:34.535866 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: warnings.warn(msg) Oct 29 01:14:34.544636 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-845784d2-9c44-4093-8548-f255fcaac7be req-7e97ce4c-0319-4f9a-b702-494a691caca8 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:34.545366 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-845784d2-9c44-4093-8548-f255fcaac7be req-7e97ce4c-0319-4f9a-b702-494a691caca8 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:34.557641 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.compute.server_external_events [req-845784d2-9c44-4093-8548-f255fcaac7be req-7e97ce4c-0319-4f9a-b702-494a691caca8 service nova] Creating event network-changed:b2294f48-2709-4187-ba15-9d492bc8e846 for instance a8c2e462-7829-4a03-bca5-01438c78bca2 on hv-cinder-81558 Oct 29 01:14:34.562229 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [req-845784d2-9c44-4093-8548-f255fcaac7be req-7e97ce4c-0319-4f9a-b702-494a691caca8 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033011 Oct 29 01:14:34.562936 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 161/319] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:14:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:14:34.625425 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-7deb4d4c-2e02-461c-872e-1907848dc8c1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:34.626683 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-7deb4d4c-2e02-461c-872e-1907848dc8c1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:34.633107 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7deb4d4c-2e02-461c-872e-1907848dc8c1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:34.633554 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7deb4d4c-2e02-461c-872e-1907848dc8c1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:34.634322 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7deb4d4c-2e02-461c-872e-1907848dc8c1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:34.634779 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7deb4d4c-2e02-461c-872e-1907848dc8c1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:34.757192 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-af6e3554-dca6-4885-a771-60b6d97577b4 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:34.758264 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-af6e3554-dca6-4885-a771-60b6d97577b4 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] [instance: a8c2e462-7829-4a03-bca5-01438c78bca2] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:34.758373 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-7deb4d4c-2e02-461c-872e-1907848dc8c1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:34.771470 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-af6e3554-dca6-4885-a771-60b6d97577b4 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:34.771651 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-7deb4d4c-2e02-461c-872e-1907848dc8c1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1322 microversion: 2.1 time: 0.150069 Oct 29 01:14:34.772553 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-af6e3554-dca6-4885-a771-60b6d97577b4 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:34.772673 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 159/320] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:34 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:34.773607 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-af6e3554-dca6-4885-a771-60b6d97577b4 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:34.774044 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-af6e3554-dca6-4885-a771-60b6d97577b4 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:34.901484 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-af6e3554-dca6-4885-a771-60b6d97577b4 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dc700311c748ba8a56dc4e9e831889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e4811f3ecf4ced9941eb882d5eb8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:34.910632 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-af6e3554-dca6-4885-a771-60b6d97577b4 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] 10.222.0.90 "GET /compute/v2.1/servers/a8c2e462-7829-4a03-bca5-01438c78bca2" status: 200 len: 1313 microversion: 2.1 time: 0.159249 Oct 29 01:14:34.911748 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 162/321] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:34 2021] GET /compute/v2.1/servers/a8c2e462-7829-4a03-bca5-01438c78bca2 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:35.364943 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-48254b3f-c03f-4a6e-a75d-ae5719d1a9d4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:35.365539 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-48254b3f-c03f-4a6e-a75d-ae5719d1a9d4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:35.372292 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-48254b3f-c03f-4a6e-a75d-ae5719d1a9d4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:35.372732 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-48254b3f-c03f-4a6e-a75d-ae5719d1a9d4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:35.373651 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-48254b3f-c03f-4a6e-a75d-ae5719d1a9d4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:35.374081 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-48254b3f-c03f-4a6e-a75d-ae5719d1a9d4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:35.392994 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-77393ebd-cdd7-4799-ab14-1db163622c4a tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:35.393964 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-77393ebd-cdd7-4799-ab14-1db163622c4a tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:35.401998 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-77393ebd-cdd7-4799-ab14-1db163622c4a tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:35.402834 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-77393ebd-cdd7-4799-ab14-1db163622c4a tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:35.403619 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-77393ebd-cdd7-4799-ab14-1db163622c4a tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:35.404052 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-77393ebd-cdd7-4799-ab14-1db163622c4a tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:35.514639 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-48254b3f-c03f-4a6e-a75d-ae5719d1a9d4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:35.523302 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-77393ebd-cdd7-4799-ab14-1db163622c4a tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 200 len: 34951 microversion: 2.20 time: 0.133750 Oct 29 01:14:35.524094 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 163/322] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:14:35 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 34951 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:14:35.527127 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-48254b3f-c03f-4a6e-a75d-ae5719d1a9d4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1260 microversion: 2.1 time: 0.165810 Oct 29 01:14:35.527971 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 160/323] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:35 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:35.710384 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [req-4c27fbf0-e778-4d7e-b0d9-8a99bac0c602 req-c9a1b310-10b5-46c6-ab56-6b6c76379a35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ff6277c-b59e-467c-82d4-631046fb03d9", "name": "network-vif-plugged", "status": "completed", "tag": "087af4cc-fcd8-4ae5-a1ad-de9edef4df73"}]} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:35.712170 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:14:35.712170 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: warnings.warn(msg) Oct 29 01:14:35.719982 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-4c27fbf0-e778-4d7e-b0d9-8a99bac0c602 req-c9a1b310-10b5-46c6-ab56-6b6c76379a35 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:35.720476 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-4c27fbf0-e778-4d7e-b0d9-8a99bac0c602 req-c9a1b310-10b5-46c6-ab56-6b6c76379a35 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:35.733120 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.compute.server_external_events [req-4c27fbf0-e778-4d7e-b0d9-8a99bac0c602 req-c9a1b310-10b5-46c6-ab56-6b6c76379a35 service nova] Creating event network-vif-plugged:087af4cc-fcd8-4ae5-a1ad-de9edef4df73 for instance 0ff6277c-b59e-467c-82d4-631046fb03d9 on hv-cinder-81558 Oct 29 01:14:35.738199 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [req-4c27fbf0-e778-4d7e-b0d9-8a99bac0c602 req-c9a1b310-10b5-46c6-ab56-6b6c76379a35 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032375 Oct 29 01:14:35.738875 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 164/324] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:14:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:14:35.788409 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-612ca5af-d6ad-44a8-832a-474fb1cb437d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:35.789034 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-612ca5af-d6ad-44a8-832a-474fb1cb437d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:35.795397 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-612ca5af-d6ad-44a8-832a-474fb1cb437d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:35.795999 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-612ca5af-d6ad-44a8-832a-474fb1cb437d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:35.796778 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-612ca5af-d6ad-44a8-832a-474fb1cb437d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:35.797211 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-612ca5af-d6ad-44a8-832a-474fb1cb437d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:35.929269 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-79a98ee6-7c3b-4bda-8475-8e977fdc2358 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:35.929967 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-79a98ee6-7c3b-4bda-8475-8e977fdc2358 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] [instance: a8c2e462-7829-4a03-bca5-01438c78bca2] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:35.935540 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-612ca5af-d6ad-44a8-832a-474fb1cb437d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:35.936222 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-79a98ee6-7c3b-4bda-8475-8e977fdc2358 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:35.936698 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-79a98ee6-7c3b-4bda-8475-8e977fdc2358 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:35.937476 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-79a98ee6-7c3b-4bda-8475-8e977fdc2358 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:35.937915 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-79a98ee6-7c3b-4bda-8475-8e977fdc2358 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:35.951561 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-612ca5af-d6ad-44a8-832a-474fb1cb437d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1322 microversion: 2.1 time: 0.166790 Oct 29 01:14:35.956157 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 161/325] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:35 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:36.069306 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-79a98ee6-7c3b-4bda-8475-8e977fdc2358 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dc700311c748ba8a56dc4e9e831889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e4811f3ecf4ced9941eb882d5eb8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:36.076848 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-79a98ee6-7c3b-4bda-8475-8e977fdc2358 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] 10.222.0.90 "GET /compute/v2.1/servers/a8c2e462-7829-4a03-bca5-01438c78bca2" status: 200 len: 1313 microversion: 2.1 time: 0.152560 Oct 29 01:14:36.077454 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 165/326] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:35 2021] GET /compute/v2.1/servers/a8c2e462-7829-4a03-bca5-01438c78bca2 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:36.534720 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-fe1c89f5-5a21-4950-be83-0870649d3a2d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:36.535538 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-fe1c89f5-5a21-4950-be83-0870649d3a2d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:36.543740 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-1d604330-d4c4-47a8-b1e1-6c63bd8eaac4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:36.544027 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fe1c89f5-5a21-4950-be83-0870649d3a2d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:36.544527 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fe1c89f5-5a21-4950-be83-0870649d3a2d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:36.544653 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-1d604330-d4c4-47a8-b1e1-6c63bd8eaac4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:36.545219 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fe1c89f5-5a21-4950-be83-0870649d3a2d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:36.545643 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fe1c89f5-5a21-4950-be83-0870649d3a2d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:36.552022 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1d604330-d4c4-47a8-b1e1-6c63bd8eaac4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:36.552974 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1d604330-d4c4-47a8-b1e1-6c63bd8eaac4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:36.554011 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1d604330-d4c4-47a8-b1e1-6c63bd8eaac4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:36.554547 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1d604330-d4c4-47a8-b1e1-6c63bd8eaac4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:36.691397 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-1d604330-d4c4-47a8-b1e1-6c63bd8eaac4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:36.700521 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-1d604330-d4c4-47a8-b1e1-6c63bd8eaac4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1260 microversion: 2.1 time: 0.160372 Oct 29 01:14:36.701258 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 166/327] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:36 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:36.843305 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-fe1c89f5-5a21-4950-be83-0870649d3a2d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 200 len: 35609 microversion: 2.20 time: 0.311969 Oct 29 01:14:36.844143 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 162/328] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:14:36 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 35609 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:14:36.968388 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-a3118d35-9afb-48db-a964-6dadf27b323f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:36.968994 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-a3118d35-9afb-48db-a964-6dadf27b323f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:36.975766 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a3118d35-9afb-48db-a964-6dadf27b323f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:36.976219 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a3118d35-9afb-48db-a964-6dadf27b323f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:36.977006 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a3118d35-9afb-48db-a964-6dadf27b323f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:36.977436 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a3118d35-9afb-48db-a964-6dadf27b323f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:37.095618 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-79334d4e-932e-4881-a9ad-f02de331c1e9 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:37.096232 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-79334d4e-932e-4881-a9ad-f02de331c1e9 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] [instance: a8c2e462-7829-4a03-bca5-01438c78bca2] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:37.104044 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-79334d4e-932e-4881-a9ad-f02de331c1e9 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:37.104490 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-79334d4e-932e-4881-a9ad-f02de331c1e9 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:37.105265 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-79334d4e-932e-4881-a9ad-f02de331c1e9 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:37.105688 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-79334d4e-932e-4881-a9ad-f02de331c1e9 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:37.390543 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-a3118d35-9afb-48db-a964-6dadf27b323f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:37.397012 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-79334d4e-932e-4881-a9ad-f02de331c1e9 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dc700311c748ba8a56dc4e9e831889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e4811f3ecf4ced9941eb882d5eb8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:37.398288 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-a3118d35-9afb-48db-a964-6dadf27b323f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1322 microversion: 2.1 time: 0.433527 Oct 29 01:14:37.398896 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 167/329] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:36 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1322 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:37.405277 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-79334d4e-932e-4881-a9ad-f02de331c1e9 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] 10.222.0.90 "GET /compute/v2.1/servers/a8c2e462-7829-4a03-bca5-01438c78bca2" status: 200 len: 1313 microversion: 2.1 time: 0.313750 Oct 29 01:14:37.405816 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 163/330] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:37 2021] GET /compute/v2.1/servers/a8c2e462-7829-4a03-bca5-01438c78bca2 => generated 1313 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:37.717189 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-5abcb253-45ed-49ac-a72d-dbe529abae20 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:37.717760 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-5abcb253-45ed-49ac-a72d-dbe529abae20 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:37.723964 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5abcb253-45ed-49ac-a72d-dbe529abae20 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:37.724400 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5abcb253-45ed-49ac-a72d-dbe529abae20 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:37.725155 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5abcb253-45ed-49ac-a72d-dbe529abae20 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:37.725582 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5abcb253-45ed-49ac-a72d-dbe529abae20 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:37.856369 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-69630244-dafe-49de-8858-80445a2f7a91 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:37.857601 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-69630244-dafe-49de-8858-80445a2f7a91 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:37.872255 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-69630244-dafe-49de-8858-80445a2f7a91 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:37.872974 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-69630244-dafe-49de-8858-80445a2f7a91 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:37.873959 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-69630244-dafe-49de-8858-80445a2f7a91 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:37.875164 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-69630244-dafe-49de-8858-80445a2f7a91 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:37.902218 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-5abcb253-45ed-49ac-a72d-dbe529abae20 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:37.912603 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-5abcb253-45ed-49ac-a72d-dbe529abae20 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1260 microversion: 2.1 time: 0.196890 Oct 29 01:14:37.912603 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 168/331] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:37 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1260 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:38.022562 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-69630244-dafe-49de-8858-80445a2f7a91 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 200 len: 37633 microversion: 2.20 time: 0.170333 Oct 29 01:14:38.023548 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 164/332] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:14:37 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 37633 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:14:38.028562 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-8c468acc-7ae1-439b-98df-ea674d3aa28e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c4bf855-9aeb-4766-b2cd-036dfc73ee66"}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:38.029668 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-8c468acc-7ae1-439b-98df-ea674d3aa28e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: d5eacee8-861b-453e-bdec-260c354bc942] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:38.036441 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8c468acc-7ae1-439b-98df-ea674d3aa28e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:38.036895 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8c468acc-7ae1-439b-98df-ea674d3aa28e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:38.037658 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8c468acc-7ae1-439b-98df-ea674d3aa28e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:38.038146 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8c468acc-7ae1-439b-98df-ea674d3aa28e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:38.115368 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.wsgi [None req-8c468acc-7ae1-439b-98df-ea674d3aa28e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] HTTP exception thrown: Invalid volume: volume 7c4bf855-9aeb-4766-b2cd-036dfc73ee66 is already attached to instances: d5eacee8-861b-453e-bdec-260c354bc942 Oct 29 01:14:38.116485 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-8c468acc-7ae1-439b-98df-ea674d3aa28e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Returning 400 to user: Invalid volume: volume 7c4bf855-9aeb-4766-b2cd-036dfc73ee66 is already attached to instances: d5eacee8-861b-453e-bdec-260c354bc942 {{(pid=115748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:14:38.117534 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-8c468acc-7ae1-439b-98df-ea674d3aa28e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "POST /compute/v2.1/servers/d5eacee8-861b-453e-bdec-260c354bc942/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.092766 Oct 29 01:14:38.118455 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 169/333] 10.222.0.90 () {60 vars in 1322 bytes} [Fri Oct 29 01:14:38 2021] POST /compute/v2.1/servers/d5eacee8-861b-453e-bdec-260c354bc942/os-volume_attachments => generated 174 bytes in 94 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:14:38.179907 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-24eff6bd-5ee4-4b72-8b24-1d14b2402396 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:38.180518 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-24eff6bd-5ee4-4b72-8b24-1d14b2402396 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: d5eacee8-861b-453e-bdec-260c354bc942] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:38.187221 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-24eff6bd-5ee4-4b72-8b24-1d14b2402396 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:38.187666 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-24eff6bd-5ee4-4b72-8b24-1d14b2402396 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:38.188421 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-24eff6bd-5ee4-4b72-8b24-1d14b2402396 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:38.188853 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-24eff6bd-5ee4-4b72-8b24-1d14b2402396 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:38.313344 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.objects.instance [None req-24eff6bd-5ee4-4b72-8b24-1d14b2402396 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lazy-loading 'services' on Instance uuid d5eacee8-861b-453e-bdec-260c354bc942 {{(pid=115747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:14:38.414883 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-a9d93605-962c-43c4-ad2c-829d849665d1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:38.415483 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-a9d93605-962c-43c4-ad2c-829d849665d1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:38.424449 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a9d93605-962c-43c4-ad2c-829d849665d1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:38.424901 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a9d93605-962c-43c4-ad2c-829d849665d1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:38.425661 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a9d93605-962c-43c4-ad2c-829d849665d1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:38.426091 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a9d93605-962c-43c4-ad2c-829d849665d1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:38.428686 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-24eff6bd-5ee4-4b72-8b24-1d14b2402396 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "DELETE /compute/v2.1/servers/d5eacee8-861b-453e-bdec-260c354bc942/os-volume_attachments/7c4bf855-9aeb-4766-b2cd-036dfc73ee66" status: 202 len: 0 microversion: 2.1 time: 0.252772 Oct 29 01:14:38.429424 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 165/334] 10.222.0.90 () {58 vars in 1415 bytes} [Fri Oct 29 01:14:38 2021] DELETE /compute/v2.1/servers/d5eacee8-861b-453e-bdec-260c354bc942/os-volume_attachments/7c4bf855-9aeb-4766-b2cd-036dfc73ee66 => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:14:38.434478 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-7513afef-8373-41e4-ad4b-e4896c38775c tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:38.435171 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-7513afef-8373-41e4-ad4b-e4896c38775c tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] [instance: a8c2e462-7829-4a03-bca5-01438c78bca2] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:38.441480 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7513afef-8373-41e4-ad4b-e4896c38775c tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:38.441651 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7513afef-8373-41e4-ad4b-e4896c38775c tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:38.442871 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7513afef-8373-41e4-ad4b-e4896c38775c tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:38.443300 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7513afef-8373-41e4-ad4b-e4896c38775c tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:38.610997 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-a9d93605-962c-43c4-ad2c-829d849665d1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:38.618679 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-a9d93605-962c-43c4-ad2c-829d849665d1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1322 microversion: 2.1 time: 0.207314 Oct 29 01:14:38.619788 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 170/335] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:38 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:38.623503 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-7513afef-8373-41e4-ad4b-e4896c38775c tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dc700311c748ba8a56dc4e9e831889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e4811f3ecf4ced9941eb882d5eb8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:38.626992 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-ab3a8496-21dd-48e1-ab28-3521b7d1688d tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:38.628042 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-ab3a8496-21dd-48e1-ab28-3521b7d1688d tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: d5eacee8-861b-453e-bdec-260c354bc942] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:38.635063 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ab3a8496-21dd-48e1-ab28-3521b7d1688d tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:38.635590 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ab3a8496-21dd-48e1-ab28-3521b7d1688d tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:38.635771 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-7513afef-8373-41e4-ad4b-e4896c38775c tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] 10.222.0.90 "GET /compute/v2.1/servers/a8c2e462-7829-4a03-bca5-01438c78bca2" status: 200 len: 1313 microversion: 2.1 time: 0.204996 Oct 29 01:14:38.636713 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 166/336] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:38 2021] GET /compute/v2.1/servers/a8c2e462-7829-4a03-bca5-01438c78bca2 => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:38.636833 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ab3a8496-21dd-48e1-ab28-3521b7d1688d tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:38.637096 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ab3a8496-21dd-48e1-ab28-3521b7d1688d tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:38.668341 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-ab3a8496-21dd-48e1-ab28-3521b7d1688d tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/d5eacee8-861b-453e-bdec-260c354bc942/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046412 Oct 29 01:14:38.668809 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 171/337] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:14:38 2021] GET /compute/v2.1/servers/d5eacee8-861b-453e-bdec-260c354bc942/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:14:38.927673 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9d3fce4b-17a5-4a5a-b0cb-31bc6f39fc05 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:38.928228 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9d3fce4b-17a5-4a5a-b0cb-31bc6f39fc05 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:38.934314 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9d3fce4b-17a5-4a5a-b0cb-31bc6f39fc05 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:38.934784 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9d3fce4b-17a5-4a5a-b0cb-31bc6f39fc05 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:38.935558 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9d3fce4b-17a5-4a5a-b0cb-31bc6f39fc05 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:38.935982 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9d3fce4b-17a5-4a5a-b0cb-31bc6f39fc05 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:39.034318 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-bf6b28a1-1589-49d7-8579-ae41823f46d2 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:39.035255 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-bf6b28a1-1589-49d7-8579-ae41823f46d2 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:39.041882 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bf6b28a1-1589-49d7-8579-ae41823f46d2 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:39.042328 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bf6b28a1-1589-49d7-8579-ae41823f46d2 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:39.043116 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bf6b28a1-1589-49d7-8579-ae41823f46d2 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:39.043546 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bf6b28a1-1589-49d7-8579-ae41823f46d2 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:39.055614 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-9d3fce4b-17a5-4a5a-b0cb-31bc6f39fc05 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:39.062936 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9d3fce4b-17a5-4a5a-b0cb-31bc6f39fc05 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1260 microversion: 2.1 time: 0.138953 Oct 29 01:14:39.063586 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 167/338] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:38 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1260 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:39.204505 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-bf6b28a1-1589-49d7-8579-ae41823f46d2 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 200 len: 38139 microversion: 2.20 time: 0.173584 Oct 29 01:14:39.205074 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 172/339] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:14:39 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 38139 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:14:39.497093 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [req-f9b4e804-179b-4a37-b67d-62abad26e36b req-a98c55c8-b0ea-4b6e-ba3a-a0fe4f67b2a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d46f88d3-603a-4019-8233-a3a1217bb756", "name": "network-vif-plugged", "status": "completed", "tag": "e474fbf6-067d-4c7e-9464-2262ab46d614"}]} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:39.499352 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:14:39.499352 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: warnings.warn(msg) Oct 29 01:14:39.507824 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-f9b4e804-179b-4a37-b67d-62abad26e36b req-a98c55c8-b0ea-4b6e-ba3a-a0fe4f67b2a5 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:39.508264 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-f9b4e804-179b-4a37-b67d-62abad26e36b req-a98c55c8-b0ea-4b6e-ba3a-a0fe4f67b2a5 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:39.518949 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.compute.server_external_events [req-f9b4e804-179b-4a37-b67d-62abad26e36b req-a98c55c8-b0ea-4b6e-ba3a-a0fe4f67b2a5 service nova] Creating event network-vif-plugged:e474fbf6-067d-4c7e-9464-2262ab46d614 for instance d46f88d3-603a-4019-8233-a3a1217bb756 on hv-cinder-81558 Oct 29 01:14:39.523638 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [req-f9b4e804-179b-4a37-b67d-62abad26e36b req-a98c55c8-b0ea-4b6e-ba3a-a0fe4f67b2a5 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030185 Oct 29 01:14:39.524239 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 168/340] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:14:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:14:39.637379 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-8b90a624-1bdd-4c55-af08-bd05589a9ba0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:39.638214 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-8b90a624-1bdd-4c55-af08-bd05589a9ba0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:39.645357 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8b90a624-1bdd-4c55-af08-bd05589a9ba0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:39.645817 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8b90a624-1bdd-4c55-af08-bd05589a9ba0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:39.646646 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8b90a624-1bdd-4c55-af08-bd05589a9ba0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:39.647074 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8b90a624-1bdd-4c55-af08-bd05589a9ba0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:39.653782 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-1effb5ce-3a65-4765-8654-125546c3cc3e tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:39.654581 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-1effb5ce-3a65-4765-8654-125546c3cc3e tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] [instance: a8c2e462-7829-4a03-bca5-01438c78bca2] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:39.660625 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1effb5ce-3a65-4765-8654-125546c3cc3e tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:39.661816 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1effb5ce-3a65-4765-8654-125546c3cc3e tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:39.662695 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1effb5ce-3a65-4765-8654-125546c3cc3e tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:39.663195 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1effb5ce-3a65-4765-8654-125546c3cc3e tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:39.855212 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-8b90a624-1bdd-4c55-af08-bd05589a9ba0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:39.857774 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-1effb5ce-3a65-4765-8654-125546c3cc3e tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dc700311c748ba8a56dc4e9e831889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e4811f3ecf4ced9941eb882d5eb8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:39.863866 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-8b90a624-1bdd-4c55-af08-bd05589a9ba0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1322 microversion: 2.1 time: 0.231014 Oct 29 01:14:39.865206 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 173/341] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:39 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:39.867142 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-1effb5ce-3a65-4765-8654-125546c3cc3e tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] 10.222.0.90 "GET /compute/v2.1/servers/a8c2e462-7829-4a03-bca5-01438c78bca2" status: 200 len: 1313 microversion: 2.1 time: 0.217582 Oct 29 01:14:39.867977 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 169/342] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:39 2021] GET /compute/v2.1/servers/a8c2e462-7829-4a03-bca5-01438c78bca2 => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:39.870181 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2c11689c-fba8-465c-99f7-7c2a51790733 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:39.871118 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2c11689c-fba8-465c-99f7-7c2a51790733 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: d5eacee8-861b-453e-bdec-260c354bc942] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:39.877846 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2c11689c-fba8-465c-99f7-7c2a51790733 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:39.878311 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2c11689c-fba8-465c-99f7-7c2a51790733 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:39.879240 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2c11689c-fba8-465c-99f7-7c2a51790733 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:39.880088 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2c11689c-fba8-465c-99f7-7c2a51790733 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:39.912656 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2c11689c-fba8-465c-99f7-7c2a51790733 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/d5eacee8-861b-453e-bdec-260c354bc942/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046275 Oct 29 01:14:39.913426 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 174/343] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:14:39 2021] GET /compute/v2.1/servers/d5eacee8-861b-453e-bdec-260c354bc942/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:14:40.053967 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-11aeee35-4d3b-46d8-80d6-24cc347186bd tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-822960626", "imageRef": "3fef3f0d-d772-4999-b764-d6690634a06d", "flavorRef": "452", "networks": [{"uuid": "04819660-923b-4a69-94a5-8390cbffb752"}]}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:40.079029 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-1a18d0cc-4935-49a6-a794-700ff76ffa21 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:40.079641 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-1a18d0cc-4935-49a6-a794-700ff76ffa21 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:40.085794 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1a18d0cc-4935-49a6-a794-700ff76ffa21 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:40.086562 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1a18d0cc-4935-49a6-a794-700ff76ffa21 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:40.087330 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1a18d0cc-4935-49a6-a794-700ff76ffa21 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:40.087765 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1a18d0cc-4935-49a6-a794-700ff76ffa21 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:40.105103 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.network.neutron [None req-11aeee35-4d3b-46d8-80d6-24cc347186bd tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] validate_networks() for [('04819660-923b-4a69-94a5-8390cbffb752', None, None, None, None, None)] {{(pid=115747) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 01:14:40.305217 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-1a18d0cc-4935-49a6-a794-700ff76ffa21 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:40.313829 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-1a18d0cc-4935-49a6-a794-700ff76ffa21 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1260 microversion: 2.1 time: 0.238260 Oct 29 01:14:40.314427 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 175/344] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:40 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1260 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:40.326421 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-74e30270-c4f6-4482-8e52-b91c32e82329 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:40.327357 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-74e30270-c4f6-4482-8e52-b91c32e82329 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:40.333450 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-74e30270-c4f6-4482-8e52-b91c32e82329 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:40.334916 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-74e30270-c4f6-4482-8e52-b91c32e82329 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:40.335697 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-74e30270-c4f6-4482-8e52-b91c32e82329 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:40.336393 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-74e30270-c4f6-4482-8e52-b91c32e82329 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:40.468949 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-74e30270-c4f6-4482-8e52-b91c32e82329 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 200 len: 38139 microversion: 2.20 time: 0.153289 Oct 29 01:14:40.473028 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 176/345] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:14:40 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 38139 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:14:40.523980 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-11aeee35-4d3b-46d8-80d6-24cc347186bd tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Flavor limits 0:0:0 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:14:40.524400 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-11aeee35-4d3b-46d8-80d6-24cc347186bd tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Image limits 0:0:0 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:14:40.524863 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-11aeee35-4d3b-46d8-80d6-24cc347186bd tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Flavor pref 0:0:0 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:14:40.525266 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-11aeee35-4d3b-46d8-80d6-24cc347186bd tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Image pref 0:0:0 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:14:40.525666 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-11aeee35-4d3b-46d8-80d6-24cc347186bd tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:14:40.534653 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-11aeee35-4d3b-46d8-80d6-24cc347186bd tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:40.535092 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-11aeee35-4d3b-46d8-80d6-24cc347186bd tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:40.536518 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-11aeee35-4d3b-46d8-80d6-24cc347186bd tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:40.536951 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-11aeee35-4d3b-46d8-80d6-24cc347186bd tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:40.552709 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.quota [None req-11aeee35-4d3b-46d8-80d6-24cc347186bd tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Getting quotas for project 355f0948092d4f3c929575a405284599. Resources: {'instances', 'cores', 'ram'} {{(pid=115747) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:14:40.556707 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.quota [None req-11aeee35-4d3b-46d8-80d6-24cc347186bd tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Getting quotas for user 8fe86a50674f4837bfcb81170f5fd253 and project 355f0948092d4f3c929575a405284599. Resources: {'instances', 'cores', 'ram'} {{(pid=115747) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:14:40.567114 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-11aeee35-4d3b-46d8-80d6-24cc347186bd tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Going to run 1 instances... {{(pid=115747) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 01:14:40.569446 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-11aeee35-4d3b-46d8-80d6-24cc347186bd tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 7add95a5-9fb0-4c27-8836-5f24f8c0113f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3fef3f0d-d772-4999-b764-d6690634a06d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 01:14:40.620108 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-11aeee35-4d3b-46d8-80d6-24cc347186bd tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.570766 Oct 29 01:14:40.620743 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 170/346] 10.222.0.90 () {60 vars in 1146 bytes} [Fri Oct 29 01:14:40 2021] POST /compute/v2.1/servers => generated 380 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:14:40.631300 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-5eca372b-2d28-459c-9830-76289695f124 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:40.632215 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-5eca372b-2d28-459c-9830-76289695f124 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 7add95a5-9fb0-4c27-8836-5f24f8c0113f] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:40.689199 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-5eca372b-2d28-459c-9830-76289695f124 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:40.696589 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-5eca372b-2d28-459c-9830-76289695f124 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f" status: 200 len: 1217 microversion: 2.1 time: 0.069798 Oct 29 01:14:40.697165 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 177/347] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:40 2021] GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f => generated 1217 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:40.881420 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-e0ff819f-20e1-4cbd-912e-778ef7a5a0f7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:40.882023 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-e0ff819f-20e1-4cbd-912e-778ef7a5a0f7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:40.888041 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e0ff819f-20e1-4cbd-912e-778ef7a5a0f7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:40.888493 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e0ff819f-20e1-4cbd-912e-778ef7a5a0f7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:40.889253 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e0ff819f-20e1-4cbd-912e-778ef7a5a0f7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:40.889682 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e0ff819f-20e1-4cbd-912e-778ef7a5a0f7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:40.891437 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-503961ee-a877-4652-b415-06d92cb138b7 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:40.892084 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-503961ee-a877-4652-b415-06d92cb138b7 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] [instance: a8c2e462-7829-4a03-bca5-01438c78bca2] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:40.902171 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-503961ee-a877-4652-b415-06d92cb138b7 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:40.902655 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-503961ee-a877-4652-b415-06d92cb138b7 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:40.903456 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-503961ee-a877-4652-b415-06d92cb138b7 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:40.903894 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-503961ee-a877-4652-b415-06d92cb138b7 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:41.094627 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-e0ff819f-20e1-4cbd-912e-778ef7a5a0f7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:41.102099 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-e0ff819f-20e1-4cbd-912e-778ef7a5a0f7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1322 microversion: 2.1 time: 0.224916 Oct 29 01:14:41.102688 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 171/348] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:40 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:41.107078 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-503961ee-a877-4652-b415-06d92cb138b7 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dc700311c748ba8a56dc4e9e831889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e4811f3ecf4ced9941eb882d5eb8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:41.115344 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-503961ee-a877-4652-b415-06d92cb138b7 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] 10.222.0.90 "GET /compute/v2.1/servers/a8c2e462-7829-4a03-bca5-01438c78bca2" status: 200 len: 1313 microversion: 2.1 time: 0.228857 Oct 29 01:14:41.115906 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 178/349] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:40 2021] GET /compute/v2.1/servers/a8c2e462-7829-4a03-bca5-01438c78bca2 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:41.329992 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-7635f928-a348-4d56-8b3d-058625fb7a39 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:41.330617 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-7635f928-a348-4d56-8b3d-058625fb7a39 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:41.336611 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7635f928-a348-4d56-8b3d-058625fb7a39 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:41.337051 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7635f928-a348-4d56-8b3d-058625fb7a39 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:41.337798 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7635f928-a348-4d56-8b3d-058625fb7a39 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:41.338222 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7635f928-a348-4d56-8b3d-058625fb7a39 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:41.459805 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-7635f928-a348-4d56-8b3d-058625fb7a39 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:41.467480 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-7635f928-a348-4d56-8b3d-058625fb7a39 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1260 microversion: 2.1 time: 0.141169 Oct 29 01:14:41.468055 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 172/350] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:41 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1260 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:41.482267 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-ff2b25bb-d467-4131-844a-469280b16a62 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:41.483264 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-ff2b25bb-d467-4131-844a-469280b16a62 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:41.489618 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ff2b25bb-d467-4131-844a-469280b16a62 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:41.490690 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ff2b25bb-d467-4131-844a-469280b16a62 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:41.491644 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ff2b25bb-d467-4131-844a-469280b16a62 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:41.492062 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ff2b25bb-d467-4131-844a-469280b16a62 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:41.561905 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [req-da8ab6aa-9f77-4bfa-ae52-32f56d66788e req-2fe5b119-c4a4-4810-91a2-c2a448a56a64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8c2e462-7829-4a03-bca5-01438c78bca2", "name": "network-vif-plugged", "status": "completed", "tag": "b2294f48-2709-4187-ba15-9d492bc8e846"}]} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:41.564101 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:14:41.564101 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: warnings.warn(msg) Oct 29 01:14:41.572113 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-da8ab6aa-9f77-4bfa-ae52-32f56d66788e req-2fe5b119-c4a4-4810-91a2-c2a448a56a64 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:41.572668 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-da8ab6aa-9f77-4bfa-ae52-32f56d66788e req-2fe5b119-c4a4-4810-91a2-c2a448a56a64 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:41.586368 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.compute.server_external_events [req-da8ab6aa-9f77-4bfa-ae52-32f56d66788e req-2fe5b119-c4a4-4810-91a2-c2a448a56a64 service nova] Creating event network-vif-plugged:b2294f48-2709-4187-ba15-9d492bc8e846 for instance a8c2e462-7829-4a03-bca5-01438c78bca2 on hv-cinder-81558 Oct 29 01:14:41.592132 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [req-da8ab6aa-9f77-4bfa-ae52-32f56d66788e req-2fe5b119-c4a4-4810-91a2-c2a448a56a64 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034984 Oct 29 01:14:41.593017 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 173/351] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:14:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:14:41.714114 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-edb6ecec-b863-4fca-b953-86d0e12f2fe1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:41.714801 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-edb6ecec-b863-4fca-b953-86d0e12f2fe1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 7add95a5-9fb0-4c27-8836-5f24f8c0113f] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:41.720723 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-edb6ecec-b863-4fca-b953-86d0e12f2fe1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:41.721166 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-edb6ecec-b863-4fca-b953-86d0e12f2fe1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:41.721927 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-edb6ecec-b863-4fca-b953-86d0e12f2fe1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:41.722362 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-edb6ecec-b863-4fca-b953-86d0e12f2fe1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:41.730802 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-ff2b25bb-d467-4131-844a-469280b16a62 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 200 len: 38139 microversion: 2.20 time: 0.252124 Oct 29 01:14:41.732000 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 179/352] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:14:41 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 38139 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:14:41.804252 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-edb6ecec-b863-4fca-b953-86d0e12f2fe1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:41.813242 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-edb6ecec-b863-4fca-b953-86d0e12f2fe1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f" status: 200 len: 1269 microversion: 2.1 time: 0.103448 Oct 29 01:14:41.813825 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 174/353] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:41 2021] GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f => generated 1269 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:42.120683 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-36fd2c0a-0650-4080-8404-21d86088e138 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:42.121381 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-36fd2c0a-0650-4080-8404-21d86088e138 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:42.128293 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-36fd2c0a-0650-4080-8404-21d86088e138 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:42.128748 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-36fd2c0a-0650-4080-8404-21d86088e138 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:42.129571 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-36fd2c0a-0650-4080-8404-21d86088e138 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:42.130010 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-36fd2c0a-0650-4080-8404-21d86088e138 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:42.132303 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-86e23ef2-898d-45d5-9730-59d525fa830c tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:42.132913 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-86e23ef2-898d-45d5-9730-59d525fa830c tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] [instance: a8c2e462-7829-4a03-bca5-01438c78bca2] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:42.138571 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-86e23ef2-898d-45d5-9730-59d525fa830c tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:42.139014 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-86e23ef2-898d-45d5-9730-59d525fa830c tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:42.139771 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-86e23ef2-898d-45d5-9730-59d525fa830c tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:42.140200 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-86e23ef2-898d-45d5-9730-59d525fa830c tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:42.309589 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-36fd2c0a-0650-4080-8404-21d86088e138 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:42.315556 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-86e23ef2-898d-45d5-9730-59d525fa830c tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dc700311c748ba8a56dc4e9e831889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e4811f3ecf4ced9941eb882d5eb8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:42.317500 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-36fd2c0a-0650-4080-8404-21d86088e138 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1515 microversion: 2.1 time: 0.200808 Oct 29 01:14:42.318109 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 180/354] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:42 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1515 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:42.322632 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-86e23ef2-898d-45d5-9730-59d525fa830c tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] 10.222.0.90 "GET /compute/v2.1/servers/a8c2e462-7829-4a03-bca5-01438c78bca2" status: 200 len: 1313 microversion: 2.1 time: 0.194033 Oct 29 01:14:42.323355 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 175/355] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:42 2021] GET /compute/v2.1/servers/a8c2e462-7829-4a03-bca5-01438c78bca2 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:42.337933 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-64b20134-a898-480b-9080-80c4da33275a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:42.338898 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-64b20134-a898-480b-9080-80c4da33275a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:42.344645 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-64b20134-a898-480b-9080-80c4da33275a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:42.345088 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-64b20134-a898-480b-9080-80c4da33275a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:42.345838 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-64b20134-a898-480b-9080-80c4da33275a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:42.346265 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-64b20134-a898-480b-9080-80c4da33275a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:42.371390 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.objects.instance [None req-64b20134-a898-480b-9080-80c4da33275a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lazy-loading 'flavor' on Instance uuid d46f88d3-603a-4019-8233-a3a1217bb756 {{(pid=115748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:14:42.484038 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a70fc14c-718f-47ea-9c3f-4e37f6308d5b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:42.484260 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-64b20134-a898-480b-9080-80c4da33275a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "POST /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756/action" status: 200 len: 32 microversion: 2.1 time: 0.150117 Oct 29 01:14:42.485038 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 181/356] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:14:42 2021] POST /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756/action => generated 32 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:14:42.485165 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a70fc14c-718f-47ea-9c3f-4e37f6308d5b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:42.491764 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a70fc14c-718f-47ea-9c3f-4e37f6308d5b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:42.492530 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a70fc14c-718f-47ea-9c3f-4e37f6308d5b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:42.493516 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a70fc14c-718f-47ea-9c3f-4e37f6308d5b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:42.494191 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a70fc14c-718f-47ea-9c3f-4e37f6308d5b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:42.494300 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d854dc35-ed1e-47bb-9c95-1f7ccd1ab7b5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:42.495133 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d854dc35-ed1e-47bb-9c95-1f7ccd1ab7b5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:42.501503 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d854dc35-ed1e-47bb-9c95-1f7ccd1ab7b5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:42.501998 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d854dc35-ed1e-47bb-9c95-1f7ccd1ab7b5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:42.502855 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d854dc35-ed1e-47bb-9c95-1f7ccd1ab7b5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:42.503293 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d854dc35-ed1e-47bb-9c95-1f7ccd1ab7b5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:42.731623 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-a70fc14c-718f-47ea-9c3f-4e37f6308d5b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:42.734057 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-d854dc35-ed1e-47bb-9c95-1f7ccd1ab7b5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:42.739359 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a70fc14c-718f-47ea-9c3f-4e37f6308d5b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1260 microversion: 2.1 time: 0.259298 Oct 29 01:14:42.740049 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 176/357] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:42 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1260 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:42.742939 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d854dc35-ed1e-47bb-9c95-1f7ccd1ab7b5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.252769 Oct 29 01:14:42.743695 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 182/358] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:42 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:42.752501 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-0d00dbb4-ec6b-42db-9d6e-8c9c96c352cd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:42.753547 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-0d00dbb4-ec6b-42db-9d6e-8c9c96c352cd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:42.760486 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0d00dbb4-ec6b-42db-9d6e-8c9c96c352cd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:42.761208 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0d00dbb4-ec6b-42db-9d6e-8c9c96c352cd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:42.761888 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0d00dbb4-ec6b-42db-9d6e-8c9c96c352cd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:42.762314 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0d00dbb4-ec6b-42db-9d6e-8c9c96c352cd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:42.831018 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-5cf7b8d2-1268-4ecf-8c1c-af87ed3fc8c2 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:42.831728 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-5cf7b8d2-1268-4ecf-8c1c-af87ed3fc8c2 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 7add95a5-9fb0-4c27-8836-5f24f8c0113f] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:42.838372 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5cf7b8d2-1268-4ecf-8c1c-af87ed3fc8c2 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:42.838930 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5cf7b8d2-1268-4ecf-8c1c-af87ed3fc8c2 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:42.839774 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5cf7b8d2-1268-4ecf-8c1c-af87ed3fc8c2 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:42.840309 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5cf7b8d2-1268-4ecf-8c1c-af87ed3fc8c2 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:42.926559 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-0d00dbb4-ec6b-42db-9d6e-8c9c96c352cd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 200 len: 38282 microversion: 2.20 time: 0.185155 Oct 29 01:14:42.927568 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 177/359] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:14:42 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 38282 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:14:42.937388 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-5cf7b8d2-1268-4ecf-8c1c-af87ed3fc8c2 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:42.938509 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-2c549254-c481-4846-83e9-1b33f741f53e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:42.939264 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-2c549254-c481-4846-83e9-1b33f741f53e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:42.946071 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-5cf7b8d2-1268-4ecf-8c1c-af87ed3fc8c2 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f" status: 200 len: 1275 microversion: 2.1 time: 0.118743 Oct 29 01:14:42.950433 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 183/360] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:42 2021] GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f => generated 1275 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:42.950645 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2c549254-c481-4846-83e9-1b33f741f53e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:42.950645 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2c549254-c481-4846-83e9-1b33f741f53e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:42.950645 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2c549254-c481-4846-83e9-1b33f741f53e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:42.950645 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2c549254-c481-4846-83e9-1b33f741f53e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:42.974874 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-2c549254-c481-4846-83e9-1b33f741f53e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/ips" status: 200 len: 150 microversion: 2.20 time: 0.040780 Oct 29 01:14:42.975457 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 178/361] 10.222.0.90 () {60 vars in 1288 bytes} [Fri Oct 29 01:14:42 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:14:43.339101 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d1dce14e-1e21-488f-9a4d-353eeffffd24 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:43.340507 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d1dce14e-1e21-488f-9a4d-353eeffffd24 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] [instance: a8c2e462-7829-4a03-bca5-01438c78bca2] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:43.351376 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d1dce14e-1e21-488f-9a4d-353eeffffd24 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:43.351652 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d1dce14e-1e21-488f-9a4d-353eeffffd24 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:43.352371 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d1dce14e-1e21-488f-9a4d-353eeffffd24 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:43.353272 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d1dce14e-1e21-488f-9a4d-353eeffffd24 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:43.504597 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-d1dce14e-1e21-488f-9a4d-353eeffffd24 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dc700311c748ba8a56dc4e9e831889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e4811f3ecf4ced9941eb882d5eb8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:43.512472 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d1dce14e-1e21-488f-9a4d-353eeffffd24 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] 10.222.0.90 "GET /compute/v2.1/servers/a8c2e462-7829-4a03-bca5-01438c78bca2" status: 200 len: 1313 microversion: 2.1 time: 0.177520 Oct 29 01:14:43.522310 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 184/362] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:43 2021] GET /compute/v2.1/servers/a8c2e462-7829-4a03-bca5-01438c78bca2 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:43.607094 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [req-a54ccb84-7f8e-4b98-88b2-422a4c3188ee req-e39f9d90-f069-480c-8fae-ff9affbc8c60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd", "name": "network-vif-plugged", "status": "completed", "tag": "8d56de6a-a409-4dde-8299-b4d26a45fc41"}]} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:43.608774 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:14:43.608774 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: warnings.warn(msg) Oct 29 01:14:43.616873 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-a54ccb84-7f8e-4b98-88b2-422a4c3188ee req-e39f9d90-f069-480c-8fae-ff9affbc8c60 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:43.617429 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-a54ccb84-7f8e-4b98-88b2-422a4c3188ee req-e39f9d90-f069-480c-8fae-ff9affbc8c60 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:43.628771 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.compute.server_external_events [req-a54ccb84-7f8e-4b98-88b2-422a4c3188ee req-e39f9d90-f069-480c-8fae-ff9affbc8c60 service nova] Creating event network-vif-plugged:8d56de6a-a409-4dde-8299-b4d26a45fc41 for instance efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd on hv-cinder-81558 Oct 29 01:14:43.634707 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [req-a54ccb84-7f8e-4b98-88b2-422a4c3188ee req-e39f9d90-f069-480c-8fae-ff9affbc8c60 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031297 Oct 29 01:14:43.635535 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 179/363] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:14:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:14:43.757643 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c98234c6-f19f-44d2-963d-462cd457df2a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:43.758539 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c98234c6-f19f-44d2-963d-462cd457df2a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:43.762090 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-089440b5-e12a-43ea-8731-d3ead2c74f34 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:43.763037 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-089440b5-e12a-43ea-8731-d3ead2c74f34 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:43.765353 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c98234c6-f19f-44d2-963d-462cd457df2a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:43.765800 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c98234c6-f19f-44d2-963d-462cd457df2a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:43.766608 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c98234c6-f19f-44d2-963d-462cd457df2a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:43.767038 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c98234c6-f19f-44d2-963d-462cd457df2a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:43.770463 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-089440b5-e12a-43ea-8731-d3ead2c74f34 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:43.770939 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-089440b5-e12a-43ea-8731-d3ead2c74f34 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:43.772280 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-089440b5-e12a-43ea-8731-d3ead2c74f34 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:43.772747 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-089440b5-e12a-43ea-8731-d3ead2c74f34 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:43.954205 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-c98234c6-f19f-44d2-963d-462cd457df2a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:43.957370 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-089440b5-e12a-43ea-8731-d3ead2c74f34 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:43.969199 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c98234c6-f19f-44d2-963d-462cd457df2a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1260 microversion: 2.1 time: 0.216593 Oct 29 01:14:43.969634 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-089440b5-e12a-43ea-8731-d3ead2c74f34 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.212478 Oct 29 01:14:43.970297 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 185/364] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:43 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1260 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:43.974583 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-178a8a18-63de-4176-88d1-a78d407b87a5 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:43.975192 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-178a8a18-63de-4176-88d1-a78d407b87a5 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 7add95a5-9fb0-4c27-8836-5f24f8c0113f] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:43.979328 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 180/365] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:43 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:43.981792 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-178a8a18-63de-4176-88d1-a78d407b87a5 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:43.982242 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-178a8a18-63de-4176-88d1-a78d407b87a5 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:43.983050 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-178a8a18-63de-4176-88d1-a78d407b87a5 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:43.983782 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-178a8a18-63de-4176-88d1-a78d407b87a5 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:44.113708 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [req-d0c5cd8e-12f7-46d6-acc0-ada396efb1c2 req-53f81925-c7d1-4bfc-9a55-1548dcfd9901 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7add95a5-9fb0-4c27-8836-5f24f8c0113f", "tag": "4c562e62-28f1-44c6-babd-05ab91b12d6b"}]} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:44.116649 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:14:44.116649 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: warnings.warn(msg) Oct 29 01:14:44.132064 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-178a8a18-63de-4176-88d1-a78d407b87a5 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:44.133375 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-d0c5cd8e-12f7-46d6-acc0-ada396efb1c2 req-53f81925-c7d1-4bfc-9a55-1548dcfd9901 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:44.134672 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-d0c5cd8e-12f7-46d6-acc0-ada396efb1c2 req-53f81925-c7d1-4bfc-9a55-1548dcfd9901 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:44.144804 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-178a8a18-63de-4176-88d1-a78d407b87a5 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f" status: 200 len: 1317 microversion: 2.1 time: 0.169698 Oct 29 01:14:44.144804 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 186/366] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:43 2021] GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:44.157866 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.compute.server_external_events [req-d0c5cd8e-12f7-46d6-acc0-ada396efb1c2 req-53f81925-c7d1-4bfc-9a55-1548dcfd9901 service nova] Creating event network-changed:4c562e62-28f1-44c6-babd-05ab91b12d6b for instance 7add95a5-9fb0-4c27-8836-5f24f8c0113f on hv-cinder-81558 Oct 29 01:14:44.162852 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [req-d0c5cd8e-12f7-46d6-acc0-ada396efb1c2 req-53f81925-c7d1-4bfc-9a55-1548dcfd9901 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053689 Oct 29 01:14:44.163598 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 181/367] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:14:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:14:44.528835 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-8d65e45f-6ffb-4622-9ed1-bc36a7c7379a tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:44.529459 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-8d65e45f-6ffb-4622-9ed1-bc36a7c7379a tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] [instance: a8c2e462-7829-4a03-bca5-01438c78bca2] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:44.535640 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8d65e45f-6ffb-4622-9ed1-bc36a7c7379a tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:44.536089 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8d65e45f-6ffb-4622-9ed1-bc36a7c7379a tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:44.537344 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8d65e45f-6ffb-4622-9ed1-bc36a7c7379a tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:44.537784 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8d65e45f-6ffb-4622-9ed1-bc36a7c7379a tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:44.660102 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-8d65e45f-6ffb-4622-9ed1-bc36a7c7379a tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dc700311c748ba8a56dc4e9e831889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e4811f3ecf4ced9941eb882d5eb8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:44.670273 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-8d65e45f-6ffb-4622-9ed1-bc36a7c7379a tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] 10.222.0.90 "GET /compute/v2.1/servers/a8c2e462-7829-4a03-bca5-01438c78bca2" status: 200 len: 1497 microversion: 2.1 time: 0.145091 Oct 29 01:14:44.670883 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 187/368] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:44 2021] GET /compute/v2.1/servers/a8c2e462-7829-4a03-bca5-01438c78bca2 => generated 1497 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:44.987065 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a2086243-91ce-4697-a89f-5d2597258b25 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:44.987754 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a2086243-91ce-4697-a89f-5d2597258b25 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:44.993921 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a2086243-91ce-4697-a89f-5d2597258b25 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:44.994368 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a2086243-91ce-4697-a89f-5d2597258b25 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:44.995008 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2466a074-0cef-47ee-b72f-cc3a161165b6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:44.995172 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a2086243-91ce-4697-a89f-5d2597258b25 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:44.995607 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a2086243-91ce-4697-a89f-5d2597258b25 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:44.995761 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2466a074-0cef-47ee-b72f-cc3a161165b6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:45.001500 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2466a074-0cef-47ee-b72f-cc3a161165b6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:45.001938 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2466a074-0cef-47ee-b72f-cc3a161165b6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:45.002732 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2466a074-0cef-47ee-b72f-cc3a161165b6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:45.003156 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2466a074-0cef-47ee-b72f-cc3a161165b6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:45.251333 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-a2086243-91ce-4697-a89f-5d2597258b25 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:45.256410 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-2466a074-0cef-47ee-b72f-cc3a161165b6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:45.259235 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a2086243-91ce-4697-a89f-5d2597258b25 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1260 microversion: 2.1 time: 0.276692 Oct 29 01:14:45.259885 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 182/369] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:44 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1260 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:45.265574 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9dda089d-1867-4ea4-8034-49e9b788c503 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:45.266180 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9dda089d-1867-4ea4-8034-49e9b788c503 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 7add95a5-9fb0-4c27-8836-5f24f8c0113f] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:45.271695 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2466a074-0cef-47ee-b72f-cc3a161165b6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.279800 Oct 29 01:14:45.272264 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 188/370] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:44 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:45.272506 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9dda089d-1867-4ea4-8034-49e9b788c503 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:45.272950 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9dda089d-1867-4ea4-8034-49e9b788c503 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:45.273718 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9dda089d-1867-4ea4-8034-49e9b788c503 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:45.274152 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9dda089d-1867-4ea4-8034-49e9b788c503 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:45.446497 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-1a5d32d2-4995-4ea7-8159-2e62052a68e1 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:45.447199 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-1a5d32d2-4995-4ea7-8159-2e62052a68e1 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] [instance: a8c2e462-7829-4a03-bca5-01438c78bca2] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:45.453307 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1a5d32d2-4995-4ea7-8159-2e62052a68e1 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:45.453830 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1a5d32d2-4995-4ea7-8159-2e62052a68e1 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:45.454693 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1a5d32d2-4995-4ea7-8159-2e62052a68e1 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:45.455184 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1a5d32d2-4995-4ea7-8159-2e62052a68e1 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:45.483910 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-1a5d32d2-4995-4ea7-8159-2e62052a68e1 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] [instance: a8c2e462-7829-4a03-bca5-01438c78bca2] Going to try to terminate instance {{(pid=115748) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 01:14:45.565520 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-1a5d32d2-4995-4ea7-8159-2e62052a68e1 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] 10.222.0.90 "DELETE /compute/v2.1/servers/a8c2e462-7829-4a03-bca5-01438c78bca2" status: 204 len: 0 microversion: 2.1 time: 0.123131 Oct 29 01:14:45.570469 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 189/371] 10.222.0.90 () {58 vars in 1238 bytes} [Fri Oct 29 01:14:45 2021] DELETE /compute/v2.1/servers/a8c2e462-7829-4a03-bca5-01438c78bca2 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 01:14:45.576564 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e43ab202-a23c-449b-bfaf-1f766a21d1fd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:45.577187 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-e43ab202-a23c-449b-bfaf-1f766a21d1fd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:45.583197 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e43ab202-a23c-449b-bfaf-1f766a21d1fd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:45.584280 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e43ab202-a23c-449b-bfaf-1f766a21d1fd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:45.585073 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e43ab202-a23c-449b-bfaf-1f766a21d1fd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:45.585512 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e43ab202-a23c-449b-bfaf-1f766a21d1fd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:45.609001 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.objects.instance [None req-e43ab202-a23c-449b-bfaf-1f766a21d1fd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lazy-loading 'flavor' on Instance uuid 27a73464-dcac-4be6-a392-58d40a0296a8 {{(pid=115748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:14:45.616368 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-9dda089d-1867-4ea4-8034-49e9b788c503 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:45.623585 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9dda089d-1867-4ea4-8034-49e9b788c503 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f" status: 200 len: 1317 microversion: 2.1 time: 0.362595 Oct 29 01:14:45.624145 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 183/372] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:45 2021] GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f => generated 1317 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:45.628268 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-34ae2575-6883-46bf-890a-7f25d25e8c43 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:45.628858 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-34ae2575-6883-46bf-890a-7f25d25e8c43 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] [instance: a8c2e462-7829-4a03-bca5-01438c78bca2] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:45.637193 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-34ae2575-6883-46bf-890a-7f25d25e8c43 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:45.638272 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-34ae2575-6883-46bf-890a-7f25d25e8c43 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:45.638509 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-34ae2575-6883-46bf-890a-7f25d25e8c43 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:45.638945 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-34ae2575-6883-46bf-890a-7f25d25e8c43 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:45.836123 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-34ae2575-6883-46bf-890a-7f25d25e8c43 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dc700311c748ba8a56dc4e9e831889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e4811f3ecf4ced9941eb882d5eb8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:45.843816 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-34ae2575-6883-46bf-890a-7f25d25e8c43 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] 10.222.0.90 "GET /compute/v2.1/servers/a8c2e462-7829-4a03-bca5-01438c78bca2" status: 200 len: 1503 microversion: 2.1 time: 0.218683 Oct 29 01:14:45.844446 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 184/373] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:45 2021] GET /compute/v2.1/servers/a8c2e462-7829-4a03-bca5-01438c78bca2 => generated 1503 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:45.874425 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-e43ab202-a23c-449b-bfaf-1f766a21d1fd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 202 len: 0 microversion: 2.20 time: 0.301813 Oct 29 01:14:45.875055 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 190/374] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:14:45 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:14:45.883657 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-eafb198d-1a7d-4e6e-bb75-73178d6106b5 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:45.884257 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-eafb198d-1a7d-4e6e-bb75-73178d6106b5 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:45.890125 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-eafb198d-1a7d-4e6e-bb75-73178d6106b5 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:45.890602 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-eafb198d-1a7d-4e6e-bb75-73178d6106b5 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:45.891356 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-eafb198d-1a7d-4e6e-bb75-73178d6106b5 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:45.891783 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-eafb198d-1a7d-4e6e-bb75-73178d6106b5 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:46.068936 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-eafb198d-1a7d-4e6e-bb75-73178d6106b5 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:46.077424 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-eafb198d-1a7d-4e6e-bb75-73178d6106b5 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:46.079261 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-eafb198d-1a7d-4e6e-bb75-73178d6106b5 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:46.080416 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-eafb198d-1a7d-4e6e-bb75-73178d6106b5 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1723 microversion: 2.20 time: 0.200967 Oct 29 01:14:46.080977 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 185/375] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:14:45 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:14:46.275599 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-747a0fad-17db-441c-8865-8f5e8ca84194 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:46.276286 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-747a0fad-17db-441c-8865-8f5e8ca84194 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:46.282329 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-747a0fad-17db-441c-8865-8f5e8ca84194 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:46.282816 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-747a0fad-17db-441c-8865-8f5e8ca84194 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:46.283574 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-747a0fad-17db-441c-8865-8f5e8ca84194 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:46.284028 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-747a0fad-17db-441c-8865-8f5e8ca84194 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:46.288239 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-fbdb3523-1e79-4961-b9ee-52eb3c786e9f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:46.288844 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-fbdb3523-1e79-4961-b9ee-52eb3c786e9f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:46.295453 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fbdb3523-1e79-4961-b9ee-52eb3c786e9f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:46.295901 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fbdb3523-1e79-4961-b9ee-52eb3c786e9f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:46.296666 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fbdb3523-1e79-4961-b9ee-52eb3c786e9f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:46.297092 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fbdb3523-1e79-4961-b9ee-52eb3c786e9f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:46.464872 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-747a0fad-17db-441c-8865-8f5e8ca84194 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:46.471476 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-fbdb3523-1e79-4961-b9ee-52eb3c786e9f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:46.472698 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-747a0fad-17db-441c-8865-8f5e8ca84194 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1260 microversion: 2.1 time: 0.201099 Oct 29 01:14:46.481356 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 191/376] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:46 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1260 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:46.481514 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-fbdb3523-1e79-4961-b9ee-52eb3c786e9f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.194513 Oct 29 01:14:46.487218 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 186/377] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:46 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:46.640629 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-ab6f2317-44c6-468c-be8e-2258775a9cca tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:46.641263 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-ab6f2317-44c6-468c-be8e-2258775a9cca tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 7add95a5-9fb0-4c27-8836-5f24f8c0113f] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:46.647467 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ab6f2317-44c6-468c-be8e-2258775a9cca tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:46.647918 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ab6f2317-44c6-468c-be8e-2258775a9cca tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:46.648684 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ab6f2317-44c6-468c-be8e-2258775a9cca tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:46.649116 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ab6f2317-44c6-468c-be8e-2258775a9cca tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:46.773742 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-ab6f2317-44c6-468c-be8e-2258775a9cca tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:46.782502 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-ab6f2317-44c6-468c-be8e-2258775a9cca tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f" status: 200 len: 1317 microversion: 2.1 time: 0.145480 Oct 29 01:14:46.783181 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 192/378] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:46 2021] GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f => generated 1317 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:46.860932 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-8d694785-0629-4b95-a0dd-ecd4229e7f75 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:46.861538 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-8d694785-0629-4b95-a0dd-ecd4229e7f75 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] [instance: a8c2e462-7829-4a03-bca5-01438c78bca2] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:46.868287 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8d694785-0629-4b95-a0dd-ecd4229e7f75 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:46.868733 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8d694785-0629-4b95-a0dd-ecd4229e7f75 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:46.869497 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8d694785-0629-4b95-a0dd-ecd4229e7f75 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:46.869930 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8d694785-0629-4b95-a0dd-ecd4229e7f75 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:47.014358 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-8d694785-0629-4b95-a0dd-ecd4229e7f75 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dc700311c748ba8a56dc4e9e831889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e4811f3ecf4ced9941eb882d5eb8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:47.022958 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-8d694785-0629-4b95-a0dd-ecd4229e7f75 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] 10.222.0.90 "GET /compute/v2.1/servers/a8c2e462-7829-4a03-bca5-01438c78bca2" status: 200 len: 1503 microversion: 2.1 time: 0.165106 Oct 29 01:14:47.023523 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 187/379] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:46 2021] GET /compute/v2.1/servers/a8c2e462-7829-4a03-bca5-01438c78bca2 => generated 1503 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:47.098754 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-33b85008-bfe0-4b72-8178-67dd0f5dd53d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:47.099349 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-33b85008-bfe0-4b72-8178-67dd0f5dd53d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:47.105821 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-33b85008-bfe0-4b72-8178-67dd0f5dd53d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:47.106264 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-33b85008-bfe0-4b72-8178-67dd0f5dd53d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:47.107064 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-33b85008-bfe0-4b72-8178-67dd0f5dd53d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:47.107497 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-33b85008-bfe0-4b72-8178-67dd0f5dd53d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:47.283737 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-33b85008-bfe0-4b72-8178-67dd0f5dd53d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:47.292253 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-33b85008-bfe0-4b72-8178-67dd0f5dd53d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:47.293748 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-33b85008-bfe0-4b72-8178-67dd0f5dd53d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:47.294933 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-33b85008-bfe0-4b72-8178-67dd0f5dd53d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1723 microversion: 2.20 time: 0.199858 Oct 29 01:14:47.295480 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 193/380] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:14:47 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:14:47.496064 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-0e396a14-ac78-4d7d-a158-9b91d8c687f6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:47.497418 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-0e396a14-ac78-4d7d-a158-9b91d8c687f6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:47.498202 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-1d4a1b11-e348-4240-bb20-bf12946fad61 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:47.499073 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-1d4a1b11-e348-4240-bb20-bf12946fad61 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:47.503873 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0e396a14-ac78-4d7d-a158-9b91d8c687f6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:47.504496 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0e396a14-ac78-4d7d-a158-9b91d8c687f6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:47.505429 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1d4a1b11-e348-4240-bb20-bf12946fad61 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:47.505613 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0e396a14-ac78-4d7d-a158-9b91d8c687f6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:47.505959 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1d4a1b11-e348-4240-bb20-bf12946fad61 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:47.507279 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0e396a14-ac78-4d7d-a158-9b91d8c687f6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:47.507453 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1d4a1b11-e348-4240-bb20-bf12946fad61 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:47.507774 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1d4a1b11-e348-4240-bb20-bf12946fad61 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:47.746662 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-1d4a1b11-e348-4240-bb20-bf12946fad61 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:47.753423 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-0e396a14-ac78-4d7d-a158-9b91d8c687f6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:47.754142 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-1d4a1b11-e348-4240-bb20-bf12946fad61 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.262224 Oct 29 01:14:47.754816 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 194/381] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:47 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:47.761371 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-0e396a14-ac78-4d7d-a158-9b91d8c687f6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1444 microversion: 2.1 time: 0.275037 Oct 29 01:14:47.761921 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 188/382] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:47 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1444 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:47.777134 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-ddaf6f7e-097a-4ca3-9613-d91b4f5efed0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:47.777898 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-ddaf6f7e-097a-4ca3-9613-d91b4f5efed0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:47.785528 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ddaf6f7e-097a-4ca3-9613-d91b4f5efed0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:47.786024 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ddaf6f7e-097a-4ca3-9613-d91b4f5efed0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:47.786863 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ddaf6f7e-097a-4ca3-9613-d91b4f5efed0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:47.787292 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ddaf6f7e-097a-4ca3-9613-d91b4f5efed0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:47.799850 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b063d6ca-4a57-451a-b15b-37c38298a654 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:47.800447 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b063d6ca-4a57-451a-b15b-37c38298a654 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 7add95a5-9fb0-4c27-8836-5f24f8c0113f] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:47.806565 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b063d6ca-4a57-451a-b15b-37c38298a654 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:47.807006 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b063d6ca-4a57-451a-b15b-37c38298a654 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:47.807756 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b063d6ca-4a57-451a-b15b-37c38298a654 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:47.808182 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b063d6ca-4a57-451a-b15b-37c38298a654 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:47.963429 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-ddaf6f7e-097a-4ca3-9613-d91b4f5efed0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:47.970755 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-ddaf6f7e-097a-4ca3-9613-d91b4f5efed0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1444 microversion: 2.1 time: 0.197171 Oct 29 01:14:47.971310 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 195/383] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:47 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1444 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:47.974656 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-b063d6ca-4a57-451a-b15b-37c38298a654 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:47.981970 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b063d6ca-4a57-451a-b15b-37c38298a654 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f" status: 200 len: 1317 microversion: 2.1 time: 0.185687 Oct 29 01:14:47.982541 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 189/384] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:47 2021] GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f => generated 1317 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:48.040339 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d312d2fb-1cb8-4304-bfc6-de0198878a92 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:48.040952 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d312d2fb-1cb8-4304-bfc6-de0198878a92 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] [instance: a8c2e462-7829-4a03-bca5-01438c78bca2] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:48.046704 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d312d2fb-1cb8-4304-bfc6-de0198878a92 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:48.047150 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d312d2fb-1cb8-4304-bfc6-de0198878a92 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:48.047921 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d312d2fb-1cb8-4304-bfc6-de0198878a92 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:48.048350 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d312d2fb-1cb8-4304-bfc6-de0198878a92 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:48.201297 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-d312d2fb-1cb8-4304-bfc6-de0198878a92 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dc700311c748ba8a56dc4e9e831889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e4811f3ecf4ced9941eb882d5eb8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:48.209131 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d312d2fb-1cb8-4304-bfc6-de0198878a92 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] 10.222.0.90 "GET /compute/v2.1/servers/a8c2e462-7829-4a03-bca5-01438c78bca2" status: 200 len: 1503 microversion: 2.1 time: 0.173064 Oct 29 01:14:48.210590 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 196/385] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:48 2021] GET /compute/v2.1/servers/a8c2e462-7829-4a03-bca5-01438c78bca2 => generated 1503 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:48.312782 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-de2f5cb1-e34b-4f39-a2c8-58a5512f08e6 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:48.313388 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-de2f5cb1-e34b-4f39-a2c8-58a5512f08e6 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:48.320052 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-de2f5cb1-e34b-4f39-a2c8-58a5512f08e6 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:48.320490 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-de2f5cb1-e34b-4f39-a2c8-58a5512f08e6 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:48.321248 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-de2f5cb1-e34b-4f39-a2c8-58a5512f08e6 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:48.321675 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-de2f5cb1-e34b-4f39-a2c8-58a5512f08e6 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:48.527982 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-de2f5cb1-e34b-4f39-a2c8-58a5512f08e6 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:48.535665 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-de2f5cb1-e34b-4f39-a2c8-58a5512f08e6 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:48.537136 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-de2f5cb1-e34b-4f39-a2c8-58a5512f08e6 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:48.538869 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-de2f5cb1-e34b-4f39-a2c8-58a5512f08e6 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1723 microversion: 2.20 time: 0.229930 Oct 29 01:14:48.539419 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 190/386] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:14:48 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:14:48.770599 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-382e70e0-da97-4a40-8f50-4f81bc300502 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:48.771394 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-382e70e0-da97-4a40-8f50-4f81bc300502 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:48.778427 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-382e70e0-da97-4a40-8f50-4f81bc300502 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:48.778868 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-382e70e0-da97-4a40-8f50-4f81bc300502 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:48.779645 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-382e70e0-da97-4a40-8f50-4f81bc300502 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:48.780223 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-382e70e0-da97-4a40-8f50-4f81bc300502 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:48.993561 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-382e70e0-da97-4a40-8f50-4f81bc300502 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:48.998667 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c336bf43-0bf9-4b41-9284-a828fc0babda tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:48.999278 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c336bf43-0bf9-4b41-9284-a828fc0babda tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 7add95a5-9fb0-4c27-8836-5f24f8c0113f] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:49.001073 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-382e70e0-da97-4a40-8f50-4f81bc300502 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.234149 Oct 29 01:14:49.001669 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 197/387] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:48 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:49.015228 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c336bf43-0bf9-4b41-9284-a828fc0babda tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:49.015803 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c336bf43-0bf9-4b41-9284-a828fc0babda tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:49.016613 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c336bf43-0bf9-4b41-9284-a828fc0babda tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:49.017077 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c336bf43-0bf9-4b41-9284-a828fc0babda tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:49.229081 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-a1a5af38-3ef5-4b52-8095-be058550d1a0 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:49.229689 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-a1a5af38-3ef5-4b52-8095-be058550d1a0 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] [instance: a8c2e462-7829-4a03-bca5-01438c78bca2] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:49.235457 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a1a5af38-3ef5-4b52-8095-be058550d1a0 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:49.235908 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a1a5af38-3ef5-4b52-8095-be058550d1a0 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:49.236672 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a1a5af38-3ef5-4b52-8095-be058550d1a0 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:49.237107 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a1a5af38-3ef5-4b52-8095-be058550d1a0 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:49.243392 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c336bf43-0bf9-4b41-9284-a828fc0babda tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:49.250932 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c336bf43-0bf9-4b41-9284-a828fc0babda tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f" status: 200 len: 1317 microversion: 2.1 time: 0.255733 Oct 29 01:14:49.257948 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 191/388] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:48 2021] GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:49.449552 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-a1a5af38-3ef5-4b52-8095-be058550d1a0 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dc700311c748ba8a56dc4e9e831889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e4811f3ecf4ced9941eb882d5eb8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:49.457101 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-a1a5af38-3ef5-4b52-8095-be058550d1a0 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] 10.222.0.90 "GET /compute/v2.1/servers/a8c2e462-7829-4a03-bca5-01438c78bca2" status: 200 len: 1503 microversion: 2.1 time: 0.232035 Oct 29 01:14:49.458207 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 198/389] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:49 2021] GET /compute/v2.1/servers/a8c2e462-7829-4a03-bca5-01438c78bca2 => generated 1503 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:49.558541 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-11c8a573-7484-4c68-ac95-7018ff4fdb44 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:49.559243 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-11c8a573-7484-4c68-ac95-7018ff4fdb44 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:49.566519 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-11c8a573-7484-4c68-ac95-7018ff4fdb44 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:49.567216 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-11c8a573-7484-4c68-ac95-7018ff4fdb44 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:49.569536 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-11c8a573-7484-4c68-ac95-7018ff4fdb44 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:49.570197 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-11c8a573-7484-4c68-ac95-7018ff4fdb44 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:50.018620 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-5d423799-4e94-4e0d-a062-1875f6f42eb0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:50.019158 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-5d423799-4e94-4e0d-a062-1875f6f42eb0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:50.025401 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5d423799-4e94-4e0d-a062-1875f6f42eb0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:50.025847 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5d423799-4e94-4e0d-a062-1875f6f42eb0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:50.026649 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5d423799-4e94-4e0d-a062-1875f6f42eb0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:50.027082 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5d423799-4e94-4e0d-a062-1875f6f42eb0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:50.136888 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-11c8a573-7484-4c68-ac95-7018ff4fdb44 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:50.144535 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-11c8a573-7484-4c68-ac95-7018ff4fdb44 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:50.146134 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-11c8a573-7484-4c68-ac95-7018ff4fdb44 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:50.147332 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-11c8a573-7484-4c68-ac95-7018ff4fdb44 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1723 microversion: 2.20 time: 0.594460 Oct 29 01:14:50.147898 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 192/390] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:14:49 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1723 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:14:50.268388 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-cd1e1b71-b814-4613-9eb1-5b4331fba647 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:50.269119 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-cd1e1b71-b814-4613-9eb1-5b4331fba647 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 7add95a5-9fb0-4c27-8836-5f24f8c0113f] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:50.274810 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cd1e1b71-b814-4613-9eb1-5b4331fba647 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:50.275260 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cd1e1b71-b814-4613-9eb1-5b4331fba647 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:50.276021 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cd1e1b71-b814-4613-9eb1-5b4331fba647 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:50.276451 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cd1e1b71-b814-4613-9eb1-5b4331fba647 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:50.362703 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-5d423799-4e94-4e0d-a062-1875f6f42eb0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:50.371889 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-5d423799-4e94-4e0d-a062-1875f6f42eb0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.357038 Oct 29 01:14:50.372789 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 199/391] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:50 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:50.474249 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-6f82e0cd-dd18-4b18-bfdc-7fcc9dd14c31 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:50.475425 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-6f82e0cd-dd18-4b18-bfdc-7fcc9dd14c31 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] [instance: a8c2e462-7829-4a03-bca5-01438c78bca2] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:50.481229 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6f82e0cd-dd18-4b18-bfdc-7fcc9dd14c31 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:50.481686 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6f82e0cd-dd18-4b18-bfdc-7fcc9dd14c31 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:50.482478 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6f82e0cd-dd18-4b18-bfdc-7fcc9dd14c31 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:50.482949 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6f82e0cd-dd18-4b18-bfdc-7fcc9dd14c31 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:50.558217 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-cd1e1b71-b814-4613-9eb1-5b4331fba647 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:50.565328 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-cd1e1b71-b814-4613-9eb1-5b4331fba647 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f" status: 200 len: 1317 microversion: 2.1 time: 0.300611 Oct 29 01:14:50.574450 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 193/392] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:50 2021] GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f => generated 1317 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:50.785224 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-6f82e0cd-dd18-4b18-bfdc-7fcc9dd14c31 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dc700311c748ba8a56dc4e9e831889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e4811f3ecf4ced9941eb882d5eb8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:50.794570 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-6f82e0cd-dd18-4b18-bfdc-7fcc9dd14c31 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] 10.222.0.90 "GET /compute/v2.1/servers/a8c2e462-7829-4a03-bca5-01438c78bca2" status: 200 len: 1503 microversion: 2.1 time: 0.323890 Oct 29 01:14:50.795482 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 200/393] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:50 2021] GET /compute/v2.1/servers/a8c2e462-7829-4a03-bca5-01438c78bca2 => generated 1503 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:50.836685 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [req-d7eab69a-58de-4b14-970d-130b84f05169 req-7bc87a12-d2be-41f8-87c2-ab0efa94227f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd", "tag": "8d56de6a-a409-4dde-8299-b4d26a45fc41"}]} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:50.838526 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:14:50.838526 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: warnings.warn(msg) Oct 29 01:14:50.845985 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-d7eab69a-58de-4b14-970d-130b84f05169 req-7bc87a12-d2be-41f8-87c2-ab0efa94227f service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:50.846455 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-d7eab69a-58de-4b14-970d-130b84f05169 req-7bc87a12-d2be-41f8-87c2-ab0efa94227f service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:50.857992 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.compute.server_external_events [req-d7eab69a-58de-4b14-970d-130b84f05169 req-7bc87a12-d2be-41f8-87c2-ab0efa94227f service nova] Creating event network-changed:8d56de6a-a409-4dde-8299-b4d26a45fc41 for instance efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd on hv-cinder-81558 Oct 29 01:14:50.863298 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [req-d7eab69a-58de-4b14-970d-130b84f05169 req-7bc87a12-d2be-41f8-87c2-ab0efa94227f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030896 Oct 29 01:14:50.864059 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 194/394] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:14:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:14:51.164988 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e33dfd64-a11b-488c-bae8-568178e7a5f2 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:51.165598 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-e33dfd64-a11b-488c-bae8-568178e7a5f2 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:51.171968 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e33dfd64-a11b-488c-bae8-568178e7a5f2 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:51.172412 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e33dfd64-a11b-488c-bae8-568178e7a5f2 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:51.173208 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e33dfd64-a11b-488c-bae8-568178e7a5f2 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:51.173639 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e33dfd64-a11b-488c-bae8-568178e7a5f2 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:51.303419 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-e33dfd64-a11b-488c-bae8-568178e7a5f2 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:51.311800 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-e33dfd64-a11b-488c-bae8-568178e7a5f2 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:51.313325 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-e33dfd64-a11b-488c-bae8-568178e7a5f2 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:51.314527 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-e33dfd64-a11b-488c-bae8-568178e7a5f2 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1723 microversion: 2.20 time: 0.153361 Oct 29 01:14:51.315325 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 201/395] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:14:51 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:14:51.389205 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-68f01655-f49d-4212-8af1-651959f354c9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:51.389965 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-68f01655-f49d-4212-8af1-651959f354c9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:51.396048 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-68f01655-f49d-4212-8af1-651959f354c9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:51.396490 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-68f01655-f49d-4212-8af1-651959f354c9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:51.397831 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-68f01655-f49d-4212-8af1-651959f354c9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:51.398262 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-68f01655-f49d-4212-8af1-651959f354c9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:51.524419 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-68f01655-f49d-4212-8af1-651959f354c9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:51.532074 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-68f01655-f49d-4212-8af1-651959f354c9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.147243 Oct 29 01:14:51.542498 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 195/396] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:51 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:51.580839 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-28fd94b7-6607-410c-a6d8-f14c088bea00 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:51.581450 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-28fd94b7-6607-410c-a6d8-f14c088bea00 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 7add95a5-9fb0-4c27-8836-5f24f8c0113f] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:51.588696 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-28fd94b7-6607-410c-a6d8-f14c088bea00 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:51.589148 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-28fd94b7-6607-410c-a6d8-f14c088bea00 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:51.589918 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-28fd94b7-6607-410c-a6d8-f14c088bea00 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:51.590354 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-28fd94b7-6607-410c-a6d8-f14c088bea00 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:51.725184 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-28fd94b7-6607-410c-a6d8-f14c088bea00 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:51.733040 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-28fd94b7-6607-410c-a6d8-f14c088bea00 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f" status: 200 len: 1317 microversion: 2.1 time: 0.155808 Oct 29 01:14:51.733622 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 202/397] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:51 2021] GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:51.811398 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-85746929-b9e4-444c-8d50-2777739e01a5 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:51.812566 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-85746929-b9e4-444c-8d50-2777739e01a5 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] [instance: a8c2e462-7829-4a03-bca5-01438c78bca2] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:51.819844 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-85746929-b9e4-444c-8d50-2777739e01a5 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:51.820291 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-85746929-b9e4-444c-8d50-2777739e01a5 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:51.821060 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-85746929-b9e4-444c-8d50-2777739e01a5 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:51.821682 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-85746929-b9e4-444c-8d50-2777739e01a5 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:51.853343 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-85746929-b9e4-444c-8d50-2777739e01a5 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:51.853787 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-85746929-b9e4-444c-8d50-2777739e01a5 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:51.854230 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.objects.instance [None req-85746929-b9e4-444c-8d50-2777739e01a5 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lazy-loading 'fault' on Instance uuid a8c2e462-7829-4a03-bca5-01438c78bca2 {{(pid=115747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:14:51.905567 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-85746929-b9e4-444c-8d50-2777739e01a5 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dc700311c748ba8a56dc4e9e831889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e4811f3ecf4ced9941eb882d5eb8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:51.913832 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-85746929-b9e4-444c-8d50-2777739e01a5 tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] 10.222.0.90 "GET /compute/v2.1/servers/a8c2e462-7829-4a03-bca5-01438c78bca2" status: 200 len: 1303 microversion: 2.1 time: 0.105987 Oct 29 01:14:51.914433 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 196/398] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:51 2021] GET /compute/v2.1/servers/a8c2e462-7829-4a03-bca5-01438c78bca2 => generated 1303 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:52.333024 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-ed286247-f514-428f-ac29-1be59678d568 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:52.333523 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-ed286247-f514-428f-ac29-1be59678d568 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:52.341030 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ed286247-f514-428f-ac29-1be59678d568 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:52.341470 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ed286247-f514-428f-ac29-1be59678d568 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:52.342219 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ed286247-f514-428f-ac29-1be59678d568 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:52.342736 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ed286247-f514-428f-ac29-1be59678d568 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:52.460326 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-ed286247-f514-428f-ac29-1be59678d568 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:52.468452 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-ed286247-f514-428f-ac29-1be59678d568 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:52.469945 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-ed286247-f514-428f-ac29-1be59678d568 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:52.471126 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-ed286247-f514-428f-ac29-1be59678d568 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1723 microversion: 2.20 time: 0.141842 Oct 29 01:14:52.471674 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 203/399] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:14:52 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1723 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:14:52.548971 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-752d8e4c-2798-462a-b7c8-79a06ac14703 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:52.549638 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-752d8e4c-2798-462a-b7c8-79a06ac14703 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:52.556420 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-752d8e4c-2798-462a-b7c8-79a06ac14703 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:52.556865 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-752d8e4c-2798-462a-b7c8-79a06ac14703 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:52.557625 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-752d8e4c-2798-462a-b7c8-79a06ac14703 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:52.558058 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-752d8e4c-2798-462a-b7c8-79a06ac14703 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:52.675089 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-752d8e4c-2798-462a-b7c8-79a06ac14703 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:52.682691 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-752d8e4c-2798-462a-b7c8-79a06ac14703 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.137310 Oct 29 01:14:52.683246 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 197/400] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:52 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:52.750180 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f159dab2-cef9-44f6-9dc0-aa190638b8c8 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:52.750806 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f159dab2-cef9-44f6-9dc0-aa190638b8c8 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 7add95a5-9fb0-4c27-8836-5f24f8c0113f] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:52.757045 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f159dab2-cef9-44f6-9dc0-aa190638b8c8 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:52.757481 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f159dab2-cef9-44f6-9dc0-aa190638b8c8 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:52.758228 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f159dab2-cef9-44f6-9dc0-aa190638b8c8 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:52.758683 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f159dab2-cef9-44f6-9dc0-aa190638b8c8 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:52.884691 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [req-c6f5f1f6-7590-4eb7-9611-9f83674adc5c req-96c8129e-7dc5-441e-81e4-99af9152bd11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8c2e462-7829-4a03-bca5-01438c78bca2", "name": "network-vif-deleted", "tag": "b2294f48-2709-4187-ba15-9d492bc8e846"}]} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:52.886297 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:14:52.886297 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: warnings.warn(msg) Oct 29 01:14:52.887096 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-f159dab2-cef9-44f6-9dc0-aa190638b8c8 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:52.893039 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-c6f5f1f6-7590-4eb7-9611-9f83674adc5c req-96c8129e-7dc5-441e-81e4-99af9152bd11 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:52.893472 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-c6f5f1f6-7590-4eb7-9611-9f83674adc5c req-96c8129e-7dc5-441e-81e4-99af9152bd11 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:52.894278 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f159dab2-cef9-44f6-9dc0-aa190638b8c8 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f" status: 200 len: 1317 microversion: 2.1 time: 0.147715 Oct 29 01:14:52.894876 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 204/401] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:52 2021] GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:52.904404 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.compute.server_external_events [req-c6f5f1f6-7590-4eb7-9611-9f83674adc5c req-96c8129e-7dc5-441e-81e4-99af9152bd11 service nova] Creating event network-vif-deleted:b2294f48-2709-4187-ba15-9d492bc8e846 for instance a8c2e462-7829-4a03-bca5-01438c78bca2 on hv-cinder-81558 Oct 29 01:14:52.908998 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [req-c6f5f1f6-7590-4eb7-9611-9f83674adc5c req-96c8129e-7dc5-441e-81e4-99af9152bd11 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028631 Oct 29 01:14:52.909554 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 198/402] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:14:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:14:52.932667 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-3ba86a7e-b28a-4815-8009-50d405d785da tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:52.933270 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-3ba86a7e-b28a-4815-8009-50d405d785da tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] [instance: a8c2e462-7829-4a03-bca5-01438c78bca2] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:52.939057 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3ba86a7e-b28a-4815-8009-50d405d785da tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:52.939502 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3ba86a7e-b28a-4815-8009-50d405d785da tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:52.940250 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3ba86a7e-b28a-4815-8009-50d405d785da tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:52.940675 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3ba86a7e-b28a-4815-8009-50d405d785da tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:52.954493 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.wsgi [None req-3ba86a7e-b28a-4815-8009-50d405d785da tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] HTTP exception thrown: Instance a8c2e462-7829-4a03-bca5-01438c78bca2 could not be found. Oct 29 01:14:52.955069 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-3ba86a7e-b28a-4815-8009-50d405d785da tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] Returning 404 to user: Instance a8c2e462-7829-4a03-bca5-01438c78bca2 could not be found. {{(pid=115748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:14:52.956001 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-3ba86a7e-b28a-4815-8009-50d405d785da tempest-VolumesActionsTest-839428629 tempest-VolumesActionsTest-839428629-project] 10.222.0.90 "GET /compute/v2.1/servers/a8c2e462-7829-4a03-bca5-01438c78bca2" status: 404 len: 111 microversion: 2.1 time: 0.027192 Oct 29 01:14:52.956532 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 205/403] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:52 2021] GET /compute/v2.1/servers/a8c2e462-7829-4a03-bca5-01438c78bca2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:14:53.489321 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-155b8a73-0977-404f-b0bd-203fd48274c2 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:53.490005 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-155b8a73-0977-404f-b0bd-203fd48274c2 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:53.496506 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-155b8a73-0977-404f-b0bd-203fd48274c2 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:53.497064 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-155b8a73-0977-404f-b0bd-203fd48274c2 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:53.498063 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-155b8a73-0977-404f-b0bd-203fd48274c2 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:53.498722 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-155b8a73-0977-404f-b0bd-203fd48274c2 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:53.570641 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [req-644784e0-7bda-48b3-a7e0-7632d26ecf73 req-9d779ad5-8c48-44d1-8363-e71001d83842 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7add95a5-9fb0-4c27-8836-5f24f8c0113f", "name": "network-vif-plugged", "status": "completed", "tag": "4c562e62-28f1-44c6-babd-05ab91b12d6b"}]} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:53.572201 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:14:53.572201 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: warnings.warn(msg) Oct 29 01:14:53.592511 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-644784e0-7bda-48b3-a7e0-7632d26ecf73 req-9d779ad5-8c48-44d1-8363-e71001d83842 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:53.592951 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-644784e0-7bda-48b3-a7e0-7632d26ecf73 req-9d779ad5-8c48-44d1-8363-e71001d83842 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:53.615699 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.compute.server_external_events [req-644784e0-7bda-48b3-a7e0-7632d26ecf73 req-9d779ad5-8c48-44d1-8363-e71001d83842 service nova] Creating event network-vif-plugged:4c562e62-28f1-44c6-babd-05ab91b12d6b for instance 7add95a5-9fb0-4c27-8836-5f24f8c0113f on hv-cinder-81558 Oct 29 01:14:53.625721 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [req-644784e0-7bda-48b3-a7e0-7632d26ecf73 req-9d779ad5-8c48-44d1-8363-e71001d83842 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057619 Oct 29 01:14:53.626573 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 206/404] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:14:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:14:53.704857 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-943cf347-e7e5-4e90-8f77-1a9a547066cb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:53.705552 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-943cf347-e7e5-4e90-8f77-1a9a547066cb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:53.712158 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-943cf347-e7e5-4e90-8f77-1a9a547066cb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:53.712607 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-943cf347-e7e5-4e90-8f77-1a9a547066cb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:53.713376 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-943cf347-e7e5-4e90-8f77-1a9a547066cb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:53.713974 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-943cf347-e7e5-4e90-8f77-1a9a547066cb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:53.714955 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-155b8a73-0977-404f-b0bd-203fd48274c2 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:53.725244 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-155b8a73-0977-404f-b0bd-203fd48274c2 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:53.727113 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-155b8a73-0977-404f-b0bd-203fd48274c2 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:53.728272 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-155b8a73-0977-404f-b0bd-203fd48274c2 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1723 microversion: 2.20 time: 0.242948 Oct 29 01:14:53.728870 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 199/405] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:14:53 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:14:53.850767 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-943cf347-e7e5-4e90-8f77-1a9a547066cb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:53.858051 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-943cf347-e7e5-4e90-8f77-1a9a547066cb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.160432 Oct 29 01:14:53.858632 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 207/406] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:53 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:53.911730 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c001fc05-23be-46c9-98a7-6964f026dbc0 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:53.912455 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c001fc05-23be-46c9-98a7-6964f026dbc0 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 7add95a5-9fb0-4c27-8836-5f24f8c0113f] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:53.918738 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c001fc05-23be-46c9-98a7-6964f026dbc0 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:53.919256 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c001fc05-23be-46c9-98a7-6964f026dbc0 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:53.920090 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c001fc05-23be-46c9-98a7-6964f026dbc0 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:53.920916 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c001fc05-23be-46c9-98a7-6964f026dbc0 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:54.047756 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c001fc05-23be-46c9-98a7-6964f026dbc0 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:54.055532 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c001fc05-23be-46c9-98a7-6964f026dbc0 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f" status: 200 len: 1317 microversion: 2.1 time: 0.147604 Oct 29 01:14:54.056110 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 200/407] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:53 2021] GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:54.745494 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-baf972c6-a493-4340-8b0d-e9c8c1822a04 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:54.746098 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-baf972c6-a493-4340-8b0d-e9c8c1822a04 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:54.752002 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-baf972c6-a493-4340-8b0d-e9c8c1822a04 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:54.752439 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-baf972c6-a493-4340-8b0d-e9c8c1822a04 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:54.753189 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-baf972c6-a493-4340-8b0d-e9c8c1822a04 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:54.753614 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-baf972c6-a493-4340-8b0d-e9c8c1822a04 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:54.875153 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d7706464-d34e-4469-b795-0b12d7227a12 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:54.875781 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d7706464-d34e-4469-b795-0b12d7227a12 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:54.876254 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-baf972c6-a493-4340-8b0d-e9c8c1822a04 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:54.882647 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d7706464-d34e-4469-b795-0b12d7227a12 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:54.883086 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d7706464-d34e-4469-b795-0b12d7227a12 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:54.883839 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d7706464-d34e-4469-b795-0b12d7227a12 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:54.884263 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d7706464-d34e-4469-b795-0b12d7227a12 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:54.884454 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-baf972c6-a493-4340-8b0d-e9c8c1822a04 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:54.885939 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-baf972c6-a493-4340-8b0d-e9c8c1822a04 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:54.887128 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-baf972c6-a493-4340-8b0d-e9c8c1822a04 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1723 microversion: 2.20 time: 0.145549 Oct 29 01:14:54.887683 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 208/408] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:14:54 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:14:55.001498 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-d7706464-d34e-4469-b795-0b12d7227a12 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:55.009203 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d7706464-d34e-4469-b795-0b12d7227a12 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.137683 Oct 29 01:14:55.009768 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 201/409] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:54 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:55.072304 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-6bd7a3c3-0702-41aa-b835-e6bad4965e80 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:55.072909 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-6bd7a3c3-0702-41aa-b835-e6bad4965e80 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 7add95a5-9fb0-4c27-8836-5f24f8c0113f] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:55.078854 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6bd7a3c3-0702-41aa-b835-e6bad4965e80 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:55.079332 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6bd7a3c3-0702-41aa-b835-e6bad4965e80 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:55.080095 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6bd7a3c3-0702-41aa-b835-e6bad4965e80 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:55.080526 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6bd7a3c3-0702-41aa-b835-e6bad4965e80 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:55.203408 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-6bd7a3c3-0702-41aa-b835-e6bad4965e80 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:55.210890 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-6bd7a3c3-0702-41aa-b835-e6bad4965e80 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f" status: 200 len: 1317 microversion: 2.1 time: 0.142397 Oct 29 01:14:55.211450 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 209/410] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:55 2021] GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f => generated 1317 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:55.904887 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-463dc23f-d986-469c-a39a-59067daa7d37 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:55.905376 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-463dc23f-d986-469c-a39a-59067daa7d37 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:55.911552 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-463dc23f-d986-469c-a39a-59067daa7d37 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:55.912936 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-463dc23f-d986-469c-a39a-59067daa7d37 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:55.913683 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-463dc23f-d986-469c-a39a-59067daa7d37 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:55.914109 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-463dc23f-d986-469c-a39a-59067daa7d37 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:56.025218 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-b438ed56-c2a2-4255-93ed-5e6a7860a9f5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:56.025823 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-b438ed56-c2a2-4255-93ed-5e6a7860a9f5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:56.032156 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b438ed56-c2a2-4255-93ed-5e6a7860a9f5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:56.032445 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-463dc23f-d986-469c-a39a-59067daa7d37 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:56.032897 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b438ed56-c2a2-4255-93ed-5e6a7860a9f5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:56.033363 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b438ed56-c2a2-4255-93ed-5e6a7860a9f5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:56.033793 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b438ed56-c2a2-4255-93ed-5e6a7860a9f5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:56.040964 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-463dc23f-d986-469c-a39a-59067daa7d37 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:56.042457 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-463dc23f-d986-469c-a39a-59067daa7d37 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:56.043576 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-463dc23f-d986-469c-a39a-59067daa7d37 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1723 microversion: 2.20 time: 0.142500 Oct 29 01:14:56.044125 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 202/411] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:14:55 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1723 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:14:56.155010 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-b438ed56-c2a2-4255-93ed-5e6a7860a9f5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:56.162815 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-b438ed56-c2a2-4255-93ed-5e6a7860a9f5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.141144 Oct 29 01:14:56.163380 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 210/412] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:56 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:56.227408 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d1e2ff41-92dd-474c-9e36-c2533dae5ac8 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:56.228002 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d1e2ff41-92dd-474c-9e36-c2533dae5ac8 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 7add95a5-9fb0-4c27-8836-5f24f8c0113f] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:56.233668 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d1e2ff41-92dd-474c-9e36-c2533dae5ac8 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:56.234102 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d1e2ff41-92dd-474c-9e36-c2533dae5ac8 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:56.234871 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d1e2ff41-92dd-474c-9e36-c2533dae5ac8 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:56.235325 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d1e2ff41-92dd-474c-9e36-c2533dae5ac8 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:56.358562 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-d1e2ff41-92dd-474c-9e36-c2533dae5ac8 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:56.365873 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d1e2ff41-92dd-474c-9e36-c2533dae5ac8 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f" status: 200 len: 1317 microversion: 2.1 time: 0.142570 Oct 29 01:14:56.366439 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 203/413] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:56 2021] GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f => generated 1317 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:57.061457 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-4146dc60-cee1-4f21-8d13-835ec7533a73 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:57.061989 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-4146dc60-cee1-4f21-8d13-835ec7533a73 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:57.068181 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4146dc60-cee1-4f21-8d13-835ec7533a73 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:57.068627 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4146dc60-cee1-4f21-8d13-835ec7533a73 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:57.069379 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4146dc60-cee1-4f21-8d13-835ec7533a73 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:57.069806 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4146dc60-cee1-4f21-8d13-835ec7533a73 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:57.179593 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-36691c42-f54b-41e3-8c1e-be4ed9312b62 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:57.180191 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-36691c42-f54b-41e3-8c1e-be4ed9312b62 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:57.186324 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-36691c42-f54b-41e3-8c1e-be4ed9312b62 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:57.186701 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-36691c42-f54b-41e3-8c1e-be4ed9312b62 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:57.187454 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-36691c42-f54b-41e3-8c1e-be4ed9312b62 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:57.187878 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-36691c42-f54b-41e3-8c1e-be4ed9312b62 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:57.188821 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-4146dc60-cee1-4f21-8d13-835ec7533a73 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:57.196506 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-4146dc60-cee1-4f21-8d13-835ec7533a73 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:57.198043 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-4146dc60-cee1-4f21-8d13-835ec7533a73 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:57.199229 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-4146dc60-cee1-4f21-8d13-835ec7533a73 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1723 microversion: 2.20 time: 0.141541 Oct 29 01:14:57.199782 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 211/414] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:14:57 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1723 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:14:57.306028 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-36691c42-f54b-41e3-8c1e-be4ed9312b62 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:57.313230 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-36691c42-f54b-41e3-8c1e-be4ed9312b62 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.137769 Oct 29 01:14:57.313726 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 204/415] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:57 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:57.383333 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-a841dbaf-81aa-4262-a16d-67836f363839 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:57.383943 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-a841dbaf-81aa-4262-a16d-67836f363839 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 7add95a5-9fb0-4c27-8836-5f24f8c0113f] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:57.389704 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a841dbaf-81aa-4262-a16d-67836f363839 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:57.390153 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a841dbaf-81aa-4262-a16d-67836f363839 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:57.390974 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a841dbaf-81aa-4262-a16d-67836f363839 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:57.391412 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a841dbaf-81aa-4262-a16d-67836f363839 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:57.520482 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-a841dbaf-81aa-4262-a16d-67836f363839 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:57.528409 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-a841dbaf-81aa-4262-a16d-67836f363839 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f" status: 200 len: 1317 microversion: 2.1 time: 0.148713 Oct 29 01:14:57.528969 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 212/416] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:57 2021] GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:58.216610 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-1f12be20-d8ce-4a77-8d3f-f493408e4032 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:58.217147 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-1f12be20-d8ce-4a77-8d3f-f493408e4032 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:58.223262 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1f12be20-d8ce-4a77-8d3f-f493408e4032 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:58.223702 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1f12be20-d8ce-4a77-8d3f-f493408e4032 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:58.224540 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1f12be20-d8ce-4a77-8d3f-f493408e4032 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:58.224991 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1f12be20-d8ce-4a77-8d3f-f493408e4032 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:58.330743 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-65a564be-a491-4d38-8a55-a3f5a972e579 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:58.331430 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-65a564be-a491-4d38-8a55-a3f5a972e579 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:58.338249 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-65a564be-a491-4d38-8a55-a3f5a972e579 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:58.338727 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-65a564be-a491-4d38-8a55-a3f5a972e579 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:58.339491 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-65a564be-a491-4d38-8a55-a3f5a972e579 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:58.339926 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-65a564be-a491-4d38-8a55-a3f5a972e579 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:58.346453 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-1f12be20-d8ce-4a77-8d3f-f493408e4032 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:58.354277 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-1f12be20-d8ce-4a77-8d3f-f493408e4032 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:58.355799 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-1f12be20-d8ce-4a77-8d3f-f493408e4032 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:58.356923 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-1f12be20-d8ce-4a77-8d3f-f493408e4032 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1723 microversion: 2.20 time: 0.143970 Oct 29 01:14:58.357479 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 205/417] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:14:58 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1723 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:14:58.458762 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-65a564be-a491-4d38-8a55-a3f5a972e579 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:58.466143 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-65a564be-a491-4d38-8a55-a3f5a972e579 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.139112 Oct 29 01:14:58.466792 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 213/418] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:58 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:58.544538 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ddda7a1c-dbd3-4a2b-b5b2-405d79c1a1bb tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:58.545142 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ddda7a1c-dbd3-4a2b-b5b2-405d79c1a1bb tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 7add95a5-9fb0-4c27-8836-5f24f8c0113f] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:58.550786 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ddda7a1c-dbd3-4a2b-b5b2-405d79c1a1bb tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:58.551234 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ddda7a1c-dbd3-4a2b-b5b2-405d79c1a1bb tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:58.551998 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ddda7a1c-dbd3-4a2b-b5b2-405d79c1a1bb tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:58.552467 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ddda7a1c-dbd3-4a2b-b5b2-405d79c1a1bb tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:58.680886 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-ddda7a1c-dbd3-4a2b-b5b2-405d79c1a1bb tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:58.687995 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ddda7a1c-dbd3-4a2b-b5b2-405d79c1a1bb tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f" status: 200 len: 1317 microversion: 2.1 time: 0.147091 Oct 29 01:14:58.688555 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 206/419] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:58 2021] GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:59.378548 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-420012a6-91ce-4c59-a5d9-3b0993bfc00e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:59.379898 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-420012a6-91ce-4c59-a5d9-3b0993bfc00e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:59.389437 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-420012a6-91ce-4c59-a5d9-3b0993bfc00e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:59.390197 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-420012a6-91ce-4c59-a5d9-3b0993bfc00e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:59.391243 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-420012a6-91ce-4c59-a5d9-3b0993bfc00e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:59.392419 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-420012a6-91ce-4c59-a5d9-3b0993bfc00e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:59.482467 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-30be812c-3f85-4b80-931a-a38347aa208b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:59.483760 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-30be812c-3f85-4b80-931a-a38347aa208b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:59.490675 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-30be812c-3f85-4b80-931a-a38347aa208b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:59.491455 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-30be812c-3f85-4b80-931a-a38347aa208b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:59.492585 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-30be812c-3f85-4b80-931a-a38347aa208b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:59.493314 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-30be812c-3f85-4b80-931a-a38347aa208b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:59.558840 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-420012a6-91ce-4c59-a5d9-3b0993bfc00e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:59.568569 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-420012a6-91ce-4c59-a5d9-3b0993bfc00e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:59.570086 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-420012a6-91ce-4c59-a5d9-3b0993bfc00e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:59.571298 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-420012a6-91ce-4c59-a5d9-3b0993bfc00e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1723 microversion: 2.20 time: 0.198054 Oct 29 01:14:59.582157 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 214/420] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:14:59 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:14:59.639056 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-30be812c-3f85-4b80-931a-a38347aa208b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:59.653985 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-30be812c-3f85-4b80-931a-a38347aa208b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.175160 Oct 29 01:14:59.654599 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 207/421] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:59 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:59.708127 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-b403e711-6fcd-41ac-87dc-7de38c76988f tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:59.709847 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-b403e711-6fcd-41ac-87dc-7de38c76988f tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 7add95a5-9fb0-4c27-8836-5f24f8c0113f] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:14:59.718858 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b403e711-6fcd-41ac-87dc-7de38c76988f tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:59.719311 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b403e711-6fcd-41ac-87dc-7de38c76988f tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:59.720457 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b403e711-6fcd-41ac-87dc-7de38c76988f tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:14:59.720884 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b403e711-6fcd-41ac-87dc-7de38c76988f tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:14:59.919339 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-b403e711-6fcd-41ac-87dc-7de38c76988f tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:59.928037 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-b403e711-6fcd-41ac-87dc-7de38c76988f tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f" status: 200 len: 1507 microversion: 2.1 time: 0.226542 Oct 29 01:14:59.929306 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 215/422] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:14:59 2021] GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f => generated 1507 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:00.589420 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-dd99dba1-7511-49ab-83ae-43db4fd0da84 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:00.589944 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-dd99dba1-7511-49ab-83ae-43db4fd0da84 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:00.596091 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dd99dba1-7511-49ab-83ae-43db4fd0da84 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:00.596540 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dd99dba1-7511-49ab-83ae-43db4fd0da84 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:00.597312 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dd99dba1-7511-49ab-83ae-43db4fd0da84 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:00.597746 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dd99dba1-7511-49ab-83ae-43db4fd0da84 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:00.670313 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e689665e-0ade-45dd-a826-3c3ddff7f1b9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:00.670973 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-e689665e-0ade-45dd-a826-3c3ddff7f1b9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:00.677672 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e689665e-0ade-45dd-a826-3c3ddff7f1b9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:00.678160 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e689665e-0ade-45dd-a826-3c3ddff7f1b9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:00.678919 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e689665e-0ade-45dd-a826-3c3ddff7f1b9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:00.679417 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e689665e-0ade-45dd-a826-3c3ddff7f1b9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:00.753534 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-dd99dba1-7511-49ab-83ae-43db4fd0da84 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:00.769445 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-dd99dba1-7511-49ab-83ae-43db4fd0da84 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:00.771128 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-dd99dba1-7511-49ab-83ae-43db4fd0da84 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:00.772377 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-dd99dba1-7511-49ab-83ae-43db4fd0da84 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1723 microversion: 2.20 time: 0.186961 Oct 29 01:15:00.773225 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 208/423] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:15:00 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:00.820311 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-e689665e-0ade-45dd-a826-3c3ddff7f1b9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:00.827791 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-e689665e-0ade-45dd-a826-3c3ddff7f1b9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.161064 Oct 29 01:15:00.828995 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 216/424] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:00 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:01.805802 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-5a104037-f30d-4227-ace1-53a44631d9fa tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:01.808771 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-5a104037-f30d-4227-ace1-53a44631d9fa tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:01.823919 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5a104037-f30d-4227-ace1-53a44631d9fa tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:01.824644 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5a104037-f30d-4227-ace1-53a44631d9fa tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:01.825816 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5a104037-f30d-4227-ace1-53a44631d9fa tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:01.826494 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5a104037-f30d-4227-ace1-53a44631d9fa tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:01.847386 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-6293062a-dae5-4561-af65-f6d740f0405a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:01.848079 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-6293062a-dae5-4561-af65-f6d740f0405a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:01.855574 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6293062a-dae5-4561-af65-f6d740f0405a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:01.856045 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6293062a-dae5-4561-af65-f6d740f0405a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:01.857165 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6293062a-dae5-4561-af65-f6d740f0405a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:01.857591 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6293062a-dae5-4561-af65-f6d740f0405a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:02.092549 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-6293062a-dae5-4561-af65-f6d740f0405a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:02.100433 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-6293062a-dae5-4561-af65-f6d740f0405a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.256726 Oct 29 01:15:02.109335 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 217/425] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:01 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:15:02.126734 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-5a104037-f30d-4227-ace1-53a44631d9fa tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:02.135349 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-5a104037-f30d-4227-ace1-53a44631d9fa tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:02.136843 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-5a104037-f30d-4227-ace1-53a44631d9fa tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:02.137997 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-5a104037-f30d-4227-ace1-53a44631d9fa tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1723 microversion: 2.20 time: 0.347040 Oct 29 01:15:02.149060 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 209/426] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:15:01 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1723 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:02.455146 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-7944ac9d-5a17-4627-bed2-e0ead8f75c38 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88c364a5-e6d0-4b22-9fe5-6175485196b3"}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:02.456733 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-7944ac9d-5a17-4627-bed2-e0ead8f75c38 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 7add95a5-9fb0-4c27-8836-5f24f8c0113f] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:02.463608 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7944ac9d-5a17-4627-bed2-e0ead8f75c38 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:02.464144 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7944ac9d-5a17-4627-bed2-e0ead8f75c38 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:02.465132 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7944ac9d-5a17-4627-bed2-e0ead8f75c38 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:02.465580 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7944ac9d-5a17-4627-bed2-e0ead8f75c38 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:02.884594 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-7944ac9d-5a17-4627-bed2-e0ead8f75c38 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "POST /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.431304 Oct 29 01:15:02.886104 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 218/427] 10.222.0.90 () {60 vars in 1322 bytes} [Fri Oct 29 01:15:02 2021] POST /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f/os-volume_attachments => generated 194 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:15:03.118606 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ff3489e1-84a2-4e80-9159-5a31baca0249 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:03.119261 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ff3489e1-84a2-4e80-9159-5a31baca0249 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:03.126075 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ff3489e1-84a2-4e80-9159-5a31baca0249 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:03.126562 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ff3489e1-84a2-4e80-9159-5a31baca0249 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:03.127361 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ff3489e1-84a2-4e80-9159-5a31baca0249 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:03.127794 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ff3489e1-84a2-4e80-9159-5a31baca0249 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:03.156730 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-83fc907a-8a8c-4622-8961-e46c12451a1b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:03.157801 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-83fc907a-8a8c-4622-8961-e46c12451a1b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:03.167686 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-83fc907a-8a8c-4622-8961-e46c12451a1b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:03.169032 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-83fc907a-8a8c-4622-8961-e46c12451a1b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:03.169281 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-83fc907a-8a8c-4622-8961-e46c12451a1b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:03.169713 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-83fc907a-8a8c-4622-8961-e46c12451a1b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:03.294789 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-ff3489e1-84a2-4e80-9159-5a31baca0249 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:03.303065 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ff3489e1-84a2-4e80-9159-5a31baca0249 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.188304 Oct 29 01:15:03.303768 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 210/428] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:03 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:03.330903 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-83fc907a-8a8c-4622-8961-e46c12451a1b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:03.339351 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-83fc907a-8a8c-4622-8961-e46c12451a1b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:03.340866 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-83fc907a-8a8c-4622-8961-e46c12451a1b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:03.342113 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-83fc907a-8a8c-4622-8961-e46c12451a1b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1723 microversion: 2.20 time: 0.189657 Oct 29 01:15:03.347106 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 219/429] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:15:03 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:15:04.321189 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-548221bd-0295-49a5-b9db-5179b8bbdae3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:04.321995 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-548221bd-0295-49a5-b9db-5179b8bbdae3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:04.328940 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-548221bd-0295-49a5-b9db-5179b8bbdae3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:04.329404 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-548221bd-0295-49a5-b9db-5179b8bbdae3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:04.330184 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-548221bd-0295-49a5-b9db-5179b8bbdae3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:04.330653 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-548221bd-0295-49a5-b9db-5179b8bbdae3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:04.362740 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-caaf6b31-0fcf-4cf7-aec3-491ac6f027ef tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:04.365458 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-caaf6b31-0fcf-4cf7-aec3-491ac6f027ef tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:04.372547 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-caaf6b31-0fcf-4cf7-aec3-491ac6f027ef tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:04.373341 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-caaf6b31-0fcf-4cf7-aec3-491ac6f027ef tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:04.374573 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-caaf6b31-0fcf-4cf7-aec3-491ac6f027ef tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:04.375221 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-caaf6b31-0fcf-4cf7-aec3-491ac6f027ef tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:04.566284 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-caaf6b31-0fcf-4cf7-aec3-491ac6f027ef tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:04.580480 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-548221bd-0295-49a5-b9db-5179b8bbdae3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:04.590003 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-caaf6b31-0fcf-4cf7-aec3-491ac6f027ef tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:04.591694 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-caaf6b31-0fcf-4cf7-aec3-491ac6f027ef tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:04.592943 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-caaf6b31-0fcf-4cf7-aec3-491ac6f027ef tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1723 microversion: 2.20 time: 0.233923 Oct 29 01:15:04.593463 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-548221bd-0295-49a5-b9db-5179b8bbdae3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.275178 Oct 29 01:15:04.599433 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 220/430] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:15:04 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:15:04.608263 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 211/431] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:04 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:05.611179 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-964a2e73-e98e-465b-a664-0c7812177f5f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:05.611808 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-964a2e73-e98e-465b-a664-0c7812177f5f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:05.619741 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-964a2e73-e98e-465b-a664-0c7812177f5f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:05.619959 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-8895a627-daf8-494b-9a91-735b2ea2e9a5 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:05.620527 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-964a2e73-e98e-465b-a664-0c7812177f5f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:05.621056 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-8895a627-daf8-494b-9a91-735b2ea2e9a5 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:05.621603 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-964a2e73-e98e-465b-a664-0c7812177f5f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:05.622205 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-964a2e73-e98e-465b-a664-0c7812177f5f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:05.628131 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8895a627-daf8-494b-9a91-735b2ea2e9a5 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:05.628583 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8895a627-daf8-494b-9a91-735b2ea2e9a5 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:05.629381 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8895a627-daf8-494b-9a91-735b2ea2e9a5 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:05.629932 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8895a627-daf8-494b-9a91-735b2ea2e9a5 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:05.827588 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-964a2e73-e98e-465b-a664-0c7812177f5f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:05.829675 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-8895a627-daf8-494b-9a91-735b2ea2e9a5 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:05.837736 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-964a2e73-e98e-465b-a664-0c7812177f5f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.230036 Oct 29 01:15:05.838657 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 221/432] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:05 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:05.839824 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-8895a627-daf8-494b-9a91-735b2ea2e9a5 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:05.841737 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-8895a627-daf8-494b-9a91-735b2ea2e9a5 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:05.843268 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-8895a627-daf8-494b-9a91-735b2ea2e9a5 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1723 microversion: 2.20 time: 0.227760 Oct 29 01:15:05.843898 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 212/433] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:15:05 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:15:06.854404 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-143cbcb1-7546-44e7-8810-fc2784727e3d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:06.855061 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-143cbcb1-7546-44e7-8810-fc2784727e3d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:06.861617 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-143cbcb1-7546-44e7-8810-fc2784727e3d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:06.862285 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-143cbcb1-7546-44e7-8810-fc2784727e3d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:06.863250 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-143cbcb1-7546-44e7-8810-fc2784727e3d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:06.863685 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-143cbcb1-7546-44e7-8810-fc2784727e3d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:06.866345 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-46dd80e7-d5d3-404d-be95-0b5276120b8e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:06.867656 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-46dd80e7-d5d3-404d-be95-0b5276120b8e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:06.874608 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-46dd80e7-d5d3-404d-be95-0b5276120b8e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:06.875348 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-46dd80e7-d5d3-404d-be95-0b5276120b8e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:06.876203 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-46dd80e7-d5d3-404d-be95-0b5276120b8e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:06.876879 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-46dd80e7-d5d3-404d-be95-0b5276120b8e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:07.059084 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-143cbcb1-7546-44e7-8810-fc2784727e3d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:07.073473 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-143cbcb1-7546-44e7-8810-fc2784727e3d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.222646 Oct 29 01:15:07.074064 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 222/434] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:06 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:07.079695 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-46dd80e7-d5d3-404d-be95-0b5276120b8e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:07.089040 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-46dd80e7-d5d3-404d-be95-0b5276120b8e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:07.090557 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-46dd80e7-d5d3-404d-be95-0b5276120b8e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:07.091701 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-46dd80e7-d5d3-404d-be95-0b5276120b8e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1723 microversion: 2.20 time: 0.229371 Oct 29 01:15:07.092254 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 213/435] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:15:06 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:08.090738 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-263485fc-5391-48fc-b5a3-a18f8d7fea56 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:08.091318 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-263485fc-5391-48fc-b5a3-a18f8d7fea56 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:08.099783 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-263485fc-5391-48fc-b5a3-a18f8d7fea56 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:08.100864 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-263485fc-5391-48fc-b5a3-a18f8d7fea56 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:08.102192 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-263485fc-5391-48fc-b5a3-a18f8d7fea56 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:08.102192 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-263485fc-5391-48fc-b5a3-a18f8d7fea56 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:08.108643 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-1edac758-decf-4e8f-8b97-2b7f226d54f9 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:08.109886 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-1edac758-decf-4e8f-8b97-2b7f226d54f9 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:08.118313 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1edac758-decf-4e8f-8b97-2b7f226d54f9 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:08.119078 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1edac758-decf-4e8f-8b97-2b7f226d54f9 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:08.120106 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1edac758-decf-4e8f-8b97-2b7f226d54f9 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:08.122901 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1edac758-decf-4e8f-8b97-2b7f226d54f9 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:08.324950 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-1edac758-decf-4e8f-8b97-2b7f226d54f9 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:08.328139 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-263485fc-5391-48fc-b5a3-a18f8d7fea56 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:08.333869 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-1edac758-decf-4e8f-8b97-2b7f226d54f9 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:08.335904 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-1edac758-decf-4e8f-8b97-2b7f226d54f9 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:08.336462 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-263485fc-5391-48fc-b5a3-a18f8d7fea56 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.249450 Oct 29 01:15:08.337483 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-1edac758-decf-4e8f-8b97-2b7f226d54f9 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1723 microversion: 2.20 time: 0.232348 Oct 29 01:15:08.338249 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 214/436] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:15:08 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:08.344846 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 223/437] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:08 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:09.360999 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d34210b3-5897-4c6e-832d-099a7e790379 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:09.361782 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-8bd82e05-4a33-4df0-bb5b-f1f90325232d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:09.362917 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-8bd82e05-4a33-4df0-bb5b-f1f90325232d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:09.363251 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d34210b3-5897-4c6e-832d-099a7e790379 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:09.374822 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d34210b3-5897-4c6e-832d-099a7e790379 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:09.384195 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8bd82e05-4a33-4df0-bb5b-f1f90325232d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:09.385257 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d34210b3-5897-4c6e-832d-099a7e790379 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:09.386076 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d34210b3-5897-4c6e-832d-099a7e790379 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:09.386536 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d34210b3-5897-4c6e-832d-099a7e790379 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:09.388327 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8bd82e05-4a33-4df0-bb5b-f1f90325232d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:09.389390 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8bd82e05-4a33-4df0-bb5b-f1f90325232d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:09.390619 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8bd82e05-4a33-4df0-bb5b-f1f90325232d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:09.658615 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-d34210b3-5897-4c6e-832d-099a7e790379 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:09.682244 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d34210b3-5897-4c6e-832d-099a7e790379 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.329774 Oct 29 01:15:09.685642 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 215/438] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:09 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:09.739546 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-8bd82e05-4a33-4df0-bb5b-f1f90325232d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:09.754903 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-8bd82e05-4a33-4df0-bb5b-f1f90325232d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:09.757904 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-8bd82e05-4a33-4df0-bb5b-f1f90325232d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:09.761371 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-8bd82e05-4a33-4df0-bb5b-f1f90325232d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1744 microversion: 2.20 time: 0.408833 Oct 29 01:15:09.764702 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 224/439] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:15:09 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1744 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:10.701399 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ace952e1-2c53-4af4-9875-8810c8936d8a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:10.702646 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ace952e1-2c53-4af4-9875-8810c8936d8a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:10.711269 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ace952e1-2c53-4af4-9875-8810c8936d8a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:10.712743 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ace952e1-2c53-4af4-9875-8810c8936d8a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:10.713644 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ace952e1-2c53-4af4-9875-8810c8936d8a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:10.713967 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ace952e1-2c53-4af4-9875-8810c8936d8a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:10.785138 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-73dd240e-a5f0-4638-ab34-b7a4963a2708 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:10.786732 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-73dd240e-a5f0-4638-ab34-b7a4963a2708 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:10.795996 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-73dd240e-a5f0-4638-ab34-b7a4963a2708 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:10.796812 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-73dd240e-a5f0-4638-ab34-b7a4963a2708 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:10.797829 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-73dd240e-a5f0-4638-ab34-b7a4963a2708 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:10.798689 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-73dd240e-a5f0-4638-ab34-b7a4963a2708 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:10.991784 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-ace952e1-2c53-4af4-9875-8810c8936d8a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:11.006126 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ace952e1-2c53-4af4-9875-8810c8936d8a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.304208 Oct 29 01:15:11.008333 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 216/440] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:10 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:11.045650 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-73dd240e-a5f0-4638-ab34-b7a4963a2708 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:11.054167 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-73dd240e-a5f0-4638-ab34-b7a4963a2708 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:11.056031 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-73dd240e-a5f0-4638-ab34-b7a4963a2708 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:11.057458 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-73dd240e-a5f0-4638-ab34-b7a4963a2708 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1744 microversion: 2.20 time: 0.278332 Oct 29 01:15:11.069065 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 225/441] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:15:10 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1744 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:11.809981 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-43f9357f-5b57-4539-8901-0e0c1eddf4a0 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:11.811307 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-43f9357f-5b57-4539-8901-0e0c1eddf4a0 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 7add95a5-9fb0-4c27-8836-5f24f8c0113f] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:11.819363 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-43f9357f-5b57-4539-8901-0e0c1eddf4a0 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:11.820057 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-43f9357f-5b57-4539-8901-0e0c1eddf4a0 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:11.820818 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-43f9357f-5b57-4539-8901-0e0c1eddf4a0 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:11.821406 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-43f9357f-5b57-4539-8901-0e0c1eddf4a0 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:11.919453 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [req-7bc1d346-938d-4ddf-9fdc-e0da5224a8d5 req-a7db3480-91d9-4a44-8c43-007e4a7367c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27a73464-dcac-4be6-a392-58d40a0296a8", "name": "network-vif-plugged", "status": "completed", "tag": "f3a5c6a4-eba2-4bfd-91f6-59386b7c88e8"}]} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:11.921122 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:15:11.921122 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: warnings.warn(msg) Oct 29 01:15:11.938703 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-7bc1d346-938d-4ddf-9fdc-e0da5224a8d5 req-a7db3480-91d9-4a44-8c43-007e4a7367c7 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:11.939525 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-7bc1d346-938d-4ddf-9fdc-e0da5224a8d5 req-a7db3480-91d9-4a44-8c43-007e4a7367c7 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:11.980901 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.compute.server_external_events [req-7bc1d346-938d-4ddf-9fdc-e0da5224a8d5 req-a7db3480-91d9-4a44-8c43-007e4a7367c7 service nova] Creating event network-vif-plugged:f3a5c6a4-eba2-4bfd-91f6-59386b7c88e8 for instance 27a73464-dcac-4be6-a392-58d40a0296a8 on hv-cinder-81558 Oct 29 01:15:11.985879 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.objects.instance [None req-43f9357f-5b57-4539-8901-0e0c1eddf4a0 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lazy-loading 'services' on Instance uuid 7add95a5-9fb0-4c27-8836-5f24f8c0113f {{(pid=115747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:15:11.993963 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [req-7bc1d346-938d-4ddf-9fdc-e0da5224a8d5 req-a7db3480-91d9-4a44-8c43-007e4a7367c7 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086285 Oct 29 01:15:12.004131 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 226/442] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:15:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:15:12.027818 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2ebe377a-9d59-42e9-83b9-9af32aba2345 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:12.028780 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2ebe377a-9d59-42e9-83b9-9af32aba2345 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:12.040102 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2ebe377a-9d59-42e9-83b9-9af32aba2345 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:12.040562 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2ebe377a-9d59-42e9-83b9-9af32aba2345 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:12.041352 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2ebe377a-9d59-42e9-83b9-9af32aba2345 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:12.041798 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2ebe377a-9d59-42e9-83b9-9af32aba2345 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:12.113242 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-43f9357f-5b57-4539-8901-0e0c1eddf4a0 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "DELETE /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f/os-volume_attachments/88c364a5-e6d0-4b22-9fe5-6175485196b3" status: 202 len: 0 microversion: 2.1 time: 0.308943 Oct 29 01:15:12.114596 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 217/443] 10.222.0.90 () {58 vars in 1415 bytes} [Fri Oct 29 01:15:11 2021] DELETE /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f/os-volume_attachments/88c364a5-e6d0-4b22-9fe5-6175485196b3 => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:15:12.119915 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-657a6fcd-8c97-4233-a937-82e73b823d88 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:12.120650 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-657a6fcd-8c97-4233-a937-82e73b823d88 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:12.127096 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-657a6fcd-8c97-4233-a937-82e73b823d88 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:12.127540 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-657a6fcd-8c97-4233-a937-82e73b823d88 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:12.128315 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-657a6fcd-8c97-4233-a937-82e73b823d88 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:12.128782 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-657a6fcd-8c97-4233-a937-82e73b823d88 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:12.295300 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-2ebe377a-9d59-42e9-83b9-9af32aba2345 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:12.309003 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2ebe377a-9d59-42e9-83b9-9af32aba2345 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.285117 Oct 29 01:15:12.318678 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 227/444] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:12 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:12.318678 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-520f3c92-3c0c-4ef1-8ed2-b244cc254f42 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:12.318678 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-520f3c92-3c0c-4ef1-8ed2-b244cc254f42 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 7add95a5-9fb0-4c27-8836-5f24f8c0113f] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:12.330409 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-520f3c92-3c0c-4ef1-8ed2-b244cc254f42 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:12.330873 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-520f3c92-3c0c-4ef1-8ed2-b244cc254f42 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:12.331751 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-520f3c92-3c0c-4ef1-8ed2-b244cc254f42 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:12.332089 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-520f3c92-3c0c-4ef1-8ed2-b244cc254f42 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:12.372449 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-657a6fcd-8c97-4233-a937-82e73b823d88 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:12.383815 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-520f3c92-3c0c-4ef1-8ed2-b244cc254f42 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072778 Oct 29 01:15:12.384886 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 228/445] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:15:12 2021] GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:15:12.391458 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-657a6fcd-8c97-4233-a937-82e73b823d88 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:12.396028 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-657a6fcd-8c97-4233-a937-82e73b823d88 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:12.400546 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-657a6fcd-8c97-4233-a937-82e73b823d88 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1739 microversion: 2.20 time: 0.284668 Oct 29 01:15:12.405442 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 218/446] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:15:12 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1739 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:13.327751 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-3460f47b-f3dc-446d-a700-de0c1a044048 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:13.329244 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-3460f47b-f3dc-446d-a700-de0c1a044048 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:13.338019 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3460f47b-f3dc-446d-a700-de0c1a044048 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:13.339142 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3460f47b-f3dc-446d-a700-de0c1a044048 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:13.340119 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3460f47b-f3dc-446d-a700-de0c1a044048 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:13.340709 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3460f47b-f3dc-446d-a700-de0c1a044048 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:13.395616 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-e05007d2-8be5-479a-b97d-787815f5363b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:13.396595 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-e05007d2-8be5-479a-b97d-787815f5363b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 7add95a5-9fb0-4c27-8836-5f24f8c0113f] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:13.409806 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e05007d2-8be5-479a-b97d-787815f5363b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:13.417372 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e05007d2-8be5-479a-b97d-787815f5363b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:13.418742 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e05007d2-8be5-479a-b97d-787815f5363b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:13.419339 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e05007d2-8be5-479a-b97d-787815f5363b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:13.502104 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-e05007d2-8be5-479a-b97d-787815f5363b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110175 Oct 29 01:15:13.506704 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 219/447] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:15:13 2021] GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:15:13.512006 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b74413a5-d392-42de-88c6-1be5fa772453 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:13.512619 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b74413a5-d392-42de-88c6-1be5fa772453 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:13.533341 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b74413a5-d392-42de-88c6-1be5fa772453 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:13.534170 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b74413a5-d392-42de-88c6-1be5fa772453 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:13.535009 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b74413a5-d392-42de-88c6-1be5fa772453 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:13.535967 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b74413a5-d392-42de-88c6-1be5fa772453 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:13.686349 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-3460f47b-f3dc-446d-a700-de0c1a044048 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:13.710111 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-3460f47b-f3dc-446d-a700-de0c1a044048 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.387068 Oct 29 01:15:13.711375 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 229/448] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:13 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:13.914004 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-b74413a5-d392-42de-88c6-1be5fa772453 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:13.923823 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-b74413a5-d392-42de-88c6-1be5fa772453 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:13.933709 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-b74413a5-d392-42de-88c6-1be5fa772453 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:13.935246 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b74413a5-d392-42de-88c6-1be5fa772453 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1739 microversion: 2.20 time: 0.427572 Oct 29 01:15:13.961144 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 220/449] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:15:13 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1739 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:14.516729 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c50324fd-5311-41e2-ab27-1d26cabb6d92 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:14.519192 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c50324fd-5311-41e2-ab27-1d26cabb6d92 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 7add95a5-9fb0-4c27-8836-5f24f8c0113f] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:14.533605 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c50324fd-5311-41e2-ab27-1d26cabb6d92 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:14.534334 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c50324fd-5311-41e2-ab27-1d26cabb6d92 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:14.542297 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c50324fd-5311-41e2-ab27-1d26cabb6d92 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:14.543086 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c50324fd-5311-41e2-ab27-1d26cabb6d92 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:14.601273 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c50324fd-5311-41e2-ab27-1d26cabb6d92 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080677 Oct 29 01:15:14.604044 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 230/450] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:15:14 2021] GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:15:14.726636 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f1c2d9c5-3d47-4f63-af04-f07b405c49da tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:14.727970 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f1c2d9c5-3d47-4f63-af04-f07b405c49da tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:14.750150 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f1c2d9c5-3d47-4f63-af04-f07b405c49da tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:14.751129 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f1c2d9c5-3d47-4f63-af04-f07b405c49da tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:14.752199 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f1c2d9c5-3d47-4f63-af04-f07b405c49da tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:14.752865 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f1c2d9c5-3d47-4f63-af04-f07b405c49da tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:14.974332 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2124602d-76da-4fce-a7e5-e8a569be2e6d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:14.974978 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2124602d-76da-4fce-a7e5-e8a569be2e6d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:14.985656 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2124602d-76da-4fce-a7e5-e8a569be2e6d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:14.986241 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2124602d-76da-4fce-a7e5-e8a569be2e6d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:14.991446 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2124602d-76da-4fce-a7e5-e8a569be2e6d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:14.992255 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2124602d-76da-4fce-a7e5-e8a569be2e6d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:15.076560 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-f1c2d9c5-3d47-4f63-af04-f07b405c49da tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:15.085105 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f1c2d9c5-3d47-4f63-af04-f07b405c49da tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.362144 Oct 29 01:15:15.093135 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 221/451] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:14 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:15.442421 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-2124602d-76da-4fce-a7e5-e8a569be2e6d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:15.454492 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-2124602d-76da-4fce-a7e5-e8a569be2e6d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:15.461476 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-2124602d-76da-4fce-a7e5-e8a569be2e6d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:15.462884 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2124602d-76da-4fce-a7e5-e8a569be2e6d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1739 microversion: 2.20 time: 0.511865 Oct 29 01:15:15.467329 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 231/452] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:15:14 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1739 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:16.020614 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-fc7928d5-b003-4ccf-837a-be5f75abb437 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:16.021838 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-fc7928d5-b003-4ccf-837a-be5f75abb437 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 7add95a5-9fb0-4c27-8836-5f24f8c0113f] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:16.029171 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fc7928d5-b003-4ccf-837a-be5f75abb437 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:16.032087 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fc7928d5-b003-4ccf-837a-be5f75abb437 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:16.033322 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fc7928d5-b003-4ccf-837a-be5f75abb437 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:16.033976 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fc7928d5-b003-4ccf-837a-be5f75abb437 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:16.080562 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-fc7928d5-b003-4ccf-837a-be5f75abb437 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 7add95a5-9fb0-4c27-8836-5f24f8c0113f] Going to try to terminate instance {{(pid=115747) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 01:15:16.111581 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-62ea809b-ce22-4d61-9891-956047df4dfb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:16.112224 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-62ea809b-ce22-4d61-9891-956047df4dfb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:16.119461 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-62ea809b-ce22-4d61-9891-956047df4dfb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:16.120380 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-62ea809b-ce22-4d61-9891-956047df4dfb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:16.121547 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-62ea809b-ce22-4d61-9891-956047df4dfb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:16.122255 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-62ea809b-ce22-4d61-9891-956047df4dfb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:16.251795 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-fc7928d5-b003-4ccf-837a-be5f75abb437 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "DELETE /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f" status: 204 len: 0 microversion: 2.1 time: 0.236899 Oct 29 01:15:16.252822 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 222/453] 10.222.0.90 () {58 vars in 1238 bytes} [Fri Oct 29 01:15:16 2021] DELETE /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 01:15:16.261862 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a70e6311-a644-45d1-95d2-9be18484367e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:16.263014 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a70e6311-a644-45d1-95d2-9be18484367e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 7add95a5-9fb0-4c27-8836-5f24f8c0113f] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:16.276170 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a70e6311-a644-45d1-95d2-9be18484367e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:16.278941 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a70e6311-a644-45d1-95d2-9be18484367e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:16.285014 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a70e6311-a644-45d1-95d2-9be18484367e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:16.288002 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a70e6311-a644-45d1-95d2-9be18484367e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:16.321672 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-62ea809b-ce22-4d61-9891-956047df4dfb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:16.331639 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-62ea809b-ce22-4d61-9891-956047df4dfb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.225330 Oct 29 01:15:16.343568 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 232/454] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:16 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:15:16.475783 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-a70e6311-a644-45d1-95d2-9be18484367e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:16.485663 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-4ac79aa1-061b-4b3a-ab0f-e71c23a9ed0e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:16.486113 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a70e6311-a644-45d1-95d2-9be18484367e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f" status: 200 len: 1513 microversion: 2.1 time: 0.227816 Oct 29 01:15:16.486740 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-4ac79aa1-061b-4b3a-ab0f-e71c23a9ed0e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:16.495730 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 223/455] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:16 2021] GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f => generated 1513 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:16.503014 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4ac79aa1-061b-4b3a-ab0f-e71c23a9ed0e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:16.503761 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4ac79aa1-061b-4b3a-ab0f-e71c23a9ed0e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:16.504832 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4ac79aa1-061b-4b3a-ab0f-e71c23a9ed0e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:16.505487 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4ac79aa1-061b-4b3a-ab0f-e71c23a9ed0e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:16.671909 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c5ef869d-499a-40fd-bfc2-e5493010063e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-141432336", "imageRef": "3fef3f0d-d772-4999-b764-d6690634a06d", "flavorRef": "452", "networks": [{"uuid": "27173245-d0a5-41d2-a1be-c4a03b369c4b"}]}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:16.787316 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-4ac79aa1-061b-4b3a-ab0f-e71c23a9ed0e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:16.795994 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-4ac79aa1-061b-4b3a-ab0f-e71c23a9ed0e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:16.797815 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-4ac79aa1-061b-4b3a-ab0f-e71c23a9ed0e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:16.799322 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-4ac79aa1-061b-4b3a-ab0f-e71c23a9ed0e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1739 microversion: 2.20 time: 0.318218 Oct 29 01:15:16.811408 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 233/456] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:15:16 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1739 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:17.350988 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-5f682949-1bc6-4e77-aa7a-0eb288a5b231 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:17.352321 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-5f682949-1bc6-4e77-aa7a-0eb288a5b231 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:17.363847 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5f682949-1bc6-4e77-aa7a-0eb288a5b231 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:17.364871 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5f682949-1bc6-4e77-aa7a-0eb288a5b231 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:17.367020 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5f682949-1bc6-4e77-aa7a-0eb288a5b231 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:17.367919 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5f682949-1bc6-4e77-aa7a-0eb288a5b231 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:17.596748 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-5f682949-1bc6-4e77-aa7a-0eb288a5b231 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:17.607120 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-5f682949-1bc6-4e77-aa7a-0eb288a5b231 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.261340 Oct 29 01:15:17.612130 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 234/457] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:17 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:17.624050 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2162c1b2-4b16-46ac-8d53-4a5eb7672572 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:17.624913 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2162c1b2-4b16-46ac-8d53-4a5eb7672572 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 7add95a5-9fb0-4c27-8836-5f24f8c0113f] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:17.635451 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2162c1b2-4b16-46ac-8d53-4a5eb7672572 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:17.637466 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2162c1b2-4b16-46ac-8d53-4a5eb7672572 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:17.641926 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2162c1b2-4b16-46ac-8d53-4a5eb7672572 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:17.642823 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2162c1b2-4b16-46ac-8d53-4a5eb7672572 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:17.825802 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-2162c1b2-4b16-46ac-8d53-4a5eb7672572 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:17.841862 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2162c1b2-4b16-46ac-8d53-4a5eb7672572 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f" status: 200 len: 1513 microversion: 2.1 time: 0.227861 Oct 29 01:15:17.843178 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 235/458] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:17 2021] GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f => generated 1513 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:17.848202 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-97aaa675-78c5-4b85-a637-e05840d2c24f tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:17.849009 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-97aaa675-78c5-4b85-a637-e05840d2c24f tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:17.857966 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-97aaa675-78c5-4b85-a637-e05840d2c24f tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:17.859102 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-97aaa675-78c5-4b85-a637-e05840d2c24f tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:17.860180 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-97aaa675-78c5-4b85-a637-e05840d2c24f tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:17.860636 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-97aaa675-78c5-4b85-a637-e05840d2c24f tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:18.072595 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-97aaa675-78c5-4b85-a637-e05840d2c24f tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:18.086951 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-97aaa675-78c5-4b85-a637-e05840d2c24f tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:18.088675 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-97aaa675-78c5-4b85-a637-e05840d2c24f tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:18.090004 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-97aaa675-78c5-4b85-a637-e05840d2c24f tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1739 microversion: 2.20 time: 0.245838 Oct 29 01:15:18.090721 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 236/459] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:15:17 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1739 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:18.629754 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-43961778-8462-409e-ba76-c153ab676482 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:18.632507 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-43961778-8462-409e-ba76-c153ab676482 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:18.642106 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-43961778-8462-409e-ba76-c153ab676482 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:18.643355 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-43961778-8462-409e-ba76-c153ab676482 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:18.645665 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-43961778-8462-409e-ba76-c153ab676482 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:18.646746 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-43961778-8462-409e-ba76-c153ab676482 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:18.833395 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-43961778-8462-409e-ba76-c153ab676482 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:18.859629 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-43961778-8462-409e-ba76-c153ab676482 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.219556 Oct 29 01:15:18.859629 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 237/460] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:18 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:18.865096 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d7443bbf-fe8c-4212-8a14-881829d808d1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:18.865096 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d7443bbf-fe8c-4212-8a14-881829d808d1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 7add95a5-9fb0-4c27-8836-5f24f8c0113f] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:18.875789 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d7443bbf-fe8c-4212-8a14-881829d808d1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:18.889176 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d7443bbf-fe8c-4212-8a14-881829d808d1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:18.889176 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d7443bbf-fe8c-4212-8a14-881829d808d1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:18.889176 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d7443bbf-fe8c-4212-8a14-881829d808d1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:19.109019 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-d7443bbf-fe8c-4212-8a14-881829d808d1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:19.123273 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d7443bbf-fe8c-4212-8a14-881829d808d1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f" status: 200 len: 1513 microversion: 2.1 time: 0.260591 Oct 29 01:15:19.123273 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 238/461] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:18 2021] GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f => generated 1513 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:15:19.127313 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-a8e525c4-d68c-4ce7-bbaf-f5f803cb5480 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:19.128058 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-a8e525c4-d68c-4ce7-bbaf-f5f803cb5480 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:19.143006 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a8e525c4-d68c-4ce7-bbaf-f5f803cb5480 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:19.143831 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a8e525c4-d68c-4ce7-bbaf-f5f803cb5480 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:19.146119 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a8e525c4-d68c-4ce7-bbaf-f5f803cb5480 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:19.146892 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a8e525c4-d68c-4ce7-bbaf-f5f803cb5480 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:19.322825 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-a8e525c4-d68c-4ce7-bbaf-f5f803cb5480 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:19.345057 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-a8e525c4-d68c-4ce7-bbaf-f5f803cb5480 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:19.348067 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-a8e525c4-d68c-4ce7-bbaf-f5f803cb5480 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:19.359481 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-a8e525c4-d68c-4ce7-bbaf-f5f803cb5480 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1739 microversion: 2.20 time: 0.226892 Oct 29 01:15:19.361335 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 239/462] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:15:19 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1739 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:19.872392 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-7e9eae96-8f48-41ca-8081-987f2c710ee7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:19.873927 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-7e9eae96-8f48-41ca-8081-987f2c710ee7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:19.882776 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7e9eae96-8f48-41ca-8081-987f2c710ee7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:19.891993 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7e9eae96-8f48-41ca-8081-987f2c710ee7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:19.893234 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7e9eae96-8f48-41ca-8081-987f2c710ee7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:19.893890 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7e9eae96-8f48-41ca-8081-987f2c710ee7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:20.080988 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-7e9eae96-8f48-41ca-8081-987f2c710ee7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:20.091634 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-7e9eae96-8f48-41ca-8081-987f2c710ee7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.223304 Oct 29 01:15:20.093965 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 240/463] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:19 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:20.137012 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-48cce418-8c78-4604-a7e5-d6c8620cc0f3 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:20.137632 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-48cce418-8c78-4604-a7e5-d6c8620cc0f3 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 7add95a5-9fb0-4c27-8836-5f24f8c0113f] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:20.153080 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-48cce418-8c78-4604-a7e5-d6c8620cc0f3 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:20.153655 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-48cce418-8c78-4604-a7e5-d6c8620cc0f3 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:20.154595 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-48cce418-8c78-4604-a7e5-d6c8620cc0f3 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:20.155123 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-48cce418-8c78-4604-a7e5-d6c8620cc0f3 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:20.418300 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-48cce418-8c78-4604-a7e5-d6c8620cc0f3 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:20.425784 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-48cce418-8c78-4604-a7e5-d6c8620cc0f3 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f" status: 200 len: 1513 microversion: 2.1 time: 0.292503 Oct 29 01:15:20.426528 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 241/464] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:20 2021] GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f => generated 1513 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:20.437685 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-41c1c512-0af9-4133-bd23-552f5287d793 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:20.440832 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-41c1c512-0af9-4133-bd23-552f5287d793 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:20.447844 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-41c1c512-0af9-4133-bd23-552f5287d793 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:20.448875 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-41c1c512-0af9-4133-bd23-552f5287d793 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:20.449079 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-41c1c512-0af9-4133-bd23-552f5287d793 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:20.449508 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-41c1c512-0af9-4133-bd23-552f5287d793 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:20.661761 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-41c1c512-0af9-4133-bd23-552f5287d793 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:20.674267 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-41c1c512-0af9-4133-bd23-552f5287d793 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:20.677679 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-41c1c512-0af9-4133-bd23-552f5287d793 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:20.679212 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-41c1c512-0af9-4133-bd23-552f5287d793 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1739 microversion: 2.20 time: 0.251821 Oct 29 01:15:20.680178 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 242/465] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:15:20 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1739 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:20.693617 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [req-c57fcd9e-e073-471e-81a2-3eed2ba90d6d req-0575f7d5-1c8c-4fa8-b450-357ccd01a72a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7add95a5-9fb0-4c27-8836-5f24f8c0113f", "name": "network-vif-deleted", "tag": "4c562e62-28f1-44c6-babd-05ab91b12d6b"}]} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:20.696675 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:15:20.696675 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: warnings.warn(msg) Oct 29 01:15:20.706214 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-c57fcd9e-e073-471e-81a2-3eed2ba90d6d req-0575f7d5-1c8c-4fa8-b450-357ccd01a72a service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:20.707806 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-c57fcd9e-e073-471e-81a2-3eed2ba90d6d req-0575f7d5-1c8c-4fa8-b450-357ccd01a72a service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:20.768640 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.compute.server_external_events [req-c57fcd9e-e073-471e-81a2-3eed2ba90d6d req-0575f7d5-1c8c-4fa8-b450-357ccd01a72a service nova] Creating event network-vif-deleted:4c562e62-28f1-44c6-babd-05ab91b12d6b for instance 7add95a5-9fb0-4c27-8836-5f24f8c0113f on hv-cinder-81558 Oct 29 01:15:20.774809 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [req-c57fcd9e-e073-471e-81a2-3eed2ba90d6d req-0575f7d5-1c8c-4fa8-b450-357ccd01a72a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091865 Oct 29 01:15:20.780842 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 243/466] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:15:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:15:21.008138 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.network.neutron [None req-c5ef869d-499a-40fd-bfc2-e5493010063e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] validate_networks() for [('27173245-d0a5-41d2-a1be-c4a03b369c4b', None, None, None, None, None)] {{(pid=115747) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 01:15:21.109448 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2c1f4fc0-b90b-4c0f-b5cc-9898d30ffb15 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:21.110925 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2c1f4fc0-b90b-4c0f-b5cc-9898d30ffb15 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:21.118950 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2c1f4fc0-b90b-4c0f-b5cc-9898d30ffb15 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:21.119706 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2c1f4fc0-b90b-4c0f-b5cc-9898d30ffb15 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:21.120688 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2c1f4fc0-b90b-4c0f-b5cc-9898d30ffb15 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:21.121287 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2c1f4fc0-b90b-4c0f-b5cc-9898d30ffb15 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:21.349324 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-2c1f4fc0-b90b-4c0f-b5cc-9898d30ffb15 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:21.365472 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2c1f4fc0-b90b-4c0f-b5cc-9898d30ffb15 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.259833 Oct 29 01:15:21.366367 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 244/467] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:21 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:21.446165 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-5bdeeafd-ea33-4693-9cfe-3a92a56177e2 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:21.446968 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-5bdeeafd-ea33-4693-9cfe-3a92a56177e2 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 7add95a5-9fb0-4c27-8836-5f24f8c0113f] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:21.455282 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5bdeeafd-ea33-4693-9cfe-3a92a56177e2 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:21.455864 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5bdeeafd-ea33-4693-9cfe-3a92a56177e2 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:21.457300 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5bdeeafd-ea33-4693-9cfe-3a92a56177e2 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:21.457833 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5bdeeafd-ea33-4693-9cfe-3a92a56177e2 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:21.472733 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.wsgi [None req-5bdeeafd-ea33-4693-9cfe-3a92a56177e2 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] HTTP exception thrown: Instance 7add95a5-9fb0-4c27-8836-5f24f8c0113f could not be found. Oct 29 01:15:21.473462 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-5bdeeafd-ea33-4693-9cfe-3a92a56177e2 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Returning 404 to user: Instance 7add95a5-9fb0-4c27-8836-5f24f8c0113f could not be found. {{(pid=115748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:15:21.474304 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-5bdeeafd-ea33-4693-9cfe-3a92a56177e2 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f" status: 404 len: 111 microversion: 2.1 time: 0.035269 Oct 29 01:15:21.480451 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 245/468] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:21 2021] GET /compute/v2.1/servers/7add95a5-9fb0-4c27-8836-5f24f8c0113f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:15:21.484764 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-c5ef869d-499a-40fd-bfc2-e5493010063e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Flavor limits 0:0:0 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:15:21.485112 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-c5ef869d-499a-40fd-bfc2-e5493010063e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Image limits 0:0:0 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:15:21.485874 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-c5ef869d-499a-40fd-bfc2-e5493010063e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Flavor pref 0:0:0 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:15:21.486505 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-c5ef869d-499a-40fd-bfc2-e5493010063e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Image pref 0:0:0 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:15:21.487234 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-c5ef869d-499a-40fd-bfc2-e5493010063e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:15:21.497846 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c5ef869d-499a-40fd-bfc2-e5493010063e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:21.498281 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c5ef869d-499a-40fd-bfc2-e5493010063e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:21.499289 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c5ef869d-499a-40fd-bfc2-e5493010063e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:21.499877 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c5ef869d-499a-40fd-bfc2-e5493010063e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:21.521315 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.quota [None req-c5ef869d-499a-40fd-bfc2-e5493010063e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Getting quotas for project 24b83d8a1a4943748e8980793c6fbec7. Resources: {'instances', 'cores', 'ram'} {{(pid=115747) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:15:21.526146 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.quota [None req-c5ef869d-499a-40fd-bfc2-e5493010063e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Getting quotas for user 35b5e84fef6c4b3dabb6caaa8ad3aa2a and project 24b83d8a1a4943748e8980793c6fbec7. Resources: {'instances', 'cores', 'ram'} {{(pid=115747) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:15:21.542018 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c5ef869d-499a-40fd-bfc2-e5493010063e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Going to run 1 instances... {{(pid=115747) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 01:15:21.544965 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c5ef869d-499a-40fd-bfc2-e5493010063e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 8478f8e3-cdb3-437f-a710-b2230e5b8be7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3fef3f0d-d772-4999-b764-d6690634a06d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 01:15:21.604656 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c5ef869d-499a-40fd-bfc2-e5493010063e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.936354 Oct 29 01:15:21.608125 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 224/469] 10.222.0.90 () {60 vars in 1146 bytes} [Fri Oct 29 01:15:16 2021] POST /compute/v2.1/servers => generated 380 bytes in 4940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:15:21.617779 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-4261670b-325e-4c2e-b44f-0c5d1242c88e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:21.618646 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-4261670b-325e-4c2e-b44f-0c5d1242c88e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 8478f8e3-cdb3-437f-a710-b2230e5b8be7] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:21.680181 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-4261670b-325e-4c2e-b44f-0c5d1242c88e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:21.687081 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-4261670b-325e-4c2e-b44f-0c5d1242c88e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/8478f8e3-cdb3-437f-a710-b2230e5b8be7" status: 200 len: 1218 microversion: 2.1 time: 0.073126 Oct 29 01:15:21.687655 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 246/470] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:21 2021] GET /compute/v2.1/servers/8478f8e3-cdb3-437f-a710-b2230e5b8be7 => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:21.702651 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-933c4803-4521-45d4-95ef-05b017c4a7af tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:21.703370 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-933c4803-4521-45d4-95ef-05b017c4a7af tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:21.717775 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-933c4803-4521-45d4-95ef-05b017c4a7af tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:21.718171 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-933c4803-4521-45d4-95ef-05b017c4a7af tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:21.718984 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-933c4803-4521-45d4-95ef-05b017c4a7af tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:21.719420 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-933c4803-4521-45d4-95ef-05b017c4a7af tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:21.894531 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-933c4803-4521-45d4-95ef-05b017c4a7af tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:21.907579 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-933c4803-4521-45d4-95ef-05b017c4a7af tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:21.909038 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-933c4803-4521-45d4-95ef-05b017c4a7af tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:21.913712 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-933c4803-4521-45d4-95ef-05b017c4a7af tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1739 microversion: 2.20 time: 0.215034 Oct 29 01:15:21.914452 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 225/471] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:15:21 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1739 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:22.383227 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-a69d8526-76e2-4d5d-be61-7c5a3f3da6c8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:22.384841 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-a69d8526-76e2-4d5d-be61-7c5a3f3da6c8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:22.392206 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a69d8526-76e2-4d5d-be61-7c5a3f3da6c8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:22.393374 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a69d8526-76e2-4d5d-be61-7c5a3f3da6c8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:22.393913 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a69d8526-76e2-4d5d-be61-7c5a3f3da6c8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:22.394734 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a69d8526-76e2-4d5d-be61-7c5a3f3da6c8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:22.634591 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-2225369e-8e02-457e-abad-32a54b9a885f tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:22.636024 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-2225369e-8e02-457e-abad-32a54b9a885f tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: d5eacee8-861b-453e-bdec-260c354bc942] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:22.650942 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2225369e-8e02-457e-abad-32a54b9a885f tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:22.651985 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2225369e-8e02-457e-abad-32a54b9a885f tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:22.660382 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2225369e-8e02-457e-abad-32a54b9a885f tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:22.661762 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2225369e-8e02-457e-abad-32a54b9a885f tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:22.705642 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-2225369e-8e02-457e-abad-32a54b9a885f tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: d5eacee8-861b-453e-bdec-260c354bc942] Going to try to terminate instance {{(pid=115747) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 01:15:22.857719 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-2225369e-8e02-457e-abad-32a54b9a885f tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "DELETE /compute/v2.1/servers/d5eacee8-861b-453e-bdec-260c354bc942" status: 204 len: 0 microversion: 2.1 time: 0.222411 Oct 29 01:15:22.861071 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 226/472] 10.222.0.90 () {58 vars in 1238 bytes} [Fri Oct 29 01:15:22 2021] DELETE /compute/v2.1/servers/d5eacee8-861b-453e-bdec-260c354bc942 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 01:15:22.874117 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-dde07064-ba3c-47bc-b6a0-db10eb6139c3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:22.875952 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-dde07064-ba3c-47bc-b6a0-db10eb6139c3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 8478f8e3-cdb3-437f-a710-b2230e5b8be7] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:22.888946 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-a69d8526-76e2-4d5d-be61-7c5a3f3da6c8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:22.891867 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dde07064-ba3c-47bc-b6a0-db10eb6139c3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:22.893569 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dde07064-ba3c-47bc-b6a0-db10eb6139c3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:22.895581 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dde07064-ba3c-47bc-b6a0-db10eb6139c3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:22.898476 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dde07064-ba3c-47bc-b6a0-db10eb6139c3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:22.899726 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-a69d8526-76e2-4d5d-be61-7c5a3f3da6c8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.520097 Oct 29 01:15:22.900844 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 247/473] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:22 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:22.905613 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-ad5a15df-7a65-45f2-ba9a-ca0415407d70 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:22.906698 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-ad5a15df-7a65-45f2-ba9a-ca0415407d70 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: d5eacee8-861b-453e-bdec-260c354bc942] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:22.915850 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ad5a15df-7a65-45f2-ba9a-ca0415407d70 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:22.916608 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ad5a15df-7a65-45f2-ba9a-ca0415407d70 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:22.917850 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ad5a15df-7a65-45f2-ba9a-ca0415407d70 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:22.918290 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ad5a15df-7a65-45f2-ba9a-ca0415407d70 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:23.028949 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-dde07064-ba3c-47bc-b6a0-db10eb6139c3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:23.053815 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-dde07064-ba3c-47bc-b6a0-db10eb6139c3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/8478f8e3-cdb3-437f-a710-b2230e5b8be7" status: 200 len: 1270 microversion: 2.1 time: 0.174319 Oct 29 01:15:23.055286 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 227/474] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:22 2021] GET /compute/v2.1/servers/8478f8e3-cdb3-437f-a710-b2230e5b8be7 => generated 1270 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:23.063739 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c7e8be8b-b6cf-46ef-878f-8784e6a43dd8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:23.066953 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c7e8be8b-b6cf-46ef-878f-8784e6a43dd8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:23.081051 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c7e8be8b-b6cf-46ef-878f-8784e6a43dd8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:23.086138 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c7e8be8b-b6cf-46ef-878f-8784e6a43dd8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:23.087869 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c7e8be8b-b6cf-46ef-878f-8784e6a43dd8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:23.088533 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c7e8be8b-b6cf-46ef-878f-8784e6a43dd8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:23.147519 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-ad5a15df-7a65-45f2-ba9a-ca0415407d70 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:23.155345 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-ad5a15df-7a65-45f2-ba9a-ca0415407d70 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/d5eacee8-861b-453e-bdec-260c354bc942" status: 200 len: 1511 microversion: 2.1 time: 0.253277 Oct 29 01:15:23.167473 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 248/475] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:22 2021] GET /compute/v2.1/servers/d5eacee8-861b-453e-bdec-260c354bc942 => generated 1511 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:23.293413 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c7e8be8b-b6cf-46ef-878f-8784e6a43dd8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:23.304920 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c7e8be8b-b6cf-46ef-878f-8784e6a43dd8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:23.306916 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c7e8be8b-b6cf-46ef-878f-8784e6a43dd8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:23.309254 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c7e8be8b-b6cf-46ef-878f-8784e6a43dd8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1739 microversion: 2.20 time: 0.252051 Oct 29 01:15:23.310698 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 228/476] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:15:23 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1739 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:23.917630 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-91f2bd27-19ed-4477-a671-a6b72c853924 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:23.918559 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-91f2bd27-19ed-4477-a671-a6b72c853924 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:23.928124 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-91f2bd27-19ed-4477-a671-a6b72c853924 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:23.928502 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-91f2bd27-19ed-4477-a671-a6b72c853924 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:23.929816 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-91f2bd27-19ed-4477-a671-a6b72c853924 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:23.930744 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-91f2bd27-19ed-4477-a671-a6b72c853924 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:24.073663 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-76bb34fa-03c5-4544-96c9-53db6d9c9045 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:24.074429 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-76bb34fa-03c5-4544-96c9-53db6d9c9045 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 8478f8e3-cdb3-437f-a710-b2230e5b8be7] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:24.085458 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-76bb34fa-03c5-4544-96c9-53db6d9c9045 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:24.086903 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-76bb34fa-03c5-4544-96c9-53db6d9c9045 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:24.091258 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-76bb34fa-03c5-4544-96c9-53db6d9c9045 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:24.093182 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-76bb34fa-03c5-4544-96c9-53db6d9c9045 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:24.131257 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-91f2bd27-19ed-4477-a671-a6b72c853924 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:24.141465 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-91f2bd27-19ed-4477-a671-a6b72c853924 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.228384 Oct 29 01:15:24.150109 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 249/477] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:23 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:24.173283 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-a7daf8a9-548c-4bbd-a314-03cc145e5857 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:24.174259 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-a7daf8a9-548c-4bbd-a314-03cc145e5857 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: d5eacee8-861b-453e-bdec-260c354bc942] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:24.181575 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a7daf8a9-548c-4bbd-a314-03cc145e5857 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:24.182340 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a7daf8a9-548c-4bbd-a314-03cc145e5857 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:24.183384 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a7daf8a9-548c-4bbd-a314-03cc145e5857 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:24.184047 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a7daf8a9-548c-4bbd-a314-03cc145e5857 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:24.294510 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-76bb34fa-03c5-4544-96c9-53db6d9c9045 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:24.303355 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-76bb34fa-03c5-4544-96c9-53db6d9c9045 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/8478f8e3-cdb3-437f-a710-b2230e5b8be7" status: 200 len: 1318 microversion: 2.1 time: 0.235735 Oct 29 01:15:24.304534 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 229/478] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:24 2021] GET /compute/v2.1/servers/8478f8e3-cdb3-437f-a710-b2230e5b8be7 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:24.336088 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-fe292dad-1bab-4f9b-829c-18ef162beb82 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:24.336916 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-fe292dad-1bab-4f9b-829c-18ef162beb82 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:24.347760 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fe292dad-1bab-4f9b-829c-18ef162beb82 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:24.348434 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fe292dad-1bab-4f9b-829c-18ef162beb82 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:24.349394 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fe292dad-1bab-4f9b-829c-18ef162beb82 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:24.350519 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fe292dad-1bab-4f9b-829c-18ef162beb82 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:24.391000 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-a7daf8a9-548c-4bbd-a314-03cc145e5857 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:24.400408 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-a7daf8a9-548c-4bbd-a314-03cc145e5857 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/d5eacee8-861b-453e-bdec-260c354bc942" status: 200 len: 1511 microversion: 2.1 time: 0.230878 Oct 29 01:15:24.410210 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 250/479] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:24 2021] GET /compute/v2.1/servers/d5eacee8-861b-453e-bdec-260c354bc942 => generated 1511 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:15:24.521289 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-fe292dad-1bab-4f9b-829c-18ef162beb82 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:24.531922 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-fe292dad-1bab-4f9b-829c-18ef162beb82 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:24.534133 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-fe292dad-1bab-4f9b-829c-18ef162beb82 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:24.535537 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-fe292dad-1bab-4f9b-829c-18ef162beb82 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1739 microversion: 2.20 time: 0.205022 Oct 29 01:15:24.536564 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 230/480] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:15:24 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1739 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:25.049292 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [req-c3eb0916-90bd-4076-a5ee-07ba072c20f6 req-5d25f48f-8f2f-432d-aa3f-5d93b7fb4f82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8478f8e3-cdb3-437f-a710-b2230e5b8be7", "tag": "019508e1-f889-428a-9019-9b4e656bdd1c"}]} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:25.052310 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:15:25.052310 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: warnings.warn(msg) Oct 29 01:15:25.062634 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-c3eb0916-90bd-4076-a5ee-07ba072c20f6 req-5d25f48f-8f2f-432d-aa3f-5d93b7fb4f82 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:25.063698 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-c3eb0916-90bd-4076-a5ee-07ba072c20f6 req-5d25f48f-8f2f-432d-aa3f-5d93b7fb4f82 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:25.076848 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.compute.server_external_events [req-c3eb0916-90bd-4076-a5ee-07ba072c20f6 req-5d25f48f-8f2f-432d-aa3f-5d93b7fb4f82 service nova] Creating event network-changed:019508e1-f889-428a-9019-9b4e656bdd1c for instance 8478f8e3-cdb3-437f-a710-b2230e5b8be7 on hv-cinder-81558 Oct 29 01:15:25.081958 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [req-c3eb0916-90bd-4076-a5ee-07ba072c20f6 req-5d25f48f-8f2f-432d-aa3f-5d93b7fb4f82 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037850 Oct 29 01:15:25.082858 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 251/481] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:15:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:15:25.166225 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b59ffa04-e154-4af6-994a-47ce58744e2c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:25.166909 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b59ffa04-e154-4af6-994a-47ce58744e2c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:25.173055 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b59ffa04-e154-4af6-994a-47ce58744e2c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:25.173498 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b59ffa04-e154-4af6-994a-47ce58744e2c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:25.174296 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b59ffa04-e154-4af6-994a-47ce58744e2c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:25.174789 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b59ffa04-e154-4af6-994a-47ce58744e2c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:25.320994 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-652b354a-7621-4a8a-9f1f-f39cf8104650 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:25.321683 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-652b354a-7621-4a8a-9f1f-f39cf8104650 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 8478f8e3-cdb3-437f-a710-b2230e5b8be7] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:25.327691 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-652b354a-7621-4a8a-9f1f-f39cf8104650 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:25.328131 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-652b354a-7621-4a8a-9f1f-f39cf8104650 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:25.328895 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-652b354a-7621-4a8a-9f1f-f39cf8104650 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:25.329324 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-652b354a-7621-4a8a-9f1f-f39cf8104650 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:25.366693 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-b59ffa04-e154-4af6-994a-47ce58744e2c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:25.371286 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b59ffa04-e154-4af6-994a-47ce58744e2c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.208694 Oct 29 01:15:25.371868 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 231/482] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:25 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:25.427771 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-575708b0-2241-41b9-900e-213f71525b51 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:25.429312 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-575708b0-2241-41b9-900e-213f71525b51 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: d5eacee8-861b-453e-bdec-260c354bc942] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:25.439331 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-575708b0-2241-41b9-900e-213f71525b51 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:25.440179 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-575708b0-2241-41b9-900e-213f71525b51 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:25.441166 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-575708b0-2241-41b9-900e-213f71525b51 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:25.441748 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-575708b0-2241-41b9-900e-213f71525b51 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:25.473887 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-652b354a-7621-4a8a-9f1f-f39cf8104650 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:25.482998 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-652b354a-7621-4a8a-9f1f-f39cf8104650 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/8478f8e3-cdb3-437f-a710-b2230e5b8be7" status: 200 len: 1318 microversion: 2.1 time: 0.165564 Oct 29 01:15:25.483573 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 252/483] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:25 2021] GET /compute/v2.1/servers/8478f8e3-cdb3-437f-a710-b2230e5b8be7 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:15:25.552947 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2ad67ec8-b2ed-45fc-8a63-c851c1c250df tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:25.553552 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2ad67ec8-b2ed-45fc-8a63-c851c1c250df tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:25.559364 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2ad67ec8-b2ed-45fc-8a63-c851c1c250df tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:25.560039 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2ad67ec8-b2ed-45fc-8a63-c851c1c250df tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:25.560984 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2ad67ec8-b2ed-45fc-8a63-c851c1c250df tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:25.561587 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2ad67ec8-b2ed-45fc-8a63-c851c1c250df tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:25.596845 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-575708b0-2241-41b9-900e-213f71525b51 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:25.606439 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-575708b0-2241-41b9-900e-213f71525b51 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/d5eacee8-861b-453e-bdec-260c354bc942" status: 200 len: 1511 microversion: 2.1 time: 0.182168 Oct 29 01:15:25.607720 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 232/484] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:25 2021] GET /compute/v2.1/servers/d5eacee8-861b-453e-bdec-260c354bc942 => generated 1511 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:15:25.692184 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-2ad67ec8-b2ed-45fc-8a63-c851c1c250df tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:25.701433 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-2ad67ec8-b2ed-45fc-8a63-c851c1c250df tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:25.702976 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-2ad67ec8-b2ed-45fc-8a63-c851c1c250df tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:25.704116 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2ad67ec8-b2ed-45fc-8a63-c851c1c250df tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1721 microversion: 2.20 time: 0.154846 Oct 29 01:15:25.704670 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 253/485] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:15:25 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:15:26.387740 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ca7e2e7a-25f4-4ce7-ae5e-7fb87604d24c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:26.389176 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ca7e2e7a-25f4-4ce7-ae5e-7fb87604d24c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:26.396232 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ca7e2e7a-25f4-4ce7-ae5e-7fb87604d24c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:26.396686 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ca7e2e7a-25f4-4ce7-ae5e-7fb87604d24c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:26.397458 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ca7e2e7a-25f4-4ce7-ae5e-7fb87604d24c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:26.397895 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ca7e2e7a-25f4-4ce7-ae5e-7fb87604d24c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:26.499835 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-3db222fd-b0d1-43f3-a291-4d5d02ce5f07 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:26.501132 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-3db222fd-b0d1-43f3-a291-4d5d02ce5f07 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 8478f8e3-cdb3-437f-a710-b2230e5b8be7] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:26.507920 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3db222fd-b0d1-43f3-a291-4d5d02ce5f07 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:26.508988 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3db222fd-b0d1-43f3-a291-4d5d02ce5f07 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:26.509983 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3db222fd-b0d1-43f3-a291-4d5d02ce5f07 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:26.510604 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3db222fd-b0d1-43f3-a291-4d5d02ce5f07 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:26.644993 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-ca7e2e7a-25f4-4ce7-ae5e-7fb87604d24c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:26.652756 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ca7e2e7a-25f4-4ce7-ae5e-7fb87604d24c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.268937 Oct 29 01:15:26.663864 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 233/486] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:26 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:26.668706 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-3050b0b6-1f59-43e9-a48e-5215f2d7159e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:26.669528 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-3050b0b6-1f59-43e9-a48e-5215f2d7159e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: d5eacee8-861b-453e-bdec-260c354bc942] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:26.675947 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3050b0b6-1f59-43e9-a48e-5215f2d7159e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:26.676619 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3050b0b6-1f59-43e9-a48e-5215f2d7159e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:26.677562 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3050b0b6-1f59-43e9-a48e-5215f2d7159e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:26.678156 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3050b0b6-1f59-43e9-a48e-5215f2d7159e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:26.862645 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-3db222fd-b0d1-43f3-a291-4d5d02ce5f07 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:26.870711 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-3db222fd-b0d1-43f3-a291-4d5d02ce5f07 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/8478f8e3-cdb3-437f-a710-b2230e5b8be7" status: 200 len: 1318 microversion: 2.1 time: 0.374577 Oct 29 01:15:26.881080 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 254/487] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:26 2021] GET /compute/v2.1/servers/8478f8e3-cdb3-437f-a710-b2230e5b8be7 => generated 1318 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:26.893510 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-69aad84b-8b9f-4444-b81f-b9b57f8c5b0e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:26.894642 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-69aad84b-8b9f-4444-b81f-b9b57f8c5b0e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:26.903251 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-69aad84b-8b9f-4444-b81f-b9b57f8c5b0e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:26.903849 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-69aad84b-8b9f-4444-b81f-b9b57f8c5b0e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:26.905471 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-69aad84b-8b9f-4444-b81f-b9b57f8c5b0e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:26.906121 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-69aad84b-8b9f-4444-b81f-b9b57f8c5b0e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:26.923156 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-3050b0b6-1f59-43e9-a48e-5215f2d7159e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:26.935006 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-3050b0b6-1f59-43e9-a48e-5215f2d7159e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/d5eacee8-861b-453e-bdec-260c354bc942" status: 200 len: 1511 microversion: 2.1 time: 0.269783 Oct 29 01:15:26.936182 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 234/488] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:26 2021] GET /compute/v2.1/servers/d5eacee8-861b-453e-bdec-260c354bc942 => generated 1511 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:27.054259 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-69aad84b-8b9f-4444-b81f-b9b57f8c5b0e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:27.062160 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-69aad84b-8b9f-4444-b81f-b9b57f8c5b0e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:27.063700 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-69aad84b-8b9f-4444-b81f-b9b57f8c5b0e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:27.064862 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-69aad84b-8b9f-4444-b81f-b9b57f8c5b0e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1721 microversion: 2.20 time: 0.182823 Oct 29 01:15:27.065459 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 255/489] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:15:26 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:27.200442 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [req-f3c256b4-fe80-4e4c-85ff-5dfa6531d3e8 req-0205dca4-e0a2-4166-964b-6f0d2ab8265c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5eacee8-861b-453e-bdec-260c354bc942", "name": "network-vif-deleted", "tag": "5945ae54-9c50-4ec7-9b83-6f66146a5c21"}]} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:27.202003 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:15:27.202003 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: warnings.warn(msg) Oct 29 01:15:27.209352 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-f3c256b4-fe80-4e4c-85ff-5dfa6531d3e8 req-0205dca4-e0a2-4166-964b-6f0d2ab8265c service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:27.209792 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-f3c256b4-fe80-4e4c-85ff-5dfa6531d3e8 req-0205dca4-e0a2-4166-964b-6f0d2ab8265c service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:27.223953 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.compute.server_external_events [req-f3c256b4-fe80-4e4c-85ff-5dfa6531d3e8 req-0205dca4-e0a2-4166-964b-6f0d2ab8265c service nova] Creating event network-vif-deleted:5945ae54-9c50-4ec7-9b83-6f66146a5c21 for instance d5eacee8-861b-453e-bdec-260c354bc942 on hv-cinder-81558 Oct 29 01:15:27.229038 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [req-f3c256b4-fe80-4e4c-85ff-5dfa6531d3e8 req-0205dca4-e0a2-4166-964b-6f0d2ab8265c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031887 Oct 29 01:15:27.229574 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 235/490] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:15:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:15:27.670957 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-1e48c3df-9e92-4dc5-9592-adb8151aa130 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:27.671570 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-1e48c3df-9e92-4dc5-9592-adb8151aa130 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:27.678169 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1e48c3df-9e92-4dc5-9592-adb8151aa130 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:27.678506 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1e48c3df-9e92-4dc5-9592-adb8151aa130 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:27.679257 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1e48c3df-9e92-4dc5-9592-adb8151aa130 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:27.679693 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1e48c3df-9e92-4dc5-9592-adb8151aa130 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:27.804815 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-1e48c3df-9e92-4dc5-9592-adb8151aa130 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:27.811929 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-1e48c3df-9e92-4dc5-9592-adb8151aa130 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.144690 Oct 29 01:15:27.812489 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 256/491] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:27 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:27.898677 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-000e9fca-d03c-4625-9a9b-73a44237a5b6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:27.899404 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-000e9fca-d03c-4625-9a9b-73a44237a5b6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 8478f8e3-cdb3-437f-a710-b2230e5b8be7] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:27.905421 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-000e9fca-d03c-4625-9a9b-73a44237a5b6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:27.906171 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-000e9fca-d03c-4625-9a9b-73a44237a5b6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:27.907019 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-000e9fca-d03c-4625-9a9b-73a44237a5b6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:27.907450 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-000e9fca-d03c-4625-9a9b-73a44237a5b6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:27.963608 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-067520ba-ef4a-4c16-8ed1-4e36c7248c06 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:27.964399 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-067520ba-ef4a-4c16-8ed1-4e36c7248c06 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: d5eacee8-861b-453e-bdec-260c354bc942] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:27.970681 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-067520ba-ef4a-4c16-8ed1-4e36c7248c06 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:27.971130 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-067520ba-ef4a-4c16-8ed1-4e36c7248c06 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:27.971954 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-067520ba-ef4a-4c16-8ed1-4e36c7248c06 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:27.972381 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-067520ba-ef4a-4c16-8ed1-4e36c7248c06 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:28.006519 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-067520ba-ef4a-4c16-8ed1-4e36c7248c06 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:28.006962 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-067520ba-ef4a-4c16-8ed1-4e36c7248c06 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:28.007402 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.objects.instance [None req-067520ba-ef4a-4c16-8ed1-4e36c7248c06 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lazy-loading 'fault' on Instance uuid d5eacee8-861b-453e-bdec-260c354bc942 {{(pid=115748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:15:28.059373 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-067520ba-ef4a-4c16-8ed1-4e36c7248c06 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:28.069332 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-067520ba-ef4a-4c16-8ed1-4e36c7248c06 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/d5eacee8-861b-453e-bdec-260c354bc942" status: 200 len: 1306 microversion: 2.1 time: 0.120249 Oct 29 01:15:28.069694 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-000e9fca-d03c-4625-9a9b-73a44237a5b6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:28.070436 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 257/492] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:27 2021] GET /compute/v2.1/servers/d5eacee8-861b-453e-bdec-260c354bc942 => generated 1306 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:15:28.076996 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-000e9fca-d03c-4625-9a9b-73a44237a5b6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/8478f8e3-cdb3-437f-a710-b2230e5b8be7" status: 200 len: 1318 microversion: 2.1 time: 0.183978 Oct 29 01:15:28.077673 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 236/493] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:27 2021] GET /compute/v2.1/servers/8478f8e3-cdb3-437f-a710-b2230e5b8be7 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:28.083249 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d14b440e-563d-4ead-a7fa-fe9950468ec0 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:28.084111 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d14b440e-563d-4ead-a7fa-fe9950468ec0 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:28.090103 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d14b440e-563d-4ead-a7fa-fe9950468ec0 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:28.090597 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d14b440e-563d-4ead-a7fa-fe9950468ec0 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:28.091387 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d14b440e-563d-4ead-a7fa-fe9950468ec0 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:28.091808 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d14b440e-563d-4ead-a7fa-fe9950468ec0 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:28.212632 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-d14b440e-563d-4ead-a7fa-fe9950468ec0 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:28.220263 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-d14b440e-563d-4ead-a7fa-fe9950468ec0 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:28.221734 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-d14b440e-563d-4ead-a7fa-fe9950468ec0 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:28.222901 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d14b440e-563d-4ead-a7fa-fe9950468ec0 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1721 microversion: 2.20 time: 0.144143 Oct 29 01:15:28.223450 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 258/494] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:15:28 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1721 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:15:28.829017 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c50f371e-3726-4de6-96c5-c806bb055457 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:28.829664 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c50f371e-3726-4de6-96c5-c806bb055457 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:28.836607 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c50f371e-3726-4de6-96c5-c806bb055457 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:28.837058 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c50f371e-3726-4de6-96c5-c806bb055457 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:28.837823 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c50f371e-3726-4de6-96c5-c806bb055457 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:28.838262 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c50f371e-3726-4de6-96c5-c806bb055457 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:28.960664 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c50f371e-3726-4de6-96c5-c806bb055457 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:28.968900 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c50f371e-3726-4de6-96c5-c806bb055457 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.143579 Oct 29 01:15:28.969551 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 237/495] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:28 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:29.086788 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-718decc0-14f8-4afc-9134-015249977660 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:29.087324 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-718decc0-14f8-4afc-9134-015249977660 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: d5eacee8-861b-453e-bdec-260c354bc942] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:29.093493 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-718decc0-14f8-4afc-9134-015249977660 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:29.093933 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-718decc0-14f8-4afc-9134-015249977660 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:29.094724 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-718decc0-14f8-4afc-9134-015249977660 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:29.095154 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-718decc0-14f8-4afc-9134-015249977660 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:29.096370 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-97b56d24-ca25-45c5-87f4-ce8b07c46ea7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:29.097531 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-97b56d24-ca25-45c5-87f4-ce8b07c46ea7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 8478f8e3-cdb3-437f-a710-b2230e5b8be7] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:29.103184 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-97b56d24-ca25-45c5-87f4-ce8b07c46ea7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:29.103632 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-97b56d24-ca25-45c5-87f4-ce8b07c46ea7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:29.104392 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-97b56d24-ca25-45c5-87f4-ce8b07c46ea7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:29.104824 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-97b56d24-ca25-45c5-87f4-ce8b07c46ea7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:29.109349 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.wsgi [None req-718decc0-14f8-4afc-9134-015249977660 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] HTTP exception thrown: Instance d5eacee8-861b-453e-bdec-260c354bc942 could not be found. Oct 29 01:15:29.109930 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-718decc0-14f8-4afc-9134-015249977660 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Returning 404 to user: Instance d5eacee8-861b-453e-bdec-260c354bc942 could not be found. {{(pid=115748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:15:29.111055 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-718decc0-14f8-4afc-9134-015249977660 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/d5eacee8-861b-453e-bdec-260c354bc942" status: 404 len: 111 microversion: 2.1 time: 0.028189 Oct 29 01:15:29.111593 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 259/496] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:29 2021] GET /compute/v2.1/servers/d5eacee8-861b-453e-bdec-260c354bc942 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:15:29.119435 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-ffbb1b1b-a1e4-42dd-9d5a-fda18018dabd tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:29.119929 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-ffbb1b1b-a1e4-42dd-9d5a-fda18018dabd tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 176a8750-3a7e-4e6e-97b9-8394581d0ff3] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:29.125794 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ffbb1b1b-a1e4-42dd-9d5a-fda18018dabd tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:29.126343 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ffbb1b1b-a1e4-42dd-9d5a-fda18018dabd tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:29.127180 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ffbb1b1b-a1e4-42dd-9d5a-fda18018dabd tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:29.127654 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ffbb1b1b-a1e4-42dd-9d5a-fda18018dabd tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:29.155119 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-ffbb1b1b-a1e4-42dd-9d5a-fda18018dabd tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 176a8750-3a7e-4e6e-97b9-8394581d0ff3] Going to try to terminate instance {{(pid=115748) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 01:15:29.228331 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-ffbb1b1b-a1e4-42dd-9d5a-fda18018dabd tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "DELETE /compute/v2.1/servers/176a8750-3a7e-4e6e-97b9-8394581d0ff3" status: 204 len: 0 microversion: 2.1 time: 0.112147 Oct 29 01:15:29.228914 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 260/497] 10.222.0.90 () {58 vars in 1238 bytes} [Fri Oct 29 01:15:29 2021] DELETE /compute/v2.1/servers/176a8750-3a7e-4e6e-97b9-8394581d0ff3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 01:15:29.237478 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c83f001b-cafa-46b9-a7d6-ec4f4759a544 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:29.238024 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-97b56d24-ca25-45c5-87f4-ce8b07c46ea7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:29.238381 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c83f001b-cafa-46b9-a7d6-ec4f4759a544 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 176a8750-3a7e-4e6e-97b9-8394581d0ff3] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:29.244723 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c83f001b-cafa-46b9-a7d6-ec4f4759a544 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:29.245184 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c83f001b-cafa-46b9-a7d6-ec4f4759a544 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:29.245945 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c83f001b-cafa-46b9-a7d6-ec4f4759a544 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:29.246380 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c83f001b-cafa-46b9-a7d6-ec4f4759a544 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:29.247231 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-97b56d24-ca25-45c5-87f4-ce8b07c46ea7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/8478f8e3-cdb3-437f-a710-b2230e5b8be7" status: 200 len: 1318 microversion: 2.1 time: 0.154341 Oct 29 01:15:29.247809 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 238/498] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:29 2021] GET /compute/v2.1/servers/8478f8e3-cdb3-437f-a710-b2230e5b8be7 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:15:29.252070 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-69950fa6-afdf-4372-8154-e71680c49f46 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:29.252976 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-69950fa6-afdf-4372-8154-e71680c49f46 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:29.259196 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-69950fa6-afdf-4372-8154-e71680c49f46 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:29.259640 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-69950fa6-afdf-4372-8154-e71680c49f46 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:29.260403 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-69950fa6-afdf-4372-8154-e71680c49f46 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:29.260835 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-69950fa6-afdf-4372-8154-e71680c49f46 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:29.427989 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-c83f001b-cafa-46b9-a7d6-ec4f4759a544 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:29.432524 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-69950fa6-afdf-4372-8154-e71680c49f46 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:29.435419 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c83f001b-cafa-46b9-a7d6-ec4f4759a544 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/176a8750-3a7e-4e6e-97b9-8394581d0ff3" status: 200 len: 1513 microversion: 2.1 time: 0.202349 Oct 29 01:15:29.435990 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 261/499] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:29 2021] GET /compute/v2.1/servers/176a8750-3a7e-4e6e-97b9-8394581d0ff3 => generated 1513 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:15:29.441163 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-69950fa6-afdf-4372-8154-e71680c49f46 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:29.442802 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-69950fa6-afdf-4372-8154-e71680c49f46 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:29.444089 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-69950fa6-afdf-4372-8154-e71680c49f46 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1721 microversion: 2.20 time: 0.195348 Oct 29 01:15:29.444727 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 239/500] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:15:29 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1721 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:29.797082 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [req-56220ecf-cd8d-4c72-8ed8-52ba7ed99c25 req-b890f0e7-1538-405f-b827-c558c74a8f31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27a73464-dcac-4be6-a392-58d40a0296a8", "name": "network-vif-unplugged", "status": "completed", "tag": "f3a5c6a4-eba2-4bfd-91f6-59386b7c88e8"}]} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:29.798678 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:15:29.798678 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: warnings.warn(msg) Oct 29 01:15:29.805881 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-56220ecf-cd8d-4c72-8ed8-52ba7ed99c25 req-b890f0e7-1538-405f-b827-c558c74a8f31 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:29.806328 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-56220ecf-cd8d-4c72-8ed8-52ba7ed99c25 req-b890f0e7-1538-405f-b827-c558c74a8f31 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:29.817624 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.compute.server_external_events [req-56220ecf-cd8d-4c72-8ed8-52ba7ed99c25 req-b890f0e7-1538-405f-b827-c558c74a8f31 service nova] Creating event network-vif-unplugged:f3a5c6a4-eba2-4bfd-91f6-59386b7c88e8 for instance 27a73464-dcac-4be6-a392-58d40a0296a8 on hv-cinder-81558 Oct 29 01:15:29.822738 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [req-56220ecf-cd8d-4c72-8ed8-52ba7ed99c25 req-b890f0e7-1538-405f-b827-c558c74a8f31 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029547 Oct 29 01:15:29.823961 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 262/501] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:15:29 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:15:29.987703 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-7367ba4e-3e62-4a1b-9717-10e38b56d6a5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:29.988317 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-7367ba4e-3e62-4a1b-9717-10e38b56d6a5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:29.994870 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7367ba4e-3e62-4a1b-9717-10e38b56d6a5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:29.995335 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7367ba4e-3e62-4a1b-9717-10e38b56d6a5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:29.996137 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7367ba4e-3e62-4a1b-9717-10e38b56d6a5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:29.996574 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7367ba4e-3e62-4a1b-9717-10e38b56d6a5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:30.123997 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-7367ba4e-3e62-4a1b-9717-10e38b56d6a5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:30.131385 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-7367ba4e-3e62-4a1b-9717-10e38b56d6a5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.148066 Oct 29 01:15:30.131889 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 240/502] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:29 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:30.265301 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-0189a40c-92eb-4d20-b821-ef805f7b0cfa tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:30.266028 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-0189a40c-92eb-4d20-b821-ef805f7b0cfa tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 8478f8e3-cdb3-437f-a710-b2230e5b8be7] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:30.272154 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0189a40c-92eb-4d20-b821-ef805f7b0cfa tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:30.272601 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0189a40c-92eb-4d20-b821-ef805f7b0cfa tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:30.273360 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0189a40c-92eb-4d20-b821-ef805f7b0cfa tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:30.273793 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0189a40c-92eb-4d20-b821-ef805f7b0cfa tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:30.399027 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-0189a40c-92eb-4d20-b821-ef805f7b0cfa tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:30.406721 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-0189a40c-92eb-4d20-b821-ef805f7b0cfa tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/8478f8e3-cdb3-437f-a710-b2230e5b8be7" status: 200 len: 1318 microversion: 2.1 time: 0.145781 Oct 29 01:15:30.407381 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 263/503] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:30 2021] GET /compute/v2.1/servers/8478f8e3-cdb3-437f-a710-b2230e5b8be7 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:30.452853 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-fb9ba2b5-b60c-4741-a111-475e5ef38147 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:30.453669 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-fb9ba2b5-b60c-4741-a111-475e5ef38147 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 176a8750-3a7e-4e6e-97b9-8394581d0ff3] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:30.460329 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fb9ba2b5-b60c-4741-a111-475e5ef38147 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:30.460787 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fb9ba2b5-b60c-4741-a111-475e5ef38147 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:30.461558 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fb9ba2b5-b60c-4741-a111-475e5ef38147 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:30.461985 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fb9ba2b5-b60c-4741-a111-475e5ef38147 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:30.462341 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-3a4c434b-8eae-4751-af7a-6067f1065f4b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:30.463193 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-3a4c434b-8eae-4751-af7a-6067f1065f4b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:30.469199 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3a4c434b-8eae-4751-af7a-6067f1065f4b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:30.469647 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3a4c434b-8eae-4751-af7a-6067f1065f4b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:30.470438 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3a4c434b-8eae-4751-af7a-6067f1065f4b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:30.470880 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3a4c434b-8eae-4751-af7a-6067f1065f4b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:30.650923 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-fb9ba2b5-b60c-4741-a111-475e5ef38147 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:30.655907 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-3a4c434b-8eae-4751-af7a-6067f1065f4b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:30.662369 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-fb9ba2b5-b60c-4741-a111-475e5ef38147 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/176a8750-3a7e-4e6e-97b9-8394581d0ff3" status: 200 len: 1513 microversion: 2.1 time: 0.213203 Oct 29 01:15:30.663080 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 241/504] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:30 2021] GET /compute/v2.1/servers/176a8750-3a7e-4e6e-97b9-8394581d0ff3 => generated 1513 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:30.664859 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-3a4c434b-8eae-4751-af7a-6067f1065f4b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:30.666488 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-3a4c434b-8eae-4751-af7a-6067f1065f4b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:30.667717 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-3a4c434b-8eae-4751-af7a-6067f1065f4b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1664 microversion: 2.20 time: 0.209740 Oct 29 01:15:30.668254 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 264/505] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:15:30 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1664 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:15:30.684512 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d6ce26ba-4954-4bd3-a220-b01e3eccc7c7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88a409f2-6048-4e85-9e8c-e9096e338844"}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:30.685604 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d6ce26ba-4954-4bd3-a220-b01e3eccc7c7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:30.691561 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d6ce26ba-4954-4bd3-a220-b01e3eccc7c7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:30.691993 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d6ce26ba-4954-4bd3-a220-b01e3eccc7c7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:30.692740 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d6ce26ba-4954-4bd3-a220-b01e3eccc7c7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:30.693163 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d6ce26ba-4954-4bd3-a220-b01e3eccc7c7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:30.961275 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d6ce26ba-4954-4bd3-a220-b01e3eccc7c7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.280312 Oct 29 01:15:30.961924 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 242/506] 10.222.0.90 () {62 vars in 1363 bytes} [Fri Oct 29 01:15:30 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/os-volume_attachments => generated 188 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:15:31.071011 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-ef7cbbce-ffa0-47c0-b6c3-ddd62204376e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:31.071546 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-ef7cbbce-ffa0-47c0-b6c3-ddd62204376e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:31.077841 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ef7cbbce-ffa0-47c0-b6c3-ddd62204376e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:31.078288 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ef7cbbce-ffa0-47c0-b6c3-ddd62204376e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:31.079092 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ef7cbbce-ffa0-47c0-b6c3-ddd62204376e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:31.079524 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ef7cbbce-ffa0-47c0-b6c3-ddd62204376e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:31.149143 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-8584aced-691e-4677-9a88-f2302d320c65 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:31.150541 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-8584aced-691e-4677-9a88-f2302d320c65 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:31.158250 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8584aced-691e-4677-9a88-f2302d320c65 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:31.159069 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8584aced-691e-4677-9a88-f2302d320c65 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:31.162222 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8584aced-691e-4677-9a88-f2302d320c65 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:31.162222 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8584aced-691e-4677-9a88-f2302d320c65 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:31.169101 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-ef7cbbce-ffa0-47c0-b6c3-ddd62204376e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action" status: 202 len: 0 microversion: 2.20 time: 0.102053 Oct 29 01:15:31.173120 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 265/507] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:15:31 2021] POST /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:15:31.178253 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-815df6c7-fbba-47b8-83b5-bde47d3a920f tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:31.178897 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-815df6c7-fbba-47b8-83b5-bde47d3a920f tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:31.185003 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-815df6c7-fbba-47b8-83b5-bde47d3a920f tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:31.185501 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-815df6c7-fbba-47b8-83b5-bde47d3a920f tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:31.186420 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-815df6c7-fbba-47b8-83b5-bde47d3a920f tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:31.186908 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-815df6c7-fbba-47b8-83b5-bde47d3a920f tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:31.381073 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-815df6c7-fbba-47b8-83b5-bde47d3a920f tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:31.388649 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-8584aced-691e-4677-9a88-f2302d320c65 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:31.390586 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-815df6c7-fbba-47b8-83b5-bde47d3a920f tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:31.392055 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-815df6c7-fbba-47b8-83b5-bde47d3a920f tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:31.393334 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-815df6c7-fbba-47b8-83b5-bde47d3a920f tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1750 microversion: 2.20 time: 0.219271 Oct 29 01:15:31.393889 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 266/508] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:15:31 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1750 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:15:31.397170 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-8584aced-691e-4677-9a88-f2302d320c65 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.252138 Oct 29 01:15:31.397729 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 243/509] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:31 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:15:31.425266 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-981745aa-88d5-44f4-a412-ec00a4307c55 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:31.425943 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-981745aa-88d5-44f4-a412-ec00a4307c55 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 8478f8e3-cdb3-437f-a710-b2230e5b8be7] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:31.431605 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-981745aa-88d5-44f4-a412-ec00a4307c55 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:31.432674 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-981745aa-88d5-44f4-a412-ec00a4307c55 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:31.433442 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-981745aa-88d5-44f4-a412-ec00a4307c55 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:31.433868 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-981745aa-88d5-44f4-a412-ec00a4307c55 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:31.563261 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-981745aa-88d5-44f4-a412-ec00a4307c55 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:31.571389 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-981745aa-88d5-44f4-a412-ec00a4307c55 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/8478f8e3-cdb3-437f-a710-b2230e5b8be7" status: 200 len: 1318 microversion: 2.1 time: 0.149862 Oct 29 01:15:31.572042 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 267/510] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:31 2021] GET /compute/v2.1/servers/8478f8e3-cdb3-437f-a710-b2230e5b8be7 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:15:31.680456 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-40fcc43e-5f48-44a7-bbdf-66c34fed5de1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:31.680982 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-40fcc43e-5f48-44a7-bbdf-66c34fed5de1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 176a8750-3a7e-4e6e-97b9-8394581d0ff3] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:31.693411 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-40fcc43e-5f48-44a7-bbdf-66c34fed5de1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:31.693822 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-40fcc43e-5f48-44a7-bbdf-66c34fed5de1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:31.695000 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-40fcc43e-5f48-44a7-bbdf-66c34fed5de1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:31.695787 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-40fcc43e-5f48-44a7-bbdf-66c34fed5de1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:31.849068 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-40fcc43e-5f48-44a7-bbdf-66c34fed5de1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:31.856411 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-40fcc43e-5f48-44a7-bbdf-66c34fed5de1 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/176a8750-3a7e-4e6e-97b9-8394581d0ff3" status: 200 len: 1513 microversion: 2.1 time: 0.179790 Oct 29 01:15:31.866658 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 244/511] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:31 2021] GET /compute/v2.1/servers/176a8750-3a7e-4e6e-97b9-8394581d0ff3 => generated 1513 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:31.882360 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [req-9f8eaa5e-fa79-4983-887d-972fdefbe637 req-49c4c4dd-8152-435b-9189-9602b728e636 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8478f8e3-cdb3-437f-a710-b2230e5b8be7", "name": "network-vif-plugged", "status": "completed", "tag": "019508e1-f889-428a-9019-9b4e656bdd1c"}]} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:31.885400 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:15:31.885400 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: warnings.warn(msg) Oct 29 01:15:31.895673 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-9f8eaa5e-fa79-4983-887d-972fdefbe637 req-49c4c4dd-8152-435b-9189-9602b728e636 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:31.896224 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-9f8eaa5e-fa79-4983-887d-972fdefbe637 req-49c4c4dd-8152-435b-9189-9602b728e636 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:31.909458 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.compute.server_external_events [req-9f8eaa5e-fa79-4983-887d-972fdefbe637 req-49c4c4dd-8152-435b-9189-9602b728e636 service nova] Creating event network-vif-plugged:019508e1-f889-428a-9019-9b4e656bdd1c for instance 8478f8e3-cdb3-437f-a710-b2230e5b8be7 on hv-cinder-81558 Oct 29 01:15:31.914611 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [req-9f8eaa5e-fa79-4983-887d-972fdefbe637 req-49c4c4dd-8152-435b-9189-9602b728e636 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038545 Oct 29 01:15:31.915646 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 268/512] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:15:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:15:32.258960 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [req-1776515f-b661-4a3e-b935-49a2bf9eeafb req-eefa1171-7c5f-456b-aec3-c5e97aeaaff9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "176a8750-3a7e-4e6e-97b9-8394581d0ff3", "name": "network-vif-deleted", "tag": "cadc346c-7128-4011-9c14-1ca218295b4e"}]} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:32.260508 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:15:32.260508 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: warnings.warn(msg) Oct 29 01:15:32.268798 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-1776515f-b661-4a3e-b935-49a2bf9eeafb req-eefa1171-7c5f-456b-aec3-c5e97aeaaff9 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:32.269230 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-1776515f-b661-4a3e-b935-49a2bf9eeafb req-eefa1171-7c5f-456b-aec3-c5e97aeaaff9 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:32.285745 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.compute.server_external_events [req-1776515f-b661-4a3e-b935-49a2bf9eeafb req-eefa1171-7c5f-456b-aec3-c5e97aeaaff9 service nova] Creating event network-vif-deleted:cadc346c-7128-4011-9c14-1ca218295b4e for instance 176a8750-3a7e-4e6e-97b9-8394581d0ff3 on hv-cinder-81558 Oct 29 01:15:32.291827 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [req-1776515f-b661-4a3e-b935-49a2bf9eeafb req-eefa1171-7c5f-456b-aec3-c5e97aeaaff9 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036272 Oct 29 01:15:32.293287 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 245/513] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:15:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:15:32.413443 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e71b9422-7e04-4a3e-87c4-6c9a2a5d7bf7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:32.414115 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-67b256c2-f864-4cde-9f82-dd83e5fa75ba tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:32.414281 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-e71b9422-7e04-4a3e-87c4-6c9a2a5d7bf7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:32.414890 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-67b256c2-f864-4cde-9f82-dd83e5fa75ba tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:32.420786 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-67b256c2-f864-4cde-9f82-dd83e5fa75ba tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:32.421217 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-67b256c2-f864-4cde-9f82-dd83e5fa75ba tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:32.421335 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e71b9422-7e04-4a3e-87c4-6c9a2a5d7bf7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:32.421976 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-67b256c2-f864-4cde-9f82-dd83e5fa75ba tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:32.422240 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e71b9422-7e04-4a3e-87c4-6c9a2a5d7bf7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:32.422412 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-67b256c2-f864-4cde-9f82-dd83e5fa75ba tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:32.423559 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e71b9422-7e04-4a3e-87c4-6c9a2a5d7bf7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:32.424010 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e71b9422-7e04-4a3e-87c4-6c9a2a5d7bf7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:32.604247 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-67b256c2-f864-4cde-9f82-dd83e5fa75ba tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:32.609048 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-e71b9422-7e04-4a3e-87c4-6c9a2a5d7bf7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:32.611557 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-67b256c2-f864-4cde-9f82-dd83e5fa75ba tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.201362 Oct 29 01:15:32.612691 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 246/514] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:32 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:15:32.616972 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-df2c80c3-a3e6-4778-86ab-91191773a37d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:32.617561 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-df2c80c3-a3e6-4778-86ab-91191773a37d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 8478f8e3-cdb3-437f-a710-b2230e5b8be7] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:32.619025 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-e71b9422-7e04-4a3e-87c4-6c9a2a5d7bf7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:32.620618 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-e71b9422-7e04-4a3e-87c4-6c9a2a5d7bf7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:32.621950 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-e71b9422-7e04-4a3e-87c4-6c9a2a5d7bf7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1752 microversion: 2.20 time: 0.213851 Oct 29 01:15:32.622641 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 269/515] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:15:32 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1752 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:32.623680 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-df2c80c3-a3e6-4778-86ab-91191773a37d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:32.624128 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-df2c80c3-a3e6-4778-86ab-91191773a37d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:32.624916 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-df2c80c3-a3e6-4778-86ab-91191773a37d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:32.625352 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-df2c80c3-a3e6-4778-86ab-91191773a37d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:32.758916 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-df2c80c3-a3e6-4778-86ab-91191773a37d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:32.767181 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-df2c80c3-a3e6-4778-86ab-91191773a37d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/8478f8e3-cdb3-437f-a710-b2230e5b8be7" status: 200 len: 1318 microversion: 2.1 time: 0.153441 Oct 29 01:15:32.767800 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 247/516] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:32 2021] GET /compute/v2.1/servers/8478f8e3-cdb3-437f-a710-b2230e5b8be7 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:32.873301 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-dcc5d4f2-8ed6-425d-93dc-111b52bdb29b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:32.873939 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-dcc5d4f2-8ed6-425d-93dc-111b52bdb29b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 176a8750-3a7e-4e6e-97b9-8394581d0ff3] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:32.881610 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dcc5d4f2-8ed6-425d-93dc-111b52bdb29b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:32.882367 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dcc5d4f2-8ed6-425d-93dc-111b52bdb29b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:32.883501 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dcc5d4f2-8ed6-425d-93dc-111b52bdb29b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:32.883965 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dcc5d4f2-8ed6-425d-93dc-111b52bdb29b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:32.917686 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dcc5d4f2-8ed6-425d-93dc-111b52bdb29b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:32.918129 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dcc5d4f2-8ed6-425d-93dc-111b52bdb29b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:32.918669 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.objects.instance [None req-dcc5d4f2-8ed6-425d-93dc-111b52bdb29b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lazy-loading 'fault' on Instance uuid 176a8750-3a7e-4e6e-97b9-8394581d0ff3 {{(pid=115748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:15:32.957374 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-dcc5d4f2-8ed6-425d-93dc-111b52bdb29b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:32.965076 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-dcc5d4f2-8ed6-425d-93dc-111b52bdb29b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/176a8750-3a7e-4e6e-97b9-8394581d0ff3" status: 200 len: 1308 microversion: 2.1 time: 0.095398 Oct 29 01:15:32.965637 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 270/517] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:32 2021] GET /compute/v2.1/servers/176a8750-3a7e-4e6e-97b9-8394581d0ff3 => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:33.629595 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-5aac2e51-daca-474e-859d-dc9b25d38475 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:33.630195 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-5aac2e51-daca-474e-859d-dc9b25d38475 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:33.636331 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5aac2e51-daca-474e-859d-dc9b25d38475 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:33.636780 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5aac2e51-daca-474e-859d-dc9b25d38475 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:33.637597 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5aac2e51-daca-474e-859d-dc9b25d38475 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:33.638028 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5aac2e51-daca-474e-859d-dc9b25d38475 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:33.678790 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-116ba252-ab82-4856-8f88-4a9faa80dcc8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:33.679550 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-116ba252-ab82-4856-8f88-4a9faa80dcc8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:33.685938 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-116ba252-ab82-4856-8f88-4a9faa80dcc8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:33.687513 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-116ba252-ab82-4856-8f88-4a9faa80dcc8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:33.688796 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-116ba252-ab82-4856-8f88-4a9faa80dcc8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:33.689436 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-116ba252-ab82-4856-8f88-4a9faa80dcc8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:33.818106 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-5aac2e51-daca-474e-859d-dc9b25d38475 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:33.825506 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-5aac2e51-daca-474e-859d-dc9b25d38475 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.200125 Oct 29 01:15:33.826066 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 248/518] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:33 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:33.830715 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-50df4660-729e-406d-bc07-95927c7a8a1c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:33.831022 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-50df4660-729e-406d-bc07-95927c7a8a1c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 8478f8e3-cdb3-437f-a710-b2230e5b8be7] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:33.837640 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-50df4660-729e-406d-bc07-95927c7a8a1c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:33.838082 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-50df4660-729e-406d-bc07-95927c7a8a1c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:33.838913 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-50df4660-729e-406d-bc07-95927c7a8a1c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:33.839348 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-50df4660-729e-406d-bc07-95927c7a8a1c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:33.857688 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-116ba252-ab82-4856-8f88-4a9faa80dcc8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:33.867086 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-116ba252-ab82-4856-8f88-4a9faa80dcc8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:33.869451 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-116ba252-ab82-4856-8f88-4a9faa80dcc8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:33.870647 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-116ba252-ab82-4856-8f88-4a9faa80dcc8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1752 microversion: 2.20 time: 0.196463 Oct 29 01:15:33.871202 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 271/519] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:15:33 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1752 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:33.968374 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-50df4660-729e-406d-bc07-95927c7a8a1c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:33.976100 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-50df4660-729e-406d-bc07-95927c7a8a1c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/8478f8e3-cdb3-437f-a710-b2230e5b8be7" status: 200 len: 1318 microversion: 2.1 time: 0.149098 Oct 29 01:15:33.976661 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 249/520] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:33 2021] GET /compute/v2.1/servers/8478f8e3-cdb3-437f-a710-b2230e5b8be7 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:33.984883 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-b2fd6435-517f-4212-8617-e3196d80bbfa tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:33.985496 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-b2fd6435-517f-4212-8617-e3196d80bbfa tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: 176a8750-3a7e-4e6e-97b9-8394581d0ff3] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:33.992764 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b2fd6435-517f-4212-8617-e3196d80bbfa tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:33.993191 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b2fd6435-517f-4212-8617-e3196d80bbfa tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:33.993961 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b2fd6435-517f-4212-8617-e3196d80bbfa tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:33.994560 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b2fd6435-517f-4212-8617-e3196d80bbfa tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:34.009542 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.wsgi [None req-b2fd6435-517f-4212-8617-e3196d80bbfa tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] HTTP exception thrown: Instance 176a8750-3a7e-4e6e-97b9-8394581d0ff3 could not be found. Oct 29 01:15:34.010141 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-b2fd6435-517f-4212-8617-e3196d80bbfa tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Returning 404 to user: Instance 176a8750-3a7e-4e6e-97b9-8394581d0ff3 could not be found. {{(pid=115748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:15:34.011002 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-b2fd6435-517f-4212-8617-e3196d80bbfa tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/176a8750-3a7e-4e6e-97b9-8394581d0ff3" status: 404 len: 111 microversion: 2.1 time: 0.029800 Oct 29 01:15:34.011553 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 272/521] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:33 2021] GET /compute/v2.1/servers/176a8750-3a7e-4e6e-97b9-8394581d0ff3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:15:34.842288 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-8550f0d6-a060-4612-a921-3b87ddb89655 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:34.842917 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-8550f0d6-a060-4612-a921-3b87ddb89655 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:34.849113 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8550f0d6-a060-4612-a921-3b87ddb89655 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:34.849550 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8550f0d6-a060-4612-a921-3b87ddb89655 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:34.850303 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8550f0d6-a060-4612-a921-3b87ddb89655 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:34.850756 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8550f0d6-a060-4612-a921-3b87ddb89655 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:34.888665 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-3d71b8ca-da9c-41b8-aa6c-938817b117ac tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:34.889412 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-3d71b8ca-da9c-41b8-aa6c-938817b117ac tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:34.898885 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3d71b8ca-da9c-41b8-aa6c-938817b117ac tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:34.899492 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3d71b8ca-da9c-41b8-aa6c-938817b117ac tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:34.900363 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3d71b8ca-da9c-41b8-aa6c-938817b117ac tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:34.900893 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3d71b8ca-da9c-41b8-aa6c-938817b117ac tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:35.008220 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-8550f0d6-a060-4612-a921-3b87ddb89655 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:35.016460 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-8550f0d6-a060-4612-a921-3b87ddb89655 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.177776 Oct 29 01:15:35.017134 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 250/522] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:34 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:35.021916 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9790b22b-1184-42a9-b4a0-4231641addc6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:35.022724 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9790b22b-1184-42a9-b4a0-4231641addc6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 8478f8e3-cdb3-437f-a710-b2230e5b8be7] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:35.030213 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9790b22b-1184-42a9-b4a0-4231641addc6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:35.030965 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9790b22b-1184-42a9-b4a0-4231641addc6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:35.031947 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9790b22b-1184-42a9-b4a0-4231641addc6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:35.032611 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9790b22b-1184-42a9-b4a0-4231641addc6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:35.063918 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-3d71b8ca-da9c-41b8-aa6c-938817b117ac tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:35.084904 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-3d71b8ca-da9c-41b8-aa6c-938817b117ac tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:35.086769 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-3d71b8ca-da9c-41b8-aa6c-938817b117ac tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:35.088323 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-3d71b8ca-da9c-41b8-aa6c-938817b117ac tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1808 microversion: 2.20 time: 0.203377 Oct 29 01:15:35.088902 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 273/523] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:15:34 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1808 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:35.138021 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-24a69a20-c795-42e6-992f-7ee0cf2d8a84 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:35.138539 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-24a69a20-c795-42e6-992f-7ee0cf2d8a84 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:35.144277 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-24a69a20-c795-42e6-992f-7ee0cf2d8a84 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:35.144725 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-24a69a20-c795-42e6-992f-7ee0cf2d8a84 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:35.145486 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-24a69a20-c795-42e6-992f-7ee0cf2d8a84 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:35.145920 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-24a69a20-c795-42e6-992f-7ee0cf2d8a84 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:35.165496 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-9790b22b-1184-42a9-b4a0-4231641addc6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:35.171688 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-24a69a20-c795-42e6-992f-7ee0cf2d8a84 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Going to try to terminate instance {{(pid=115748) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 01:15:35.172659 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9790b22b-1184-42a9-b4a0-4231641addc6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/8478f8e3-cdb3-437f-a710-b2230e5b8be7" status: 200 len: 1507 microversion: 2.1 time: 0.154355 Oct 29 01:15:35.173228 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 251/524] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:35 2021] GET /compute/v2.1/servers/8478f8e3-cdb3-437f-a710-b2230e5b8be7 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:35.267791 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-24a69a20-c795-42e6-992f-7ee0cf2d8a84 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "DELETE /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 204 len: 0 microversion: 2.1 time: 0.133081 Oct 29 01:15:35.268631 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 274/525] 10.222.0.90 () {58 vars in 1238 bytes} [Fri Oct 29 01:15:35 2021] DELETE /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 01:15:35.285793 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c8e7763d-cc5d-4f4f-ba54-309bd75ac787 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:35.286425 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c8e7763d-cc5d-4f4f-ba54-309bd75ac787 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:35.292545 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c8e7763d-cc5d-4f4f-ba54-309bd75ac787 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:35.292984 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c8e7763d-cc5d-4f4f-ba54-309bd75ac787 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:35.293904 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c8e7763d-cc5d-4f4f-ba54-309bd75ac787 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:35.294335 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c8e7763d-cc5d-4f4f-ba54-309bd75ac787 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:35.420805 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c8e7763d-cc5d-4f4f-ba54-309bd75ac787 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:35.428660 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c8e7763d-cc5d-4f4f-ba54-309bd75ac787 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1514 microversion: 2.1 time: 0.155712 Oct 29 01:15:35.429262 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 252/526] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:35 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:36.034094 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e1101528-0105-4fd1-bcf8-b89d20b051be tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:36.034919 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-e1101528-0105-4fd1-bcf8-b89d20b051be tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:36.041096 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e1101528-0105-4fd1-bcf8-b89d20b051be tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:36.041538 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e1101528-0105-4fd1-bcf8-b89d20b051be tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:36.042298 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e1101528-0105-4fd1-bcf8-b89d20b051be tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:36.042750 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e1101528-0105-4fd1-bcf8-b89d20b051be tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:36.107524 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-8b9f67f9-7953-4c55-b530-f25e95c26612 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:36.108727 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-8b9f67f9-7953-4c55-b530-f25e95c26612 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:36.120314 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8b9f67f9-7953-4c55-b530-f25e95c26612 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:36.120935 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8b9f67f9-7953-4c55-b530-f25e95c26612 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:36.121826 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8b9f67f9-7953-4c55-b530-f25e95c26612 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:36.122433 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8b9f67f9-7953-4c55-b530-f25e95c26612 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:36.211332 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-e1101528-0105-4fd1-bcf8-b89d20b051be tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:36.219365 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-e1101528-0105-4fd1-bcf8-b89d20b051be tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.189767 Oct 29 01:15:36.221491 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 275/527] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:36 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:36.276539 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-8b9f67f9-7953-4c55-b530-f25e95c26612 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:36.286205 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-8b9f67f9-7953-4c55-b530-f25e95c26612 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:36.287991 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-8b9f67f9-7953-4c55-b530-f25e95c26612 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:36.289399 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-8b9f67f9-7953-4c55-b530-f25e95c26612 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1808 microversion: 2.20 time: 0.185916 Oct 29 01:15:36.290157 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 253/528] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:15:36 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:15:36.444941 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-1d02510b-06a0-4330-b65e-4f7b2295460b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:36.445562 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-1d02510b-06a0-4330-b65e-4f7b2295460b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:36.451678 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1d02510b-06a0-4330-b65e-4f7b2295460b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:36.452128 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1d02510b-06a0-4330-b65e-4f7b2295460b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:36.452894 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1d02510b-06a0-4330-b65e-4f7b2295460b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:36.453319 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1d02510b-06a0-4330-b65e-4f7b2295460b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:36.581168 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-1d02510b-06a0-4330-b65e-4f7b2295460b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:36.589399 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-1d02510b-06a0-4330-b65e-4f7b2295460b tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1514 microversion: 2.1 time: 0.148175 Oct 29 01:15:36.589979 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 276/529] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:36 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:37.237709 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-95cfa4ea-86b4-4184-8db7-d8584fbdd63c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:37.238312 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-95cfa4ea-86b4-4184-8db7-d8584fbdd63c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:37.244950 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-95cfa4ea-86b4-4184-8db7-d8584fbdd63c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:37.245406 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-95cfa4ea-86b4-4184-8db7-d8584fbdd63c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:37.246178 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-95cfa4ea-86b4-4184-8db7-d8584fbdd63c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:37.246695 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-95cfa4ea-86b4-4184-8db7-d8584fbdd63c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:37.308675 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f2f5f9c5-001e-4957-ac60-ec0d00544dfb tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:37.309399 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f2f5f9c5-001e-4957-ac60-ec0d00544dfb tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:37.316007 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f2f5f9c5-001e-4957-ac60-ec0d00544dfb tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:37.316528 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f2f5f9c5-001e-4957-ac60-ec0d00544dfb tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:37.317524 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f2f5f9c5-001e-4957-ac60-ec0d00544dfb tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:37.318150 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f2f5f9c5-001e-4957-ac60-ec0d00544dfb tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:37.420281 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-95cfa4ea-86b4-4184-8db7-d8584fbdd63c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:37.428183 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-95cfa4ea-86b4-4184-8db7-d8584fbdd63c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.194919 Oct 29 01:15:37.428755 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 254/530] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:37 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:37.480649 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-f2f5f9c5-001e-4957-ac60-ec0d00544dfb tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:37.490037 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-f2f5f9c5-001e-4957-ac60-ec0d00544dfb tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:37.492247 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-f2f5f9c5-001e-4957-ac60-ec0d00544dfb tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:37.493714 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f2f5f9c5-001e-4957-ac60-ec0d00544dfb tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1808 microversion: 2.20 time: 0.189323 Oct 29 01:15:37.494800 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 277/531] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:15:37 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:37.607283 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-102a1380-072e-4dee-9806-28c6aa847461 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:37.607997 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-102a1380-072e-4dee-9806-28c6aa847461 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:37.614627 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-102a1380-072e-4dee-9806-28c6aa847461 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:37.615143 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-102a1380-072e-4dee-9806-28c6aa847461 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:37.615973 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-102a1380-072e-4dee-9806-28c6aa847461 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:37.616471 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-102a1380-072e-4dee-9806-28c6aa847461 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:37.745408 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-102a1380-072e-4dee-9806-28c6aa847461 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:37.752741 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-102a1380-072e-4dee-9806-28c6aa847461 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1514 microversion: 2.1 time: 0.149056 Oct 29 01:15:37.753303 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 255/532] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:37 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:38.445036 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2c155099-4e0e-429f-89c0-51db8116a1ec tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:38.445646 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2c155099-4e0e-429f-89c0-51db8116a1ec tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:38.452207 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2c155099-4e0e-429f-89c0-51db8116a1ec tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:38.452658 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2c155099-4e0e-429f-89c0-51db8116a1ec tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:38.453432 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2c155099-4e0e-429f-89c0-51db8116a1ec tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:38.453867 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2c155099-4e0e-429f-89c0-51db8116a1ec tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:38.513529 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-cdb04633-63a6-47ef-af4c-70e6a77acc01 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:38.514206 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-cdb04633-63a6-47ef-af4c-70e6a77acc01 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:38.525833 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cdb04633-63a6-47ef-af4c-70e6a77acc01 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:38.526444 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cdb04633-63a6-47ef-af4c-70e6a77acc01 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:38.527260 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cdb04633-63a6-47ef-af4c-70e6a77acc01 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:38.527693 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cdb04633-63a6-47ef-af4c-70e6a77acc01 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:38.619083 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-2c155099-4e0e-429f-89c0-51db8116a1ec tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:38.632308 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2c155099-4e0e-429f-89c0-51db8116a1ec tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.190870 Oct 29 01:15:38.636037 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 278/533] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:38 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:38.679417 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-cdb04633-63a6-47ef-af4c-70e6a77acc01 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:38.687738 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-cdb04633-63a6-47ef-af4c-70e6a77acc01 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:38.689693 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-cdb04633-63a6-47ef-af4c-70e6a77acc01 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:38.692045 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-cdb04633-63a6-47ef-af4c-70e6a77acc01 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1808 microversion: 2.20 time: 0.182374 Oct 29 01:15:38.693872 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 256/534] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:15:38 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:15:38.768838 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-65a1708b-3c13-441d-984d-c712361c146a tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:38.769437 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-65a1708b-3c13-441d-984d-c712361c146a tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:38.775274 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-65a1708b-3c13-441d-984d-c712361c146a tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:38.775713 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-65a1708b-3c13-441d-984d-c712361c146a tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:38.776471 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-65a1708b-3c13-441d-984d-c712361c146a tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:38.776888 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-65a1708b-3c13-441d-984d-c712361c146a tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:38.923732 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-65a1708b-3c13-441d-984d-c712361c146a tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:38.935276 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-65a1708b-3c13-441d-984d-c712361c146a tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1514 microversion: 2.1 time: 0.169936 Oct 29 01:15:38.944994 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 279/535] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:38 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:39.650981 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9f9eb6be-8c97-4bdc-ac0b-c9f9b6e0da8a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:39.651637 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9f9eb6be-8c97-4bdc-ac0b-c9f9b6e0da8a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:39.657780 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9f9eb6be-8c97-4bdc-ac0b-c9f9b6e0da8a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:39.658225 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9f9eb6be-8c97-4bdc-ac0b-c9f9b6e0da8a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:39.659765 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9f9eb6be-8c97-4bdc-ac0b-c9f9b6e0da8a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:39.660366 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9f9eb6be-8c97-4bdc-ac0b-c9f9b6e0da8a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:39.711576 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2592e18c-671d-4975-97b5-700b17d1db7e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:39.712173 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2592e18c-671d-4975-97b5-700b17d1db7e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:39.719311 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2592e18c-671d-4975-97b5-700b17d1db7e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:39.719739 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2592e18c-671d-4975-97b5-700b17d1db7e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:39.723447 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2592e18c-671d-4975-97b5-700b17d1db7e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:39.723926 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2592e18c-671d-4975-97b5-700b17d1db7e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:39.847345 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-9f9eb6be-8c97-4bdc-ac0b-c9f9b6e0da8a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:39.859072 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9f9eb6be-8c97-4bdc-ac0b-c9f9b6e0da8a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.212501 Oct 29 01:15:39.860449 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 257/536] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:39 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:39.914677 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-2592e18c-671d-4975-97b5-700b17d1db7e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:39.923125 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-2592e18c-671d-4975-97b5-700b17d1db7e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:39.925195 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-2592e18c-671d-4975-97b5-700b17d1db7e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:39.926363 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2592e18c-671d-4975-97b5-700b17d1db7e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1808 microversion: 2.20 time: 0.218856 Oct 29 01:15:39.927130 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 280/537] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:15:39 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1808 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:39.952808 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-fc21c2aa-06f9-44f8-9ef1-57297ecfeb6c tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:39.953543 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-fc21c2aa-06f9-44f8-9ef1-57297ecfeb6c tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:39.959720 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fc21c2aa-06f9-44f8-9ef1-57297ecfeb6c tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:39.960166 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fc21c2aa-06f9-44f8-9ef1-57297ecfeb6c tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:39.961525 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fc21c2aa-06f9-44f8-9ef1-57297ecfeb6c tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:39.961525 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fc21c2aa-06f9-44f8-9ef1-57297ecfeb6c tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:40.090063 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-fc21c2aa-06f9-44f8-9ef1-57297ecfeb6c tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:40.099008 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-fc21c2aa-06f9-44f8-9ef1-57297ecfeb6c tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1514 microversion: 2.1 time: 0.149822 Oct 29 01:15:40.099689 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 258/538] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:39 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:40.877061 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f9e17ae0-8443-46fe-83b2-6d792ebf72ab tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:40.877701 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f9e17ae0-8443-46fe-83b2-6d792ebf72ab tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:40.884335 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f9e17ae0-8443-46fe-83b2-6d792ebf72ab tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:40.885281 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f9e17ae0-8443-46fe-83b2-6d792ebf72ab tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:40.886355 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f9e17ae0-8443-46fe-83b2-6d792ebf72ab tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:40.886956 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f9e17ae0-8443-46fe-83b2-6d792ebf72ab tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:40.945863 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9556e419-a24c-421c-a59f-178beedb7e5d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:40.946759 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9556e419-a24c-421c-a59f-178beedb7e5d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:40.953868 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9556e419-a24c-421c-a59f-178beedb7e5d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:40.956169 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9556e419-a24c-421c-a59f-178beedb7e5d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:40.957392 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9556e419-a24c-421c-a59f-178beedb7e5d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:40.958092 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9556e419-a24c-421c-a59f-178beedb7e5d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:41.057372 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-f9e17ae0-8443-46fe-83b2-6d792ebf72ab tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:41.065142 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f9e17ae0-8443-46fe-83b2-6d792ebf72ab tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.192259 Oct 29 01:15:41.066780 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 281/539] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:40 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:41.114828 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-9556e419-a24c-421c-a59f-178beedb7e5d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:41.116657 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-4ae8dee4-0d17-4ac1-8be8-0d6b3aa8201e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:41.117612 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-4ae8dee4-0d17-4ac1-8be8-0d6b3aa8201e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:41.123256 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-9556e419-a24c-421c-a59f-178beedb7e5d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:41.124879 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-9556e419-a24c-421c-a59f-178beedb7e5d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:41.125221 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4ae8dee4-0d17-4ac1-8be8-0d6b3aa8201e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:41.125693 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4ae8dee4-0d17-4ac1-8be8-0d6b3aa8201e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:41.126311 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9556e419-a24c-421c-a59f-178beedb7e5d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1808 microversion: 2.20 time: 0.184764 Oct 29 01:15:41.127289 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 259/540] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:15:40 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:15:41.131212 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4ae8dee4-0d17-4ac1-8be8-0d6b3aa8201e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:41.131942 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4ae8dee4-0d17-4ac1-8be8-0d6b3aa8201e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:41.265697 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-4ae8dee4-0d17-4ac1-8be8-0d6b3aa8201e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:41.273527 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-4ae8dee4-0d17-4ac1-8be8-0d6b3aa8201e tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1514 microversion: 2.1 time: 0.161513 Oct 29 01:15:41.274100 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 282/541] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:41 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:15:42.084090 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-901c2539-6c65-4247-8e1a-1cc35c16c271 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:42.084689 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-901c2539-6c65-4247-8e1a-1cc35c16c271 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:42.091195 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-901c2539-6c65-4247-8e1a-1cc35c16c271 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:42.091644 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-901c2539-6c65-4247-8e1a-1cc35c16c271 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:42.092416 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-901c2539-6c65-4247-8e1a-1cc35c16c271 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:42.092849 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-901c2539-6c65-4247-8e1a-1cc35c16c271 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:42.149176 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-40c8a23b-3ea4-4845-ad93-326a1f2c3871 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:42.149788 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-40c8a23b-3ea4-4845-ad93-326a1f2c3871 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:42.156296 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-40c8a23b-3ea4-4845-ad93-326a1f2c3871 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:42.156747 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-40c8a23b-3ea4-4845-ad93-326a1f2c3871 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:42.157524 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-40c8a23b-3ea4-4845-ad93-326a1f2c3871 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:42.157987 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-40c8a23b-3ea4-4845-ad93-326a1f2c3871 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:42.278743 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-901c2539-6c65-4247-8e1a-1cc35c16c271 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:42.286302 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-901c2539-6c65-4247-8e1a-1cc35c16c271 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.206611 Oct 29 01:15:42.287094 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 260/542] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:42 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:42.300608 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ae227bbf-2032-4256-aace-d047109f98e8 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:42.301214 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ae227bbf-2032-4256-aace-d047109f98e8 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:42.307234 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ae227bbf-2032-4256-aace-d047109f98e8 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:42.307676 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ae227bbf-2032-4256-aace-d047109f98e8 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:42.308604 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ae227bbf-2032-4256-aace-d047109f98e8 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:42.309037 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ae227bbf-2032-4256-aace-d047109f98e8 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:42.338123 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-40c8a23b-3ea4-4845-ad93-326a1f2c3871 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:42.348063 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-40c8a23b-3ea4-4845-ad93-326a1f2c3871 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:42.349654 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-40c8a23b-3ea4-4845-ad93-326a1f2c3871 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:42.350966 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-40c8a23b-3ea4-4845-ad93-326a1f2c3871 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1808 microversion: 2.20 time: 0.206965 Oct 29 01:15:42.351766 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 283/543] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:15:42 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1808 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:42.453715 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-ae227bbf-2032-4256-aace-d047109f98e8 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:42.462341 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ae227bbf-2032-4256-aace-d047109f98e8 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1514 microversion: 2.1 time: 0.173688 Oct 29 01:15:42.463379 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 261/544] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:42 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1514 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:43.302863 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-669908a6-bd6a-4604-9fb6-ebf095241fdf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:43.303450 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-669908a6-bd6a-4604-9fb6-ebf095241fdf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:43.309618 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-669908a6-bd6a-4604-9fb6-ebf095241fdf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:43.310067 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-669908a6-bd6a-4604-9fb6-ebf095241fdf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:43.310917 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-669908a6-bd6a-4604-9fb6-ebf095241fdf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:43.311339 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-669908a6-bd6a-4604-9fb6-ebf095241fdf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:43.374863 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-2f1df0b4-9d8a-4283-9c91-793124a53af4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:43.376128 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-2f1df0b4-9d8a-4283-9c91-793124a53af4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:43.382924 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2f1df0b4-9d8a-4283-9c91-793124a53af4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:43.383363 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2f1df0b4-9d8a-4283-9c91-793124a53af4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:43.384135 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2f1df0b4-9d8a-4283-9c91-793124a53af4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:43.384585 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2f1df0b4-9d8a-4283-9c91-793124a53af4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:43.490161 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-669908a6-bd6a-4604-9fb6-ebf095241fdf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:43.498171 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-669908a6-bd6a-4604-9fb6-ebf095241fdf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.199023 Oct 29 01:15:43.498780 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 284/545] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:43 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:43.503888 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-4fa28e68-7329-43ed-a7f8-9def74d79475 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:43.504485 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-4fa28e68-7329-43ed-a7f8-9def74d79475 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:43.512461 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4fa28e68-7329-43ed-a7f8-9def74d79475 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:43.513307 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4fa28e68-7329-43ed-a7f8-9def74d79475 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:43.514474 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4fa28e68-7329-43ed-a7f8-9def74d79475 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:43.515286 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4fa28e68-7329-43ed-a7f8-9def74d79475 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:43.572191 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-2f1df0b4-9d8a-4283-9c91-793124a53af4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:43.580678 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-2f1df0b4-9d8a-4283-9c91-793124a53af4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:43.583609 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-2f1df0b4-9d8a-4283-9c91-793124a53af4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:43.584781 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-2f1df0b4-9d8a-4283-9c91-793124a53af4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1808 microversion: 2.20 time: 0.219043 Oct 29 01:15:43.585695 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 262/546] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:15:43 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1808 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:15:43.663705 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-4fa28e68-7329-43ed-a7f8-9def74d79475 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:43.671078 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-4fa28e68-7329-43ed-a7f8-9def74d79475 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1514 microversion: 2.1 time: 0.171115 Oct 29 01:15:43.671655 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 285/547] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:43 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:44.515729 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-44f72cd1-7fee-4203-8498-925ed024697f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:44.516419 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-44f72cd1-7fee-4203-8498-925ed024697f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:44.523257 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-44f72cd1-7fee-4203-8498-925ed024697f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:44.523696 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-44f72cd1-7fee-4203-8498-925ed024697f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:44.524457 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-44f72cd1-7fee-4203-8498-925ed024697f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:44.524881 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-44f72cd1-7fee-4203-8498-925ed024697f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:44.602791 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c4ca8246-545c-4d8c-875a-e8c29bb8a585 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:44.603405 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c4ca8246-545c-4d8c-875a-e8c29bb8a585 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:44.611752 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c4ca8246-545c-4d8c-875a-e8c29bb8a585 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:44.612207 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c4ca8246-545c-4d8c-875a-e8c29bb8a585 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:44.613511 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c4ca8246-545c-4d8c-875a-e8c29bb8a585 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:44.613943 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c4ca8246-545c-4d8c-875a-e8c29bb8a585 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:44.649770 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-44f72cd1-7fee-4203-8498-925ed024697f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:44.657118 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-44f72cd1-7fee-4203-8498-925ed024697f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.145590 Oct 29 01:15:44.657687 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 263/548] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:44 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:44.688445 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-2f1f0b1b-a0fc-4676-a3c9-3ffd996ff4ea tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:44.689137 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-2f1f0b1b-a0fc-4676-a3c9-3ffd996ff4ea tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:44.695924 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2f1f0b1b-a0fc-4676-a3c9-3ffd996ff4ea tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:44.696369 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2f1f0b1b-a0fc-4676-a3c9-3ffd996ff4ea tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:44.697144 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2f1f0b1b-a0fc-4676-a3c9-3ffd996ff4ea tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:44.697569 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2f1f0b1b-a0fc-4676-a3c9-3ffd996ff4ea tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:44.798901 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-c4ca8246-545c-4d8c-875a-e8c29bb8a585 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:44.807801 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-c4ca8246-545c-4d8c-875a-e8c29bb8a585 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:44.809721 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-c4ca8246-545c-4d8c-875a-e8c29bb8a585 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:44.811229 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c4ca8246-545c-4d8c-875a-e8c29bb8a585 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1808 microversion: 2.20 time: 0.211957 Oct 29 01:15:44.811906 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 286/549] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:15:44 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1808 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:15:44.860520 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-2f1f0b1b-a0fc-4676-a3c9-3ffd996ff4ea tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:44.869964 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-2f1f0b1b-a0fc-4676-a3c9-3ffd996ff4ea tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1514 microversion: 2.1 time: 0.185904 Oct 29 01:15:44.870563 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 264/550] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:44 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1514 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:15:45.673917 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-7b0de67e-8a9f-4642-8d59-a26cf97f343a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:45.674554 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-7b0de67e-8a9f-4642-8d59-a26cf97f343a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:45.681443 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7b0de67e-8a9f-4642-8d59-a26cf97f343a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:45.681894 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7b0de67e-8a9f-4642-8d59-a26cf97f343a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:45.682677 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7b0de67e-8a9f-4642-8d59-a26cf97f343a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:45.683112 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7b0de67e-8a9f-4642-8d59-a26cf97f343a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:45.815722 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-7b0de67e-8a9f-4642-8d59-a26cf97f343a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:45.823272 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-7b0de67e-8a9f-4642-8d59-a26cf97f343a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.153046 Oct 29 01:15:45.823843 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 287/551] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:45 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:45.829742 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d74d1de5-8b6d-4c84-829d-498577947e64 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:45.830454 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d74d1de5-8b6d-4c84-829d-498577947e64 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:45.837404 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d74d1de5-8b6d-4c84-829d-498577947e64 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:45.837926 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d74d1de5-8b6d-4c84-829d-498577947e64 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:45.838981 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d74d1de5-8b6d-4c84-829d-498577947e64 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:45.839487 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d74d1de5-8b6d-4c84-829d-498577947e64 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:45.887357 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-05615b83-d816-4cd2-ba0f-a426afaa4929 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:45.887954 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-05615b83-d816-4cd2-ba0f-a426afaa4929 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:45.893680 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-05615b83-d816-4cd2-ba0f-a426afaa4929 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:45.894121 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-05615b83-d816-4cd2-ba0f-a426afaa4929 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:45.894951 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-05615b83-d816-4cd2-ba0f-a426afaa4929 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:45.895375 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-05615b83-d816-4cd2-ba0f-a426afaa4929 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:46.005639 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-d74d1de5-8b6d-4c84-829d-498577947e64 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:46.014082 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-d74d1de5-8b6d-4c84-829d-498577947e64 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:46.015889 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-d74d1de5-8b6d-4c84-829d-498577947e64 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:46.017318 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d74d1de5-8b6d-4c84-829d-498577947e64 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1808 microversion: 2.20 time: 0.191152 Oct 29 01:15:46.028458 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 265/552] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:15:45 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1808 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:46.059571 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-05615b83-d816-4cd2-ba0f-a426afaa4929 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:46.067256 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-05615b83-d816-4cd2-ba0f-a426afaa4929 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1514 microversion: 2.1 time: 0.183565 Oct 29 01:15:46.067829 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 288/553] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:45 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1514 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:15:46.840447 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-1a89dd20-c3f3-4d95-9a89-01b485fd6ca9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:46.841061 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-1a89dd20-c3f3-4d95-9a89-01b485fd6ca9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:46.847317 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1a89dd20-c3f3-4d95-9a89-01b485fd6ca9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:46.847826 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1a89dd20-c3f3-4d95-9a89-01b485fd6ca9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:46.848597 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1a89dd20-c3f3-4d95-9a89-01b485fd6ca9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:46.849032 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1a89dd20-c3f3-4d95-9a89-01b485fd6ca9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:46.975941 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-1a89dd20-c3f3-4d95-9a89-01b485fd6ca9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:46.983866 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-1a89dd20-c3f3-4d95-9a89-01b485fd6ca9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.147032 Oct 29 01:15:46.984432 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 266/554] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:46 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:47.035431 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-45056560-db29-4ed5-a7b5-c7f3ef4ec8f9 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:47.036055 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-45056560-db29-4ed5-a7b5-c7f3ef4ec8f9 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:47.042298 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-45056560-db29-4ed5-a7b5-c7f3ef4ec8f9 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:47.042799 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-45056560-db29-4ed5-a7b5-c7f3ef4ec8f9 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:47.043564 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-45056560-db29-4ed5-a7b5-c7f3ef4ec8f9 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:47.043999 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-45056560-db29-4ed5-a7b5-c7f3ef4ec8f9 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:47.084952 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f75f2887-cbfe-4dbb-a594-c490bd54c004 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:47.085406 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f75f2887-cbfe-4dbb-a594-c490bd54c004 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:47.091562 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f75f2887-cbfe-4dbb-a594-c490bd54c004 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:47.092022 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f75f2887-cbfe-4dbb-a594-c490bd54c004 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:47.092810 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f75f2887-cbfe-4dbb-a594-c490bd54c004 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:47.093244 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f75f2887-cbfe-4dbb-a594-c490bd54c004 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:47.209882 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-45056560-db29-4ed5-a7b5-c7f3ef4ec8f9 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:47.219061 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-45056560-db29-4ed5-a7b5-c7f3ef4ec8f9 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:47.220565 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-45056560-db29-4ed5-a7b5-c7f3ef4ec8f9 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:47.221709 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-45056560-db29-4ed5-a7b5-c7f3ef4ec8f9 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1808 microversion: 2.20 time: 0.190182 Oct 29 01:15:47.222259 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 289/555] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:15:47 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:47.259304 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-f75f2887-cbfe-4dbb-a594-c490bd54c004 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:47.266539 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f75f2887-cbfe-4dbb-a594-c490bd54c004 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1514 microversion: 2.1 time: 0.185689 Oct 29 01:15:47.267105 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 267/556] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:47 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1514 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:15:48.003869 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-dadf905c-b22e-4ef7-9c9c-fbbabbf6a4c7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:48.004574 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-dadf905c-b22e-4ef7-9c9c-fbbabbf6a4c7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:48.010753 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dadf905c-b22e-4ef7-9c9c-fbbabbf6a4c7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:48.011199 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dadf905c-b22e-4ef7-9c9c-fbbabbf6a4c7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:48.011965 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dadf905c-b22e-4ef7-9c9c-fbbabbf6a4c7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:48.012394 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dadf905c-b22e-4ef7-9c9c-fbbabbf6a4c7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:48.140596 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-dadf905c-b22e-4ef7-9c9c-fbbabbf6a4c7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:48.148170 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-dadf905c-b22e-4ef7-9c9c-fbbabbf6a4c7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.150960 Oct 29 01:15:48.148921 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 290/557] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:47 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:48.239826 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c3ac40ca-9648-41a0-b27a-277160799268 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:48.240428 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c3ac40ca-9648-41a0-b27a-277160799268 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:48.246610 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c3ac40ca-9648-41a0-b27a-277160799268 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:48.247057 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c3ac40ca-9648-41a0-b27a-277160799268 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:48.247824 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c3ac40ca-9648-41a0-b27a-277160799268 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:48.248263 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c3ac40ca-9648-41a0-b27a-277160799268 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:48.283709 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-17e5decb-16be-478e-a615-4003c6047baf tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:48.284365 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-17e5decb-16be-478e-a615-4003c6047baf tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:48.290186 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-17e5decb-16be-478e-a615-4003c6047baf tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:48.290661 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-17e5decb-16be-478e-a615-4003c6047baf tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:48.291423 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-17e5decb-16be-478e-a615-4003c6047baf tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:48.291855 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-17e5decb-16be-478e-a615-4003c6047baf tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:48.431387 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c3ac40ca-9648-41a0-b27a-277160799268 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:48.439892 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c3ac40ca-9648-41a0-b27a-277160799268 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:48.442311 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c3ac40ca-9648-41a0-b27a-277160799268 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:48.443804 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c3ac40ca-9648-41a0-b27a-277160799268 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1808 microversion: 2.20 time: 0.207669 Oct 29 01:15:48.444745 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 268/558] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:15:48 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1808 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:48.458013 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-17e5decb-16be-478e-a615-4003c6047baf tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:48.466155 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-17e5decb-16be-478e-a615-4003c6047baf tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1514 microversion: 2.1 time: 0.186027 Oct 29 01:15:48.466959 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 291/559] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:48 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1514 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:15:49.165457 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-e83ee5c0-4bc0-4c9c-9552-5a7610c7ad59 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:49.166461 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-e83ee5c0-4bc0-4c9c-9552-5a7610c7ad59 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:49.172757 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e83ee5c0-4bc0-4c9c-9552-5a7610c7ad59 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:49.173207 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e83ee5c0-4bc0-4c9c-9552-5a7610c7ad59 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:49.173977 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e83ee5c0-4bc0-4c9c-9552-5a7610c7ad59 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:49.174495 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e83ee5c0-4bc0-4c9c-9552-5a7610c7ad59 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:49.300733 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-e83ee5c0-4bc0-4c9c-9552-5a7610c7ad59 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:49.308327 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-e83ee5c0-4bc0-4c9c-9552-5a7610c7ad59 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.146585 Oct 29 01:15:49.308887 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 269/560] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:49 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:49.462732 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-8b96c47e-1c1c-45d3-8396-6f4557580d85 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:49.463273 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-8b96c47e-1c1c-45d3-8396-6f4557580d85 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:49.469426 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8b96c47e-1c1c-45d3-8396-6f4557580d85 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:49.469878 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8b96c47e-1c1c-45d3-8396-6f4557580d85 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:49.470671 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8b96c47e-1c1c-45d3-8396-6f4557580d85 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:49.471149 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8b96c47e-1c1c-45d3-8396-6f4557580d85 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:49.483503 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-4c6c63d9-3ed2-4b5b-a7c4-aae157a40236 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:49.484100 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-4c6c63d9-3ed2-4b5b-a7c4-aae157a40236 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:49.489776 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4c6c63d9-3ed2-4b5b-a7c4-aae157a40236 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:49.490220 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4c6c63d9-3ed2-4b5b-a7c4-aae157a40236 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:49.491004 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4c6c63d9-3ed2-4b5b-a7c4-aae157a40236 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:49.491433 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4c6c63d9-3ed2-4b5b-a7c4-aae157a40236 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:49.880502 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-8b96c47e-1c1c-45d3-8396-6f4557580d85 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:49.890682 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-8b96c47e-1c1c-45d3-8396-6f4557580d85 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:49.890910 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-4c6c63d9-3ed2-4b5b-a7c4-aae157a40236 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:49.891029 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-8b96c47e-1c1c-45d3-8396-6f4557580d85 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:49.891992 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-8b96c47e-1c1c-45d3-8396-6f4557580d85 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1808 microversion: 2.20 time: 0.433031 Oct 29 01:15:49.892557 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 292/561] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:15:49 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1808 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:15:49.899326 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-4c6c63d9-3ed2-4b5b-a7c4-aae157a40236 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1514 microversion: 2.1 time: 0.419264 Oct 29 01:15:49.899911 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 270/562] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:49 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1514 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:15:50.324485 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-97f8d767-9862-4c61-b8a1-9524650f682f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:50.325089 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-97f8d767-9862-4c61-b8a1-9524650f682f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:50.331872 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-97f8d767-9862-4c61-b8a1-9524650f682f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:50.332579 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-97f8d767-9862-4c61-b8a1-9524650f682f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:50.333372 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-97f8d767-9862-4c61-b8a1-9524650f682f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:50.333800 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-97f8d767-9862-4c61-b8a1-9524650f682f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:50.456434 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-97f8d767-9862-4c61-b8a1-9524650f682f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:50.464042 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-97f8d767-9862-4c61-b8a1-9524650f682f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1521 microversion: 2.1 time: 0.143094 Oct 29 01:15:50.467086 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 293/563] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:50 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:50.910405 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-627a2bc3-5b48-422f-9068-a8d552a176f1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:50.911117 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-627a2bc3-5b48-422f-9068-a8d552a176f1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:50.915734 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e8c249bb-aa27-4ee4-acc6-bb13ed2cd23f tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:50.916373 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-e8c249bb-aa27-4ee4-acc6-bb13ed2cd23f tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:50.917410 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-627a2bc3-5b48-422f-9068-a8d552a176f1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:50.917860 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-627a2bc3-5b48-422f-9068-a8d552a176f1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:50.918664 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-627a2bc3-5b48-422f-9068-a8d552a176f1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:50.919097 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-627a2bc3-5b48-422f-9068-a8d552a176f1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:50.922515 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e8c249bb-aa27-4ee4-acc6-bb13ed2cd23f tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:50.922965 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e8c249bb-aa27-4ee4-acc6-bb13ed2cd23f tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:50.923719 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e8c249bb-aa27-4ee4-acc6-bb13ed2cd23f tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:50.924152 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e8c249bb-aa27-4ee4-acc6-bb13ed2cd23f tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:51.105674 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-e8c249bb-aa27-4ee4-acc6-bb13ed2cd23f tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:51.109208 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-627a2bc3-5b48-422f-9068-a8d552a176f1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:51.114142 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-e8c249bb-aa27-4ee4-acc6-bb13ed2cd23f tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1514 microversion: 2.1 time: 0.201261 Oct 29 01:15:51.118655 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 294/564] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:50 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1514 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:51.122430 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-627a2bc3-5b48-422f-9068-a8d552a176f1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:51.123919 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-627a2bc3-5b48-422f-9068-a8d552a176f1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:51.125058 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-627a2bc3-5b48-422f-9068-a8d552a176f1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1808 microversion: 2.20 time: 0.218498 Oct 29 01:15:51.125871 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 271/565] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:15:50 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1808 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:51.480871 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-6cec51b1-3890-4564-b064-fb9fd38fa4ab tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:51.481489 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-6cec51b1-3890-4564-b064-fb9fd38fa4ab tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:51.487507 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6cec51b1-3890-4564-b064-fb9fd38fa4ab tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:51.487957 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6cec51b1-3890-4564-b064-fb9fd38fa4ab tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:51.489209 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6cec51b1-3890-4564-b064-fb9fd38fa4ab tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:51.489646 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6cec51b1-3890-4564-b064-fb9fd38fa4ab tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:51.608707 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-6cec51b1-3890-4564-b064-fb9fd38fa4ab tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:51.616620 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-6cec51b1-3890-4564-b064-fb9fd38fa4ab tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1501 microversion: 2.1 time: 0.139463 Oct 29 01:15:51.617185 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 295/566] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:51 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1501 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:51.632582 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-1542ff20-28a8-4fcf-97bd-b6d7be3180e8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:51.633190 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-1542ff20-28a8-4fcf-97bd-b6d7be3180e8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:51.639008 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1542ff20-28a8-4fcf-97bd-b6d7be3180e8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:51.639456 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1542ff20-28a8-4fcf-97bd-b6d7be3180e8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:51.640209 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1542ff20-28a8-4fcf-97bd-b6d7be3180e8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:51.640639 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1542ff20-28a8-4fcf-97bd-b6d7be3180e8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:51.759920 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-1542ff20-28a8-4fcf-97bd-b6d7be3180e8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:51.767093 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-1542ff20-28a8-4fcf-97bd-b6d7be3180e8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1516 microversion: 2.1 time: 0.138741 Oct 29 01:15:51.767655 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 272/567] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:51 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1516 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:52.132988 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-855ca27b-56d4-474b-b751-b0c230dfa60c tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:52.134192 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-855ca27b-56d4-474b-b751-b0c230dfa60c tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:52.140967 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-855ca27b-56d4-474b-b751-b0c230dfa60c tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:52.141557 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-855ca27b-56d4-474b-b751-b0c230dfa60c tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:52.142324 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-855ca27b-56d4-474b-b751-b0c230dfa60c tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:52.142780 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-855ca27b-56d4-474b-b751-b0c230dfa60c tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:52.143761 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-622c3970-9b2c-405b-8857-d205bad4160b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:52.144438 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-622c3970-9b2c-405b-8857-d205bad4160b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:52.151294 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-622c3970-9b2c-405b-8857-d205bad4160b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:52.151951 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-622c3970-9b2c-405b-8857-d205bad4160b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:52.152798 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-622c3970-9b2c-405b-8857-d205bad4160b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:52.153319 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-622c3970-9b2c-405b-8857-d205bad4160b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:52.327372 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-855ca27b-56d4-474b-b751-b0c230dfa60c tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:52.336110 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-855ca27b-56d4-474b-b751-b0c230dfa60c tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1514 microversion: 2.1 time: 0.207319 Oct 29 01:15:52.339206 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-622c3970-9b2c-405b-8857-d205bad4160b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:52.346437 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 296/568] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:52 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1514 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:52.348175 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-622c3970-9b2c-405b-8857-d205bad4160b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:52.349602 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-622c3970-9b2c-405b-8857-d205bad4160b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:52.350791 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-622c3970-9b2c-405b-8857-d205bad4160b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1808 microversion: 2.20 time: 0.211445 Oct 29 01:15:52.351481 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 273/569] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:15:52 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1808 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:53.105913 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-4687d815-cec0-4e55-bd5e-d0a4941d3787 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:53.107566 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-4687d815-cec0-4e55-bd5e-d0a4941d3787 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:53.113973 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4687d815-cec0-4e55-bd5e-d0a4941d3787 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:53.114442 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4687d815-cec0-4e55-bd5e-d0a4941d3787 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:53.115221 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4687d815-cec0-4e55-bd5e-d0a4941d3787 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:53.115655 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4687d815-cec0-4e55-bd5e-d0a4941d3787 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:53.142242 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.objects.instance [None req-4687d815-cec0-4e55-bd5e-d0a4941d3787 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lazy-loading 'flavor' on Instance uuid 0ff6277c-b59e-467c-82d4-631046fb03d9 {{(pid=115748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:15:53.217006 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-4687d815-cec0-4e55-bd5e-d0a4941d3787 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "POST /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/action" status: 200 len: 32 microversion: 2.1 time: 0.113907 Oct 29 01:15:53.217006 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 297/570] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:15:53 2021] POST /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/action => generated 32 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:15:53.227578 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-219f6a33-8242-40da-8385-ea904396ba73 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:53.227578 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-219f6a33-8242-40da-8385-ea904396ba73 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:53.234713 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-219f6a33-8242-40da-8385-ea904396ba73 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:53.235308 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-219f6a33-8242-40da-8385-ea904396ba73 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:53.236096 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-219f6a33-8242-40da-8385-ea904396ba73 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:53.236526 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-219f6a33-8242-40da-8385-ea904396ba73 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:53.280538 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [req-29a6bb48-5302-4024-ab5e-4dd1c11e7744 req-e39008a5-8117-4b4e-a767-389141deef7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e789e569-3570-483f-8768-27b5be53c535", "name": "network-vif-deleted", "tag": "df5dbe79-b13c-4a7f-a7df-7f7b2b74a2db"}]} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:53.282046 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:15:53.282046 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: warnings.warn(msg) Oct 29 01:15:53.290302 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-29a6bb48-5302-4024-ab5e-4dd1c11e7744 req-e39008a5-8117-4b4e-a767-389141deef7a service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:53.290762 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-29a6bb48-5302-4024-ab5e-4dd1c11e7744 req-e39008a5-8117-4b4e-a767-389141deef7a service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:53.301875 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.compute.server_external_events [req-29a6bb48-5302-4024-ab5e-4dd1c11e7744 req-e39008a5-8117-4b4e-a767-389141deef7a service nova] Creating event network-vif-deleted:df5dbe79-b13c-4a7f-a7df-7f7b2b74a2db for instance e789e569-3570-483f-8768-27b5be53c535 on hv-cinder-81558 Oct 29 01:15:53.306706 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [req-29a6bb48-5302-4024-ab5e-4dd1c11e7744 req-e39008a5-8117-4b4e-a767-389141deef7a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029977 Oct 29 01:15:53.307398 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 298/571] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:15:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:15:53.362016 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-5b6988dc-5bad-49ce-8bd7-15dbcd9b0752 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:53.362016 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-5b6988dc-5bad-49ce-8bd7-15dbcd9b0752 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:53.367712 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-219f6a33-8242-40da-8385-ea904396ba73 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:53.369930 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5b6988dc-5bad-49ce-8bd7-15dbcd9b0752 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:53.370376 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5b6988dc-5bad-49ce-8bd7-15dbcd9b0752 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:53.371190 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5b6988dc-5bad-49ce-8bd7-15dbcd9b0752 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:53.371620 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5b6988dc-5bad-49ce-8bd7-15dbcd9b0752 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:53.375071 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-219f6a33-8242-40da-8385-ea904396ba73 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1522 microversion: 2.1 time: 0.153109 Oct 29 01:15:53.375634 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 274/572] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:53 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:53.380557 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a34e4e02-40a7-4c58-aa9c-29c57f9c34b6 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:53.381161 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a34e4e02-40a7-4c58-aa9c-29c57f9c34b6 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:53.386915 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a34e4e02-40a7-4c58-aa9c-29c57f9c34b6 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:53.387369 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a34e4e02-40a7-4c58-aa9c-29c57f9c34b6 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:53.388136 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a34e4e02-40a7-4c58-aa9c-29c57f9c34b6 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:53.388572 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a34e4e02-40a7-4c58-aa9c-29c57f9c34b6 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:53.444597 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-5b6988dc-5bad-49ce-8bd7-15dbcd9b0752 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:53.452676 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-5b6988dc-5bad-49ce-8bd7-15dbcd9b0752 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1472 microversion: 2.1 time: 0.096766 Oct 29 01:15:53.454535 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 299/573] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:53 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1472 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:15:53.542737 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-a34e4e02-40a7-4c58-aa9c-29c57f9c34b6 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:53.551929 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-a34e4e02-40a7-4c58-aa9c-29c57f9c34b6 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:53.553428 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-a34e4e02-40a7-4c58-aa9c-29c57f9c34b6 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:53.554879 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a34e4e02-40a7-4c58-aa9c-29c57f9c34b6 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1808 microversion: 2.20 time: 0.178266 Oct 29 01:15:53.555433 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 275/574] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:15:53 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:54.391840 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-63cfae57-ccd5-423a-bb3a-a786ea52abe5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:54.392459 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-63cfae57-ccd5-423a-bb3a-a786ea52abe5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:54.399189 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-63cfae57-ccd5-423a-bb3a-a786ea52abe5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:54.399643 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-63cfae57-ccd5-423a-bb3a-a786ea52abe5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:54.400476 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-63cfae57-ccd5-423a-bb3a-a786ea52abe5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:54.400870 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-63cfae57-ccd5-423a-bb3a-a786ea52abe5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:54.470793 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a47037d8-188a-45b7-9203-9db3ecf210ba tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:54.471366 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a47037d8-188a-45b7-9203-9db3ecf210ba tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:54.480255 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a47037d8-188a-45b7-9203-9db3ecf210ba tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:54.480813 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a47037d8-188a-45b7-9203-9db3ecf210ba tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:54.481984 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a47037d8-188a-45b7-9203-9db3ecf210ba tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:54.482631 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a47037d8-188a-45b7-9203-9db3ecf210ba tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:54.521476 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a47037d8-188a-45b7-9203-9db3ecf210ba tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:54.521922 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a47037d8-188a-45b7-9203-9db3ecf210ba tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:54.522551 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.objects.instance [None req-a47037d8-188a-45b7-9203-9db3ecf210ba tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lazy-loading 'fault' on Instance uuid e789e569-3570-483f-8768-27b5be53c535 {{(pid=115747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:15:54.533923 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-63cfae57-ccd5-423a-bb3a-a786ea52abe5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:54.543179 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-63cfae57-ccd5-423a-bb3a-a786ea52abe5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1522 microversion: 2.1 time: 0.154903 Oct 29 01:15:54.543771 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 300/575] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:54 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:54.570289 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-a47037d8-188a-45b7-9203-9db3ecf210ba tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe86a50674f4837bfcb81170f5fd253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f0948092d4f3c929575a405284599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:54.576870 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a47037d8-188a-45b7-9203-9db3ecf210ba tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 200 len: 1308 microversion: 2.1 time: 0.111659 Oct 29 01:15:54.577131 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2bc869d9-3a5d-4e5c-b4cd-4a91d1bdb2e7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:54.578029 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 276/576] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:54 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 1308 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:54.579356 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2bc869d9-3a5d-4e5c-b4cd-4a91d1bdb2e7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:54.587623 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2bc869d9-3a5d-4e5c-b4cd-4a91d1bdb2e7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:54.588064 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2bc869d9-3a5d-4e5c-b4cd-4a91d1bdb2e7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:54.588858 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2bc869d9-3a5d-4e5c-b4cd-4a91d1bdb2e7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:54.589297 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2bc869d9-3a5d-4e5c-b4cd-4a91d1bdb2e7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:54.711773 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-2bc869d9-3a5d-4e5c-b4cd-4a91d1bdb2e7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:54.719800 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-2bc869d9-3a5d-4e5c-b4cd-4a91d1bdb2e7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:54.721341 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-2bc869d9-3a5d-4e5c-b4cd-4a91d1bdb2e7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:54.722436 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2bc869d9-3a5d-4e5c-b4cd-4a91d1bdb2e7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1808 microversion: 2.20 time: 0.152620 Oct 29 01:15:54.722984 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 301/577] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:15:54 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:55.560792 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d7c57d45-51b2-4791-a70d-1760cf15622c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:55.561348 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d7c57d45-51b2-4791-a70d-1760cf15622c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:55.567494 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d7c57d45-51b2-4791-a70d-1760cf15622c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:55.567948 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d7c57d45-51b2-4791-a70d-1760cf15622c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:55.568701 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d7c57d45-51b2-4791-a70d-1760cf15622c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:55.569130 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d7c57d45-51b2-4791-a70d-1760cf15622c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:55.593703 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2af1e8e7-e4cb-4495-84a4-b8b4d48a9c20 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:55.594962 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2af1e8e7-e4cb-4495-84a4-b8b4d48a9c20 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] [instance: e789e569-3570-483f-8768-27b5be53c535] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:55.601794 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2af1e8e7-e4cb-4495-84a4-b8b4d48a9c20 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:55.602242 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2af1e8e7-e4cb-4495-84a4-b8b4d48a9c20 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:55.603038 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2af1e8e7-e4cb-4495-84a4-b8b4d48a9c20 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:55.603466 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2af1e8e7-e4cb-4495-84a4-b8b4d48a9c20 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:55.617873 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.wsgi [None req-2af1e8e7-e4cb-4495-84a4-b8b4d48a9c20 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] HTTP exception thrown: Instance e789e569-3570-483f-8768-27b5be53c535 could not be found. Oct 29 01:15:55.618923 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2af1e8e7-e4cb-4495-84a4-b8b4d48a9c20 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] Returning 404 to user: Instance e789e569-3570-483f-8768-27b5be53c535 could not be found. {{(pid=115748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:15:55.624165 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2af1e8e7-e4cb-4495-84a4-b8b4d48a9c20 tempest-AttachVolumeNegativeTest-2136777209 tempest-AttachVolumeNegativeTest-2136777209-project] 10.222.0.90 "GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535" status: 404 len: 111 microversion: 2.1 time: 0.033211 Oct 29 01:15:55.624165 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 302/578] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:55 2021] GET /compute/v2.1/servers/e789e569-3570-483f-8768-27b5be53c535 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:15:55.696319 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-d7c57d45-51b2-4791-a70d-1760cf15622c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:55.705021 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d7c57d45-51b2-4791-a70d-1760cf15622c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1522 microversion: 2.1 time: 0.148053 Oct 29 01:15:55.706047 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 277/579] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:55 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:15:55.739522 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e08d6b08-dcc3-4d49-9e77-8ce3a28d3810 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:55.740119 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-e08d6b08-dcc3-4d49-9e77-8ce3a28d3810 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:55.746055 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e08d6b08-dcc3-4d49-9e77-8ce3a28d3810 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:55.746531 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e08d6b08-dcc3-4d49-9e77-8ce3a28d3810 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:55.747289 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e08d6b08-dcc3-4d49-9e77-8ce3a28d3810 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:55.747722 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e08d6b08-dcc3-4d49-9e77-8ce3a28d3810 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:55.876012 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-e08d6b08-dcc3-4d49-9e77-8ce3a28d3810 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:55.884907 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-e08d6b08-dcc3-4d49-9e77-8ce3a28d3810 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:55.886430 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-e08d6b08-dcc3-4d49-9e77-8ce3a28d3810 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:55.887685 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-e08d6b08-dcc3-4d49-9e77-8ce3a28d3810 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1808 microversion: 2.20 time: 0.152035 Oct 29 01:15:55.888244 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 303/580] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:15:55 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:56.730066 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a0596972-1778-44f6-ac99-df917851948d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:56.730755 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a0596972-1778-44f6-ac99-df917851948d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:56.737284 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a0596972-1778-44f6-ac99-df917851948d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:56.737919 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a0596972-1778-44f6-ac99-df917851948d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:56.738862 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a0596972-1778-44f6-ac99-df917851948d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:56.739299 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a0596972-1778-44f6-ac99-df917851948d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:56.880285 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-a0596972-1778-44f6-ac99-df917851948d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:56.887554 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a0596972-1778-44f6-ac99-df917851948d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1522 microversion: 2.1 time: 0.168920 Oct 29 01:15:56.888113 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 278/581] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:56 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:56.905700 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-66f75936-0c3a-4593-9042-80aaf3b1483e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:56.906444 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-66f75936-0c3a-4593-9042-80aaf3b1483e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:56.913828 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-66f75936-0c3a-4593-9042-80aaf3b1483e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:56.914653 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-66f75936-0c3a-4593-9042-80aaf3b1483e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:56.915646 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-66f75936-0c3a-4593-9042-80aaf3b1483e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:56.916088 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-66f75936-0c3a-4593-9042-80aaf3b1483e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:57.044179 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-66f75936-0c3a-4593-9042-80aaf3b1483e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:57.052834 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-66f75936-0c3a-4593-9042-80aaf3b1483e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:57.054317 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-66f75936-0c3a-4593-9042-80aaf3b1483e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:57.055682 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-66f75936-0c3a-4593-9042-80aaf3b1483e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1808 microversion: 2.20 time: 0.153807 Oct 29 01:15:57.056231 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 304/582] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:15:56 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:57.906819 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-801da55f-2a91-4235-93f6-071301a2928d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:57.907581 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-801da55f-2a91-4235-93f6-071301a2928d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:57.920886 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-801da55f-2a91-4235-93f6-071301a2928d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:57.921337 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-801da55f-2a91-4235-93f6-071301a2928d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:57.922117 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-801da55f-2a91-4235-93f6-071301a2928d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:57.922671 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-801da55f-2a91-4235-93f6-071301a2928d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:58.068362 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-801da55f-2a91-4235-93f6-071301a2928d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:58.073000 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-8154ba28-72ee-4777-b383-644219b08826 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:58.073605 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-8154ba28-72ee-4777-b383-644219b08826 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:58.076091 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-801da55f-2a91-4235-93f6-071301a2928d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1522 microversion: 2.1 time: 0.174122 Oct 29 01:15:58.076847 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 279/583] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:57 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:58.080263 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8154ba28-72ee-4777-b383-644219b08826 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:58.080701 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8154ba28-72ee-4777-b383-644219b08826 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:58.081466 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8154ba28-72ee-4777-b383-644219b08826 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:58.082144 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8154ba28-72ee-4777-b383-644219b08826 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:58.209913 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-8154ba28-72ee-4777-b383-644219b08826 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:58.218207 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-8154ba28-72ee-4777-b383-644219b08826 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:58.219936 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-8154ba28-72ee-4777-b383-644219b08826 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:58.221132 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-8154ba28-72ee-4777-b383-644219b08826 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1808 microversion: 2.20 time: 0.151752 Oct 29 01:15:58.221686 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 305/584] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:15:58 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:15:59.093197 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-86129b7f-4811-46ac-82f4-891425e121af tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:59.094076 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-86129b7f-4811-46ac-82f4-891425e121af tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:59.101303 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-86129b7f-4811-46ac-82f4-891425e121af tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:59.101745 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-86129b7f-4811-46ac-82f4-891425e121af tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:59.102555 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-86129b7f-4811-46ac-82f4-891425e121af tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:59.103005 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-86129b7f-4811-46ac-82f4-891425e121af tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:59.234889 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-86129b7f-4811-46ac-82f4-891425e121af tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:59.242994 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-86129b7f-4811-46ac-82f4-891425e121af tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1522 microversion: 2.1 time: 0.153537 Oct 29 01:15:59.243563 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 280/585] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:15:59 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:59.244141 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-4d5eddac-52f2-445d-9737-5e23fe39e118 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:59.244819 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-4d5eddac-52f2-445d-9737-5e23fe39e118 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:15:59.251141 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4d5eddac-52f2-445d-9737-5e23fe39e118 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:59.251582 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4d5eddac-52f2-445d-9737-5e23fe39e118 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:59.252349 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4d5eddac-52f2-445d-9737-5e23fe39e118 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:15:59.252965 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4d5eddac-52f2-445d-9737-5e23fe39e118 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:15:59.380998 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-4d5eddac-52f2-445d-9737-5e23fe39e118 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:59.389274 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-4d5eddac-52f2-445d-9737-5e23fe39e118 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:59.390807 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-4d5eddac-52f2-445d-9737-5e23fe39e118 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:59.391958 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-4d5eddac-52f2-445d-9737-5e23fe39e118 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1808 microversion: 2.20 time: 0.152109 Oct 29 01:15:59.392512 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 306/586] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:15:59 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:00.259975 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-67da2e9b-efa2-47d0-a776-330544a23b18 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:00.260575 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-67da2e9b-efa2-47d0-a776-330544a23b18 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:00.275256 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-67da2e9b-efa2-47d0-a776-330544a23b18 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:00.275256 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-67da2e9b-efa2-47d0-a776-330544a23b18 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:00.275256 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-67da2e9b-efa2-47d0-a776-330544a23b18 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:00.275256 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-67da2e9b-efa2-47d0-a776-330544a23b18 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:00.399556 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-67da2e9b-efa2-47d0-a776-330544a23b18 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:00.407257 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-67da2e9b-efa2-47d0-a776-330544a23b18 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1522 microversion: 2.1 time: 0.150881 Oct 29 01:16:00.407986 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 281/587] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:16:00 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:00.408601 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-0fbbaa7f-57c0-45ce-a7d8-1e3f10138373 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:00.409564 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-0fbbaa7f-57c0-45ce-a7d8-1e3f10138373 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:00.416480 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0fbbaa7f-57c0-45ce-a7d8-1e3f10138373 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:00.416928 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0fbbaa7f-57c0-45ce-a7d8-1e3f10138373 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:00.417694 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0fbbaa7f-57c0-45ce-a7d8-1e3f10138373 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:00.418124 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0fbbaa7f-57c0-45ce-a7d8-1e3f10138373 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:00.541646 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-0fbbaa7f-57c0-45ce-a7d8-1e3f10138373 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:00.550022 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-0fbbaa7f-57c0-45ce-a7d8-1e3f10138373 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:00.551544 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-0fbbaa7f-57c0-45ce-a7d8-1e3f10138373 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:00.552693 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-0fbbaa7f-57c0-45ce-a7d8-1e3f10138373 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1808 microversion: 2.20 time: 0.147714 Oct 29 01:16:00.553240 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 307/588] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:16:00 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1808 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:16:01.424522 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d56d4d12-981f-4f4d-8aa5-8a1efa9ffe65 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:01.425123 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d56d4d12-981f-4f4d-8aa5-8a1efa9ffe65 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:01.431912 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d56d4d12-981f-4f4d-8aa5-8a1efa9ffe65 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:01.432359 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d56d4d12-981f-4f4d-8aa5-8a1efa9ffe65 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:01.433117 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d56d4d12-981f-4f4d-8aa5-8a1efa9ffe65 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:01.433548 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d56d4d12-981f-4f4d-8aa5-8a1efa9ffe65 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:01.549697 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-d56d4d12-981f-4f4d-8aa5-8a1efa9ffe65 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:01.557440 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d56d4d12-981f-4f4d-8aa5-8a1efa9ffe65 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1522 microversion: 2.1 time: 0.136597 Oct 29 01:16:01.558003 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 282/589] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:16:01 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1522 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:01.570176 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-7184afeb-2716-4ee1-b309-deae0ab2af3c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:01.570817 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-7184afeb-2716-4ee1-b309-deae0ab2af3c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:01.576963 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7184afeb-2716-4ee1-b309-deae0ab2af3c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:01.577412 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7184afeb-2716-4ee1-b309-deae0ab2af3c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:01.578176 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7184afeb-2716-4ee1-b309-deae0ab2af3c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:01.578639 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7184afeb-2716-4ee1-b309-deae0ab2af3c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:01.699671 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-7184afeb-2716-4ee1-b309-deae0ab2af3c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:01.708177 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-7184afeb-2716-4ee1-b309-deae0ab2af3c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:01.709656 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-7184afeb-2716-4ee1-b309-deae0ab2af3c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:01.710821 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-7184afeb-2716-4ee1-b309-deae0ab2af3c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1808 microversion: 2.20 time: 0.144320 Oct 29 01:16:01.711371 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 308/590] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:16:01 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1808 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:02.573779 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c9a12a0e-eca4-41e4-9833-04ba8e83ef38 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:02.574401 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c9a12a0e-eca4-41e4-9833-04ba8e83ef38 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:02.580663 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c9a12a0e-eca4-41e4-9833-04ba8e83ef38 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:02.581098 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c9a12a0e-eca4-41e4-9833-04ba8e83ef38 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:02.582656 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c9a12a0e-eca4-41e4-9833-04ba8e83ef38 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:02.583083 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c9a12a0e-eca4-41e4-9833-04ba8e83ef38 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:02.704309 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c9a12a0e-eca4-41e4-9833-04ba8e83ef38 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:02.711728 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c9a12a0e-eca4-41e4-9833-04ba8e83ef38 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1522 microversion: 2.1 time: 0.141544 Oct 29 01:16:02.712282 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 283/591] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:16:02 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1522 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:02.728637 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-8330b68f-417f-42c8-b035-6a2a79d80c40 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:02.729244 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-8330b68f-417f-42c8-b035-6a2a79d80c40 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:02.735773 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8330b68f-417f-42c8-b035-6a2a79d80c40 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:02.736176 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8330b68f-417f-42c8-b035-6a2a79d80c40 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:02.736938 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8330b68f-417f-42c8-b035-6a2a79d80c40 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:02.737367 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8330b68f-417f-42c8-b035-6a2a79d80c40 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:02.861749 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-8330b68f-417f-42c8-b035-6a2a79d80c40 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:02.871030 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-8330b68f-417f-42c8-b035-6a2a79d80c40 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:02.872627 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-8330b68f-417f-42c8-b035-6a2a79d80c40 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:02.873791 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-8330b68f-417f-42c8-b035-6a2a79d80c40 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1808 microversion: 2.20 time: 0.148803 Oct 29 01:16:02.874339 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 309/592] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:16:02 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1808 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:03.000629 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:16:03.000864 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: Fri Oct 29 01:16:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 29 01:16:03.727610 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ae65bde8-7bed-4aea-a249-7353b1792cb5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:03.728216 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ae65bde8-7bed-4aea-a249-7353b1792cb5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:03.733978 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ae65bde8-7bed-4aea-a249-7353b1792cb5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:03.734489 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ae65bde8-7bed-4aea-a249-7353b1792cb5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:03.735247 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ae65bde8-7bed-4aea-a249-7353b1792cb5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:03.735683 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ae65bde8-7bed-4aea-a249-7353b1792cb5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:03.857401 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-ae65bde8-7bed-4aea-a249-7353b1792cb5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:03.864906 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ae65bde8-7bed-4aea-a249-7353b1792cb5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1522 microversion: 2.1 time: 0.141093 Oct 29 01:16:03.865481 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 284/593] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:16:03 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1522 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:03.892002 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-93e96380-dd76-400d-90d7-0797b223de9e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:03.892605 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-93e96380-dd76-400d-90d7-0797b223de9e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:03.899561 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-93e96380-dd76-400d-90d7-0797b223de9e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:03.900010 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-93e96380-dd76-400d-90d7-0797b223de9e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:03.900771 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-93e96380-dd76-400d-90d7-0797b223de9e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:03.901208 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-93e96380-dd76-400d-90d7-0797b223de9e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:04.025247 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-93e96380-dd76-400d-90d7-0797b223de9e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:04.033697 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-93e96380-dd76-400d-90d7-0797b223de9e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:04.035227 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-93e96380-dd76-400d-90d7-0797b223de9e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:04.036868 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-93e96380-dd76-400d-90d7-0797b223de9e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1808 microversion: 2.20 time: 0.148056 Oct 29 01:16:04.036984 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 310/594] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:16:03 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1808 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:04.881906 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-7acdc16c-22c4-4b3e-b9fa-42a6ffca4187 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:04.882647 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-7acdc16c-22c4-4b3e-b9fa-42a6ffca4187 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:04.889757 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7acdc16c-22c4-4b3e-b9fa-42a6ffca4187 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:04.893022 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7acdc16c-22c4-4b3e-b9fa-42a6ffca4187 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:04.893022 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7acdc16c-22c4-4b3e-b9fa-42a6ffca4187 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:04.893022 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7acdc16c-22c4-4b3e-b9fa-42a6ffca4187 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:05.055938 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d6784d0c-0378-4098-a449-aeec536251b3 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:05.057498 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d6784d0c-0378-4098-a449-aeec536251b3 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:05.063038 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-7acdc16c-22c4-4b3e-b9fa-42a6ffca4187 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:05.073305 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d6784d0c-0378-4098-a449-aeec536251b3 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:05.074204 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d6784d0c-0378-4098-a449-aeec536251b3 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:05.075260 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d6784d0c-0378-4098-a449-aeec536251b3 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:05.075772 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d6784d0c-0378-4098-a449-aeec536251b3 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:05.079322 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-7acdc16c-22c4-4b3e-b9fa-42a6ffca4187 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1522 microversion: 2.1 time: 0.201962 Oct 29 01:16:05.079897 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 285/595] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:16:04 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:05.204983 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-d6784d0c-0378-4098-a449-aeec536251b3 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:05.214071 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-d6784d0c-0378-4098-a449-aeec536251b3 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:05.215611 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-d6784d0c-0378-4098-a449-aeec536251b3 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:05.216754 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d6784d0c-0378-4098-a449-aeec536251b3 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1808 microversion: 2.20 time: 0.166877 Oct 29 01:16:05.217301 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 311/596] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:16:05 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:06.099219 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-0360376a-3b4a-4b0b-bef5-9d5606da15b8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:06.100439 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-0360376a-3b4a-4b0b-bef5-9d5606da15b8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:06.107573 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0360376a-3b4a-4b0b-bef5-9d5606da15b8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:06.108240 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0360376a-3b4a-4b0b-bef5-9d5606da15b8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:06.109369 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0360376a-3b4a-4b0b-bef5-9d5606da15b8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:06.110528 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0360376a-3b4a-4b0b-bef5-9d5606da15b8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:06.233555 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-fd186d86-ec94-462d-b491-000d613bc4be tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:06.234184 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-fd186d86-ec94-462d-b491-000d613bc4be tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:06.241386 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fd186d86-ec94-462d-b491-000d613bc4be tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:06.241840 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fd186d86-ec94-462d-b491-000d613bc4be tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:06.242647 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fd186d86-ec94-462d-b491-000d613bc4be tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:06.243086 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fd186d86-ec94-462d-b491-000d613bc4be tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:06.246584 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-0360376a-3b4a-4b0b-bef5-9d5606da15b8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:06.254760 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-0360376a-3b4a-4b0b-bef5-9d5606da15b8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1522 microversion: 2.1 time: 0.161309 Oct 29 01:16:06.255322 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 286/597] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:16:06 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:06.372879 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-fd186d86-ec94-462d-b491-000d613bc4be tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:06.381029 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-fd186d86-ec94-462d-b491-000d613bc4be tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:06.382552 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-fd186d86-ec94-462d-b491-000d613bc4be tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:06.383696 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-fd186d86-ec94-462d-b491-000d613bc4be tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1808 microversion: 2.20 time: 0.153961 Oct 29 01:16:06.384246 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 312/598] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:16:06 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:16:07.279142 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-dce4d163-8346-4997-90d1-a20380731697 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:07.279843 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-dce4d163-8346-4997-90d1-a20380731697 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:07.287897 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dce4d163-8346-4997-90d1-a20380731697 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:07.288217 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dce4d163-8346-4997-90d1-a20380731697 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:07.289256 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dce4d163-8346-4997-90d1-a20380731697 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:07.289731 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dce4d163-8346-4997-90d1-a20380731697 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:07.401415 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2e9291a2-9dd0-4356-9278-8478d7a66bf8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:07.402224 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2e9291a2-9dd0-4356-9278-8478d7a66bf8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:07.408699 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2e9291a2-9dd0-4356-9278-8478d7a66bf8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:07.409143 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2e9291a2-9dd0-4356-9278-8478d7a66bf8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:07.410427 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2e9291a2-9dd0-4356-9278-8478d7a66bf8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:07.410859 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2e9291a2-9dd0-4356-9278-8478d7a66bf8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:07.413912 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-dce4d163-8346-4997-90d1-a20380731697 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:07.421296 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-dce4d163-8346-4997-90d1-a20380731697 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1522 microversion: 2.1 time: 0.153570 Oct 29 01:16:07.421881 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 287/599] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:16:07 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:07.531926 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-2e9291a2-9dd0-4356-9278-8478d7a66bf8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:07.539999 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-2e9291a2-9dd0-4356-9278-8478d7a66bf8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:07.541544 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-2e9291a2-9dd0-4356-9278-8478d7a66bf8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:07.542771 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2e9291a2-9dd0-4356-9278-8478d7a66bf8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1808 microversion: 2.20 time: 0.144997 Oct 29 01:16:07.543315 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 313/600] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:16:07 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1808 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:16:07.927135 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [req-57d816ab-9f2f-42dc-82f4-e4943dbac4c9 req-0b47646d-d7c5-4cbf-8a90-085c97288bc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27a73464-dcac-4be6-a392-58d40a0296a8", "name": "network-vif-plugged", "status": "completed", "tag": "f3a5c6a4-eba2-4bfd-91f6-59386b7c88e8"}]} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:07.928757 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:16:07.928757 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: warnings.warn(msg) Oct 29 01:16:07.937070 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-57d816ab-9f2f-42dc-82f4-e4943dbac4c9 req-0b47646d-d7c5-4cbf-8a90-085c97288bc2 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:07.937514 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-57d816ab-9f2f-42dc-82f4-e4943dbac4c9 req-0b47646d-d7c5-4cbf-8a90-085c97288bc2 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:07.949768 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.compute.server_external_events [req-57d816ab-9f2f-42dc-82f4-e4943dbac4c9 req-0b47646d-d7c5-4cbf-8a90-085c97288bc2 service nova] Creating event network-vif-plugged:f3a5c6a4-eba2-4bfd-91f6-59386b7c88e8 for instance 27a73464-dcac-4be6-a392-58d40a0296a8 on hv-cinder-81558 Oct 29 01:16:07.957862 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [req-57d816ab-9f2f-42dc-82f4-e4943dbac4c9 req-0b47646d-d7c5-4cbf-8a90-085c97288bc2 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033951 Oct 29 01:16:07.958256 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 288/601] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:16:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:16:08.438654 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-cb007312-89d3-4670-8628-eb80cf8ee556 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:08.439268 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-cb007312-89d3-4670-8628-eb80cf8ee556 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:08.447625 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cb007312-89d3-4670-8628-eb80cf8ee556 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:08.448078 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cb007312-89d3-4670-8628-eb80cf8ee556 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:08.448854 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cb007312-89d3-4670-8628-eb80cf8ee556 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:08.449290 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cb007312-89d3-4670-8628-eb80cf8ee556 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:08.562889 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a86ca634-466c-4e1a-b69a-ab13ee6fb79e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:08.563596 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a86ca634-466c-4e1a-b69a-ab13ee6fb79e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:08.571554 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a86ca634-466c-4e1a-b69a-ab13ee6fb79e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:08.572098 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a86ca634-466c-4e1a-b69a-ab13ee6fb79e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:08.572960 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a86ca634-466c-4e1a-b69a-ab13ee6fb79e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:08.573469 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a86ca634-466c-4e1a-b69a-ab13ee6fb79e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:08.590428 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-cb007312-89d3-4670-8628-eb80cf8ee556 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:08.598977 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-cb007312-89d3-4670-8628-eb80cf8ee556 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1522 microversion: 2.1 time: 0.163904 Oct 29 01:16:08.599786 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 314/602] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:16:08 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:08.708863 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-a86ca634-466c-4e1a-b69a-ab13ee6fb79e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:08.717454 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-a86ca634-466c-4e1a-b69a-ab13ee6fb79e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:08.718974 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-a86ca634-466c-4e1a-b69a-ab13ee6fb79e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:08.720104 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a86ca634-466c-4e1a-b69a-ab13ee6fb79e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1808 microversion: 2.20 time: 0.163242 Oct 29 01:16:08.720672 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 289/603] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:16:08 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:16:09.274836 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-9d7968e9-956a-4f8a-af40-187fabbd9c5c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2389ea62-526e-4af6-9fe9-7c8765d2e6ae", "device": "/dev/sdb"}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:09.276731 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-9d7968e9-956a-4f8a-af40-187fabbd9c5c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 8478f8e3-cdb3-437f-a710-b2230e5b8be7] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:09.282560 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9d7968e9-956a-4f8a-af40-187fabbd9c5c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:09.283014 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9d7968e9-956a-4f8a-af40-187fabbd9c5c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:09.283854 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9d7968e9-956a-4f8a-af40-187fabbd9c5c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:09.284300 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9d7968e9-956a-4f8a-af40-187fabbd9c5c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:09.551425 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-9d7968e9-956a-4f8a-af40-187fabbd9c5c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "POST /compute/v2.1/servers/8478f8e3-cdb3-437f-a710-b2230e5b8be7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280216 Oct 29 01:16:09.552326 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 315/604] 10.222.0.90 () {60 vars in 1322 bytes} [Fri Oct 29 01:16:09 2021] POST /compute/v2.1/servers/8478f8e3-cdb3-437f-a710-b2230e5b8be7/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:16:09.617544 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-fdd5bfaf-4f08-4daf-aa60-1cabe28978d3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:09.618160 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-fdd5bfaf-4f08-4daf-aa60-1cabe28978d3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:09.624511 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fdd5bfaf-4f08-4daf-aa60-1cabe28978d3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:09.624958 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fdd5bfaf-4f08-4daf-aa60-1cabe28978d3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:09.626243 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fdd5bfaf-4f08-4daf-aa60-1cabe28978d3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:09.626973 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fdd5bfaf-4f08-4daf-aa60-1cabe28978d3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:09.740989 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-0bc289cd-58c7-4761-9560-920d176eee87 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:09.742117 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-0bc289cd-58c7-4761-9560-920d176eee87 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:09.749943 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0bc289cd-58c7-4761-9560-920d176eee87 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:09.750708 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0bc289cd-58c7-4761-9560-920d176eee87 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:09.751838 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0bc289cd-58c7-4761-9560-920d176eee87 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:09.752735 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0bc289cd-58c7-4761-9560-920d176eee87 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:09.817599 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-fdd5bfaf-4f08-4daf-aa60-1cabe28978d3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:09.827168 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-fdd5bfaf-4f08-4daf-aa60-1cabe28978d3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1522 microversion: 2.1 time: 0.213080 Oct 29 01:16:09.828031 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 290/605] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:16:09 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:09.916906 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-0bc289cd-58c7-4761-9560-920d176eee87 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:09.925795 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-0bc289cd-58c7-4761-9560-920d176eee87 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:09.927328 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-0bc289cd-58c7-4761-9560-920d176eee87 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:09.928484 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-0bc289cd-58c7-4761-9560-920d176eee87 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1808 microversion: 2.20 time: 0.193450 Oct 29 01:16:09.929381 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 316/606] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:16:09 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1808 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:10.844490 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-7785ca95-dae3-4840-ab22-06bfe611a5ca tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:10.845340 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-7785ca95-dae3-4840-ab22-06bfe611a5ca tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:10.854109 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7785ca95-dae3-4840-ab22-06bfe611a5ca tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:10.854781 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7785ca95-dae3-4840-ab22-06bfe611a5ca tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:10.855835 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7785ca95-dae3-4840-ab22-06bfe611a5ca tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:10.856262 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7785ca95-dae3-4840-ab22-06bfe611a5ca tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:10.948891 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-8c5f41d3-6ed2-4f1f-a64d-19fb2b69b250 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:10.949689 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-8c5f41d3-6ed2-4f1f-a64d-19fb2b69b250 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:10.959507 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8c5f41d3-6ed2-4f1f-a64d-19fb2b69b250 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:10.960159 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8c5f41d3-6ed2-4f1f-a64d-19fb2b69b250 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:10.961091 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8c5f41d3-6ed2-4f1f-a64d-19fb2b69b250 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:10.961680 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8c5f41d3-6ed2-4f1f-a64d-19fb2b69b250 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:11.059541 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-7785ca95-dae3-4840-ab22-06bfe611a5ca tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:11.077628 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-7785ca95-dae3-4840-ab22-06bfe611a5ca tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1522 microversion: 2.1 time: 0.236992 Oct 29 01:16:11.078455 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 291/607] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:16:10 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:11.136066 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-8c5f41d3-6ed2-4f1f-a64d-19fb2b69b250 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:11.146254 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-8c5f41d3-6ed2-4f1f-a64d-19fb2b69b250 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:11.148031 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-8c5f41d3-6ed2-4f1f-a64d-19fb2b69b250 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:11.149404 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-8c5f41d3-6ed2-4f1f-a64d-19fb2b69b250 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1808 microversion: 2.20 time: 0.206077 Oct 29 01:16:11.150584 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 317/608] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:16:10 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1808 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:16:12.093444 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-424bee9b-3ee2-4296-9312-9f93c6d8eb88 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:12.094137 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-424bee9b-3ee2-4296-9312-9f93c6d8eb88 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:12.100340 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-424bee9b-3ee2-4296-9312-9f93c6d8eb88 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:12.100790 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-424bee9b-3ee2-4296-9312-9f93c6d8eb88 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:12.101549 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-424bee9b-3ee2-4296-9312-9f93c6d8eb88 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:12.102146 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-424bee9b-3ee2-4296-9312-9f93c6d8eb88 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:12.168863 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-906d29a7-5056-493f-8828-5063abc9e6aa tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:12.169445 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-906d29a7-5056-493f-8828-5063abc9e6aa tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:12.176498 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-906d29a7-5056-493f-8828-5063abc9e6aa tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:12.176937 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-906d29a7-5056-493f-8828-5063abc9e6aa tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:12.177930 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-906d29a7-5056-493f-8828-5063abc9e6aa tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:12.178575 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-906d29a7-5056-493f-8828-5063abc9e6aa tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:12.236375 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-424bee9b-3ee2-4296-9312-9f93c6d8eb88 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:12.244706 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-424bee9b-3ee2-4296-9312-9f93c6d8eb88 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1522 microversion: 2.1 time: 0.154936 Oct 29 01:16:12.245272 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 292/609] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:16:12 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:12.313171 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-906d29a7-5056-493f-8828-5063abc9e6aa tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:12.323152 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-906d29a7-5056-493f-8828-5063abc9e6aa tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:12.324644 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-906d29a7-5056-493f-8828-5063abc9e6aa tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:12.325902 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-906d29a7-5056-493f-8828-5063abc9e6aa tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1795 microversion: 2.20 time: 0.160729 Oct 29 01:16:12.326475 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 318/610] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:16:12 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1795 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:13.262807 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-811eec2f-8ff0-4922-af36-666e04b59f9e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:13.264030 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-811eec2f-8ff0-4922-af36-666e04b59f9e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:13.270678 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-811eec2f-8ff0-4922-af36-666e04b59f9e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:13.271259 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-811eec2f-8ff0-4922-af36-666e04b59f9e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:13.272092 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-811eec2f-8ff0-4922-af36-666e04b59f9e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:13.272592 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-811eec2f-8ff0-4922-af36-666e04b59f9e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:13.401650 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-811eec2f-8ff0-4922-af36-666e04b59f9e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:13.410034 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-811eec2f-8ff0-4922-af36-666e04b59f9e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1522 microversion: 2.1 time: 0.150668 Oct 29 01:16:13.410636 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 293/611] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:16:13 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:14.428873 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-b4fdaf4f-4e73-4769-a3ea-eb05e5077c6a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:14.429506 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-b4fdaf4f-4e73-4769-a3ea-eb05e5077c6a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:14.436289 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b4fdaf4f-4e73-4769-a3ea-eb05e5077c6a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:14.436796 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b4fdaf4f-4e73-4769-a3ea-eb05e5077c6a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:14.437662 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b4fdaf4f-4e73-4769-a3ea-eb05e5077c6a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:14.438309 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b4fdaf4f-4e73-4769-a3ea-eb05e5077c6a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:14.585016 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-b4fdaf4f-4e73-4769-a3ea-eb05e5077c6a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:14.593090 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-b4fdaf4f-4e73-4769-a3ea-eb05e5077c6a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1522 microversion: 2.1 time: 0.170271 Oct 29 01:16:14.593871 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 319/612] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:16:14 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:15.610296 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c8a40f0e-0a62-4e70-8e72-b9a7f3bc317e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:15.611034 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c8a40f0e-0a62-4e70-8e72-b9a7f3bc317e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:15.617478 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c8a40f0e-0a62-4e70-8e72-b9a7f3bc317e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:15.617917 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c8a40f0e-0a62-4e70-8e72-b9a7f3bc317e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:15.618694 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c8a40f0e-0a62-4e70-8e72-b9a7f3bc317e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:15.619124 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c8a40f0e-0a62-4e70-8e72-b9a7f3bc317e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:15.746170 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c8a40f0e-0a62-4e70-8e72-b9a7f3bc317e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:15.754939 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c8a40f0e-0a62-4e70-8e72-b9a7f3bc317e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1522 microversion: 2.1 time: 0.148323 Oct 29 01:16:15.755508 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 294/613] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:16:15 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:16.771806 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-3c4aa7af-72fc-4d6f-bc5a-01bdf07c7b8a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:16.773424 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-3c4aa7af-72fc-4d6f-bc5a-01bdf07c7b8a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:16.786801 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3c4aa7af-72fc-4d6f-bc5a-01bdf07c7b8a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:16.787469 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3c4aa7af-72fc-4d6f-bc5a-01bdf07c7b8a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:16.788329 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3c4aa7af-72fc-4d6f-bc5a-01bdf07c7b8a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:16.788894 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3c4aa7af-72fc-4d6f-bc5a-01bdf07c7b8a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:16.930549 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-3c4aa7af-72fc-4d6f-bc5a-01bdf07c7b8a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:16.938285 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-3c4aa7af-72fc-4d6f-bc5a-01bdf07c7b8a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1522 microversion: 2.1 time: 0.170692 Oct 29 01:16:16.938882 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 320/614] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:16:16 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:17.956748 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-bbe0d850-a6c4-4e79-a17a-ae5efc5f2959 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:17.957655 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-bbe0d850-a6c4-4e79-a17a-ae5efc5f2959 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:17.967313 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bbe0d850-a6c4-4e79-a17a-ae5efc5f2959 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:17.967765 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bbe0d850-a6c4-4e79-a17a-ae5efc5f2959 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:17.968545 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bbe0d850-a6c4-4e79-a17a-ae5efc5f2959 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:17.968978 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bbe0d850-a6c4-4e79-a17a-ae5efc5f2959 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:18.105156 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-bbe0d850-a6c4-4e79-a17a-ae5efc5f2959 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:18.115911 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-bbe0d850-a6c4-4e79-a17a-ae5efc5f2959 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1502 microversion: 2.1 time: 0.163493 Oct 29 01:16:18.116586 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 295/615] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:16:17 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1502 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:18.133584 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-201555bf-d60e-4442-a790-719888206fd5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "970cfbdd-4b4c-4ed4-82b8-c7207d4c1888"}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:18.135392 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-201555bf-d60e-4442-a790-719888206fd5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:18.144000 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-201555bf-d60e-4442-a790-719888206fd5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:18.145151 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-201555bf-d60e-4442-a790-719888206fd5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:18.146232 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-201555bf-d60e-4442-a790-719888206fd5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:18.146676 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-201555bf-d60e-4442-a790-719888206fd5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:18.171376 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.wsgi [None req-201555bf-d60e-4442-a790-719888206fd5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] HTTP exception thrown: Cannot 'attach_volume' instance 0ff6277c-b59e-467c-82d4-631046fb03d9 while it is in vm_state rescued Oct 29 01:16:18.172245 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-201555bf-d60e-4442-a790-719888206fd5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Returning 409 to user: Cannot 'attach_volume' instance 0ff6277c-b59e-467c-82d4-631046fb03d9 while it is in vm_state rescued {{(pid=115748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:16:18.173355 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-201555bf-d60e-4442-a790-719888206fd5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "POST /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044071 Oct 29 01:16:18.173983 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 321/616] 10.222.0.90 () {60 vars in 1322 bytes} [Fri Oct 29 01:16:18 2021] POST /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 152 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:16:18.182655 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-3b054eb3-394e-4d5d-9729-dd80a597fde3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:18.183284 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-3b054eb3-394e-4d5d-9729-dd80a597fde3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:18.189388 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3b054eb3-394e-4d5d-9729-dd80a597fde3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:18.190598 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3b054eb3-394e-4d5d-9729-dd80a597fde3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:18.191412 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3b054eb3-394e-4d5d-9729-dd80a597fde3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:18.191878 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3b054eb3-394e-4d5d-9729-dd80a597fde3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:18.281570 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-3b054eb3-394e-4d5d-9729-dd80a597fde3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "POST /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/action" status: 202 len: 0 microversion: 2.1 time: 0.102929 Oct 29 01:16:18.282199 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 296/617] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:16:18 2021] POST /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:16:18.291672 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-ed474625-8847-4eeb-a771-32bb1bee8ebd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:18.292020 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-ed474625-8847-4eeb-a771-32bb1bee8ebd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:18.302770 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ed474625-8847-4eeb-a771-32bb1bee8ebd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:18.303283 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ed474625-8847-4eeb-a771-32bb1bee8ebd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:18.305949 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ed474625-8847-4eeb-a771-32bb1bee8ebd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:18.306542 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ed474625-8847-4eeb-a771-32bb1bee8ebd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:18.441731 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-ed474625-8847-4eeb-a771-32bb1bee8ebd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:18.450095 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-ed474625-8847-4eeb-a771-32bb1bee8ebd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1510 microversion: 2.1 time: 0.162596 Oct 29 01:16:18.450912 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 322/618] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:16:18 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:19.469867 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-adb767d2-c9c1-4b3a-8aa7-0d6ec5d82d7f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:19.470613 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-adb767d2-c9c1-4b3a-8aa7-0d6ec5d82d7f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:19.476539 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-adb767d2-c9c1-4b3a-8aa7-0d6ec5d82d7f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:19.476985 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-adb767d2-c9c1-4b3a-8aa7-0d6ec5d82d7f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:19.477743 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-adb767d2-c9c1-4b3a-8aa7-0d6ec5d82d7f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:19.478173 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-adb767d2-c9c1-4b3a-8aa7-0d6ec5d82d7f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:19.600600 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-adb767d2-c9c1-4b3a-8aa7-0d6ec5d82d7f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:19.607903 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-adb767d2-c9c1-4b3a-8aa7-0d6ec5d82d7f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1510 microversion: 2.1 time: 0.142528 Oct 29 01:16:19.608471 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 297/619] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:16:19 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1510 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:20.624840 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-5e9f22f4-4a92-478b-819a-05b8c6f7c131 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:20.625476 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-5e9f22f4-4a92-478b-819a-05b8c6f7c131 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:20.632386 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5e9f22f4-4a92-478b-819a-05b8c6f7c131 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:20.632832 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5e9f22f4-4a92-478b-819a-05b8c6f7c131 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:20.633593 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5e9f22f4-4a92-478b-819a-05b8c6f7c131 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:20.634026 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5e9f22f4-4a92-478b-819a-05b8c6f7c131 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:20.752297 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-5e9f22f4-4a92-478b-819a-05b8c6f7c131 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:20.760071 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-5e9f22f4-4a92-478b-819a-05b8c6f7c131 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1510 microversion: 2.1 time: 0.138922 Oct 29 01:16:20.760626 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 323/620] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:16:20 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1510 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:21.776788 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-0f658cbc-60e5-42f1-9fa5-9c8c6ea21ee8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:21.777388 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-0f658cbc-60e5-42f1-9fa5-9c8c6ea21ee8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:21.784018 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0f658cbc-60e5-42f1-9fa5-9c8c6ea21ee8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:21.784462 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0f658cbc-60e5-42f1-9fa5-9c8c6ea21ee8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:21.785212 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0f658cbc-60e5-42f1-9fa5-9c8c6ea21ee8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:21.785665 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0f658cbc-60e5-42f1-9fa5-9c8c6ea21ee8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:21.903600 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-0f658cbc-60e5-42f1-9fa5-9c8c6ea21ee8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:21.911361 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-0f658cbc-60e5-42f1-9fa5-9c8c6ea21ee8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1510 microversion: 2.1 time: 0.138222 Oct 29 01:16:21.911924 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 298/621] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:16:21 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1510 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:22.927907 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2d7fb395-817b-498d-aa7f-4ec1affecd3b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:22.928452 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2d7fb395-817b-498d-aa7f-4ec1affecd3b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:22.934657 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2d7fb395-817b-498d-aa7f-4ec1affecd3b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:22.935108 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2d7fb395-817b-498d-aa7f-4ec1affecd3b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:22.935867 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2d7fb395-817b-498d-aa7f-4ec1affecd3b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:22.936294 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2d7fb395-817b-498d-aa7f-4ec1affecd3b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:23.057996 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-2d7fb395-817b-498d-aa7f-4ec1affecd3b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:23.065283 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2d7fb395-817b-498d-aa7f-4ec1affecd3b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1510 microversion: 2.1 time: 0.141575 Oct 29 01:16:23.065843 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 324/622] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:16:22 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1510 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:24.082365 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-7ddc117c-e57b-4e0c-9e7f-9d61bd2971f3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:24.082940 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-7ddc117c-e57b-4e0c-9e7f-9d61bd2971f3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:24.089959 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7ddc117c-e57b-4e0c-9e7f-9d61bd2971f3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:24.090434 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7ddc117c-e57b-4e0c-9e7f-9d61bd2971f3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:24.091222 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7ddc117c-e57b-4e0c-9e7f-9d61bd2971f3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:24.091652 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7ddc117c-e57b-4e0c-9e7f-9d61bd2971f3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:24.241142 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-7ddc117c-e57b-4e0c-9e7f-9d61bd2971f3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:24.250674 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-7ddc117c-e57b-4e0c-9e7f-9d61bd2971f3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1510 microversion: 2.1 time: 0.173482 Oct 29 01:16:24.252215 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 299/623] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:16:24 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1510 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:25.267867 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-dd41dff4-775b-4cc9-9bbc-d4d565e9caab tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:25.269164 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-dd41dff4-775b-4cc9-9bbc-d4d565e9caab tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:25.275170 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dd41dff4-775b-4cc9-9bbc-d4d565e9caab tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:25.275862 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dd41dff4-775b-4cc9-9bbc-d4d565e9caab tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:25.276634 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dd41dff4-775b-4cc9-9bbc-d4d565e9caab tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:25.277065 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dd41dff4-775b-4cc9-9bbc-d4d565e9caab tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:25.532682 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-dd41dff4-775b-4cc9-9bbc-d4d565e9caab tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:25.539977 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-dd41dff4-775b-4cc9-9bbc-d4d565e9caab tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1510 microversion: 2.1 time: 0.276216 Oct 29 01:16:25.540748 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 325/624] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:16:25 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1510 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:26.557111 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-573028ac-9116-4099-b5be-301ba0bf9f15 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:26.557710 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-573028ac-9116-4099-b5be-301ba0bf9f15 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:26.565880 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-573028ac-9116-4099-b5be-301ba0bf9f15 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:26.566621 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-573028ac-9116-4099-b5be-301ba0bf9f15 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:26.567682 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-573028ac-9116-4099-b5be-301ba0bf9f15 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:26.568281 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-573028ac-9116-4099-b5be-301ba0bf9f15 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:26.789701 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-573028ac-9116-4099-b5be-301ba0bf9f15 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:26.802088 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-573028ac-9116-4099-b5be-301ba0bf9f15 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1510 microversion: 2.1 time: 0.247527 Oct 29 01:16:26.802697 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 300/625] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:16:26 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1510 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:27.820103 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-0384b829-d20e-4905-81cc-e34408b170c7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:27.821421 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-0384b829-d20e-4905-81cc-e34408b170c7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:27.827912 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0384b829-d20e-4905-81cc-e34408b170c7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:27.828691 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0384b829-d20e-4905-81cc-e34408b170c7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:27.829509 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0384b829-d20e-4905-81cc-e34408b170c7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:27.829942 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0384b829-d20e-4905-81cc-e34408b170c7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:28.082784 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-0384b829-d20e-4905-81cc-e34408b170c7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:28.090619 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-0384b829-d20e-4905-81cc-e34408b170c7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1510 microversion: 2.1 time: 0.275152 Oct 29 01:16:28.100939 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 326/626] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:16:27 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1510 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:29.109900 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9d67fd4d-34f4-42ca-be5d-cbd3ddc09a1d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:29.110301 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9d67fd4d-34f4-42ca-be5d-cbd3ddc09a1d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:29.124471 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9d67fd4d-34f4-42ca-be5d-cbd3ddc09a1d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:29.124915 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9d67fd4d-34f4-42ca-be5d-cbd3ddc09a1d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:29.125714 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9d67fd4d-34f4-42ca-be5d-cbd3ddc09a1d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:29.126141 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9d67fd4d-34f4-42ca-be5d-cbd3ddc09a1d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:29.294856 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-9d67fd4d-34f4-42ca-be5d-cbd3ddc09a1d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:29.306113 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9d67fd4d-34f4-42ca-be5d-cbd3ddc09a1d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1510 microversion: 2.1 time: 0.201207 Oct 29 01:16:29.306782 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 301/627] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:16:29 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1510 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:30.322507 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-da28406a-8d15-4506-ade0-89bf1acf551a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:30.324986 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-da28406a-8d15-4506-ade0-89bf1acf551a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:30.332935 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-da28406a-8d15-4506-ade0-89bf1acf551a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:30.333643 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-da28406a-8d15-4506-ade0-89bf1acf551a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:30.334771 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-da28406a-8d15-4506-ade0-89bf1acf551a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:30.335200 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-da28406a-8d15-4506-ade0-89bf1acf551a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:30.590282 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-da28406a-8d15-4506-ade0-89bf1acf551a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:30.625003 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-da28406a-8d15-4506-ade0-89bf1acf551a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1516 microversion: 2.1 time: 0.306108 Oct 29 01:16:30.628088 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 327/628] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:16:30 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1516 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:32.221367 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-1ca500d6-cbe4-4ce3-8484-4b2edfad97b6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:32.232562 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-1ca500d6-cbe4-4ce3-8484-4b2edfad97b6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:32.245256 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1ca500d6-cbe4-4ce3-8484-4b2edfad97b6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:32.248485 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1ca500d6-cbe4-4ce3-8484-4b2edfad97b6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:32.252050 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1ca500d6-cbe4-4ce3-8484-4b2edfad97b6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:32.252754 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1ca500d6-cbe4-4ce3-8484-4b2edfad97b6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:32.613996 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-1ca500d6-cbe4-4ce3-8484-4b2edfad97b6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:32.627083 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-1ca500d6-cbe4-4ce3-8484-4b2edfad97b6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1516 microversion: 2.1 time: 0.409854 Oct 29 01:16:32.629790 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 302/629] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:16:32 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1516 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:32.646344 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-64c70716-ea3b-4d58-ac3f-5a8345129165 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23c26adc-b125-45d9-b8ba-8febe3ea4192"}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:32.650735 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-64c70716-ea3b-4d58-ac3f-5a8345129165 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:32.670954 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-64c70716-ea3b-4d58-ac3f-5a8345129165 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:32.680810 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-64c70716-ea3b-4d58-ac3f-5a8345129165 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:32.686117 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-64c70716-ea3b-4d58-ac3f-5a8345129165 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:32.687148 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-64c70716-ea3b-4d58-ac3f-5a8345129165 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:33.063106 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-64c70716-ea3b-4d58-ac3f-5a8345129165 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "POST /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.421690 Oct 29 01:16:33.078704 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 328/630] 10.222.0.90 () {60 vars in 1322 bytes} [Fri Oct 29 01:16:32 2021] POST /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 194 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:16:34.941835 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9b154fff-3933-4a25-85ad-5b3238b8e14b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:34.943058 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9b154fff-3933-4a25-85ad-5b3238b8e14b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 8478f8e3-cdb3-437f-a710-b2230e5b8be7] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:34.951989 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9b154fff-3933-4a25-85ad-5b3238b8e14b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:34.952548 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9b154fff-3933-4a25-85ad-5b3238b8e14b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:34.953607 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9b154fff-3933-4a25-85ad-5b3238b8e14b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:34.955299 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9b154fff-3933-4a25-85ad-5b3238b8e14b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:35.061244 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.objects.instance [None req-9b154fff-3933-4a25-85ad-5b3238b8e14b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lazy-loading 'services' on Instance uuid 8478f8e3-cdb3-437f-a710-b2230e5b8be7 {{(pid=115747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:16:35.178915 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9b154fff-3933-4a25-85ad-5b3238b8e14b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "DELETE /compute/v2.1/servers/8478f8e3-cdb3-437f-a710-b2230e5b8be7/os-volume_attachments/2389ea62-526e-4af6-9fe9-7c8765d2e6ae" status: 202 len: 0 microversion: 2.1 time: 0.241380 Oct 29 01:16:35.180096 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 303/631] 10.222.0.90 () {58 vars in 1415 bytes} [Fri Oct 29 01:16:34 2021] DELETE /compute/v2.1/servers/8478f8e3-cdb3-437f-a710-b2230e5b8be7/os-volume_attachments/2389ea62-526e-4af6-9fe9-7c8765d2e6ae => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:16:35.770958 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-3fe65c16-1dcc-4c0b-9944-2c7472dfd3e1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Action: 'create', calling method: .version_select at 0x7f60293a6f70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1685738325"}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:35.790989 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.quota [None req-3fe65c16-1dcc-4c0b-9944-2c7472dfd3e1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Getting quotas for project ccd9f9783640477abd2d011a323a6f06. Resources: {'key_pairs'} {{(pid=115748) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:16:35.796077 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.quota [None req-3fe65c16-1dcc-4c0b-9944-2c7472dfd3e1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Getting quotas for user fe886b061dd447649b65fc919fb6dd87 and project ccd9f9783640477abd2d011a323a6f06. Resources: {'key_pairs'} {{(pid=115748) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:16:36.132316 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.quota [None req-3fe65c16-1dcc-4c0b-9944-2c7472dfd3e1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Getting quotas for project ccd9f9783640477abd2d011a323a6f06. Resources: {'key_pairs'} {{(pid=115748) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:16:36.136025 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.quota [None req-3fe65c16-1dcc-4c0b-9944-2c7472dfd3e1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Getting quotas for user fe886b061dd447649b65fc919fb6dd87 and project ccd9f9783640477abd2d011a323a6f06. Resources: {'key_pairs'} {{(pid=115748) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:16:36.148771 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-3fe65c16-1dcc-4c0b-9944-2c7472dfd3e1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.577096 Oct 29 01:16:36.149366 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 329/632] 10.222.0.90 () {60 vars in 1157 bytes} [Fri Oct 29 01:16:35 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:16:47.014674 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-6abf4834-60c3-4114-965e-1a9bed68303d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:47.016339 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-6abf4834-60c3-4114-965e-1a9bed68303d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:47.022758 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6abf4834-60c3-4114-965e-1a9bed68303d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:47.023227 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6abf4834-60c3-4114-965e-1a9bed68303d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:47.024192 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6abf4834-60c3-4114-965e-1a9bed68303d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:47.024622 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6abf4834-60c3-4114-965e-1a9bed68303d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:47.052777 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.objects.instance [None req-6abf4834-60c3-4114-965e-1a9bed68303d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lazy-loading 'flavor' on Instance uuid 0ff6277c-b59e-467c-82d4-631046fb03d9 {{(pid=115747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:16:47.221917 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-6abf4834-60c3-4114-965e-1a9bed68303d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "POST /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/action" status: 200 len: 32 microversion: 2.1 time: 0.211931 Oct 29 01:16:47.222726 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 304/633] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:16:47 2021] POST /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/action => generated 32 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:16:47.232054 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-5c5c5268-e84a-43c5-896d-3b34407403ef tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:47.232810 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-5c5c5268-e84a-43c5-896d-3b34407403ef tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:47.240584 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5c5c5268-e84a-43c5-896d-3b34407403ef tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:47.241346 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5c5c5268-e84a-43c5-896d-3b34407403ef tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:47.242343 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5c5c5268-e84a-43c5-896d-3b34407403ef tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:47.242783 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5c5c5268-e84a-43c5-896d-3b34407403ef tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:47.376813 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-5c5c5268-e84a-43c5-896d-3b34407403ef tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:47.384470 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-5c5c5268-e84a-43c5-896d-3b34407403ef tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1568 microversion: 2.1 time: 0.156826 Oct 29 01:16:47.385031 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 330/634] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:16:47 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:16:47.928437 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-e2e92ffc-dab9-4908-a5ac-5d1abfde0017 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:47.929079 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-e2e92ffc-dab9-4908-a5ac-5d1abfde0017 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 8478f8e3-cdb3-437f-a710-b2230e5b8be7] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:47.935140 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e2e92ffc-dab9-4908-a5ac-5d1abfde0017 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:47.935587 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e2e92ffc-dab9-4908-a5ac-5d1abfde0017 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:47.936351 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e2e92ffc-dab9-4908-a5ac-5d1abfde0017 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:47.936782 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e2e92ffc-dab9-4908-a5ac-5d1abfde0017 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:47.962258 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-e2e92ffc-dab9-4908-a5ac-5d1abfde0017 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 8478f8e3-cdb3-437f-a710-b2230e5b8be7] Going to try to terminate instance {{(pid=115747) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 01:16:48.036241 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-e2e92ffc-dab9-4908-a5ac-5d1abfde0017 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "DELETE /compute/v2.1/servers/8478f8e3-cdb3-437f-a710-b2230e5b8be7" status: 204 len: 0 microversion: 2.1 time: 0.111773 Oct 29 01:16:48.036928 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 305/635] 10.222.0.90 () {58 vars in 1238 bytes} [Fri Oct 29 01:16:47 2021] DELETE /compute/v2.1/servers/8478f8e3-cdb3-437f-a710-b2230e5b8be7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:16:48.047160 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-6e72780d-5e9a-4369-88e9-0c579b9e6bc5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:48.047848 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-6e72780d-5e9a-4369-88e9-0c579b9e6bc5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 8478f8e3-cdb3-437f-a710-b2230e5b8be7] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:48.055596 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6e72780d-5e9a-4369-88e9-0c579b9e6bc5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:48.056594 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6e72780d-5e9a-4369-88e9-0c579b9e6bc5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:48.057627 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6e72780d-5e9a-4369-88e9-0c579b9e6bc5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:48.058323 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6e72780d-5e9a-4369-88e9-0c579b9e6bc5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:48.180729 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-6e72780d-5e9a-4369-88e9-0c579b9e6bc5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:48.188445 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-6e72780d-5e9a-4369-88e9-0c579b9e6bc5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/8478f8e3-cdb3-437f-a710-b2230e5b8be7" status: 200 len: 1513 microversion: 2.1 time: 0.147058 Oct 29 01:16:48.189001 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 331/636] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:16:48 2021] GET /compute/v2.1/servers/8478f8e3-cdb3-437f-a710-b2230e5b8be7 => generated 1513 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:48.402278 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-5497cb9c-9a53-45f4-be8c-e72119ad1e81 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:48.403024 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-5497cb9c-9a53-45f4-be8c-e72119ad1e81 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:48.410722 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5497cb9c-9a53-45f4-be8c-e72119ad1e81 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:48.411195 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5497cb9c-9a53-45f4-be8c-e72119ad1e81 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:48.411985 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5497cb9c-9a53-45f4-be8c-e72119ad1e81 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:48.412418 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5497cb9c-9a53-45f4-be8c-e72119ad1e81 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:48.543833 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-5497cb9c-9a53-45f4-be8c-e72119ad1e81 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:48.551974 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-5497cb9c-9a53-45f4-be8c-e72119ad1e81 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1568 microversion: 2.1 time: 0.153714 Oct 29 01:16:48.552540 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 306/637] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:16:48 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:49.205600 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-658ee88b-abfc-4249-8b25-191fb96b3f8c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:49.206207 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-658ee88b-abfc-4249-8b25-191fb96b3f8c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 8478f8e3-cdb3-437f-a710-b2230e5b8be7] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:49.212525 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-658ee88b-abfc-4249-8b25-191fb96b3f8c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:49.212917 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-658ee88b-abfc-4249-8b25-191fb96b3f8c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:49.213670 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-658ee88b-abfc-4249-8b25-191fb96b3f8c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:49.214103 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-658ee88b-abfc-4249-8b25-191fb96b3f8c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:49.332183 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-658ee88b-abfc-4249-8b25-191fb96b3f8c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:49.339321 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-658ee88b-abfc-4249-8b25-191fb96b3f8c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/8478f8e3-cdb3-437f-a710-b2230e5b8be7" status: 200 len: 1513 microversion: 2.1 time: 0.138157 Oct 29 01:16:49.339883 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 332/638] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:16:49 2021] GET /compute/v2.1/servers/8478f8e3-cdb3-437f-a710-b2230e5b8be7 => generated 1513 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:49.568801 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-044ccd07-009d-4af7-b016-f81ec27616bc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:49.569436 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-044ccd07-009d-4af7-b016-f81ec27616bc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:49.575401 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-044ccd07-009d-4af7-b016-f81ec27616bc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:49.575845 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-044ccd07-009d-4af7-b016-f81ec27616bc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:49.576612 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-044ccd07-009d-4af7-b016-f81ec27616bc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:49.577041 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-044ccd07-009d-4af7-b016-f81ec27616bc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:49.703094 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-044ccd07-009d-4af7-b016-f81ec27616bc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:49.711774 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-044ccd07-009d-4af7-b016-f81ec27616bc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1568 microversion: 2.1 time: 0.146642 Oct 29 01:16:49.712344 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 307/639] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:16:49 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:50.356849 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-380c9ed2-afdd-48ad-b05a-69e1a8cb966e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:50.357448 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-380c9ed2-afdd-48ad-b05a-69e1a8cb966e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 8478f8e3-cdb3-437f-a710-b2230e5b8be7] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:50.364482 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-380c9ed2-afdd-48ad-b05a-69e1a8cb966e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:50.364924 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-380c9ed2-afdd-48ad-b05a-69e1a8cb966e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:50.365678 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-380c9ed2-afdd-48ad-b05a-69e1a8cb966e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:50.366108 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-380c9ed2-afdd-48ad-b05a-69e1a8cb966e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:50.490097 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-380c9ed2-afdd-48ad-b05a-69e1a8cb966e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:50.497334 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-380c9ed2-afdd-48ad-b05a-69e1a8cb966e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/8478f8e3-cdb3-437f-a710-b2230e5b8be7" status: 200 len: 1513 microversion: 2.1 time: 0.144212 Oct 29 01:16:50.497892 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 333/640] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:16:50 2021] GET /compute/v2.1/servers/8478f8e3-cdb3-437f-a710-b2230e5b8be7 => generated 1513 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:50.728689 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-2c7abc33-4a02-462d-8e97-7e7a8b3c9282 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:50.729271 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-2c7abc33-4a02-462d-8e97-7e7a8b3c9282 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:50.735663 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2c7abc33-4a02-462d-8e97-7e7a8b3c9282 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:50.736113 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2c7abc33-4a02-462d-8e97-7e7a8b3c9282 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:50.736914 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2c7abc33-4a02-462d-8e97-7e7a8b3c9282 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:50.737349 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2c7abc33-4a02-462d-8e97-7e7a8b3c9282 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:50.865461 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-2c7abc33-4a02-462d-8e97-7e7a8b3c9282 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:50.875093 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-2c7abc33-4a02-462d-8e97-7e7a8b3c9282 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1568 microversion: 2.1 time: 0.150202 Oct 29 01:16:50.875782 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 308/641] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:16:50 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:51.074174 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [req-8f220539-1ec8-4d39-9cf5-a1d288a11ae4 req-9b716b7c-080c-4f66-b51d-285699ae5733 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8478f8e3-cdb3-437f-a710-b2230e5b8be7", "name": "network-vif-deleted", "tag": "019508e1-f889-428a-9019-9b4e656bdd1c"}]} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:51.076160 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:16:51.076160 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: warnings.warn(msg) Oct 29 01:16:51.086567 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-8f220539-1ec8-4d39-9cf5-a1d288a11ae4 req-9b716b7c-080c-4f66-b51d-285699ae5733 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:51.087040 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-8f220539-1ec8-4d39-9cf5-a1d288a11ae4 req-9b716b7c-080c-4f66-b51d-285699ae5733 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:51.097619 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.compute.server_external_events [req-8f220539-1ec8-4d39-9cf5-a1d288a11ae4 req-9b716b7c-080c-4f66-b51d-285699ae5733 service nova] Creating event network-vif-deleted:019508e1-f889-428a-9019-9b4e656bdd1c for instance 8478f8e3-cdb3-437f-a710-b2230e5b8be7 on hv-cinder-81558 Oct 29 01:16:51.102559 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [req-8f220539-1ec8-4d39-9cf5-a1d288a11ae4 req-9b716b7c-080c-4f66-b51d-285699ae5733 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032254 Oct 29 01:16:51.103147 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 334/642] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:16:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:16:51.514984 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b4219bd1-353a-415e-a327-c12d0dcb8a40 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:51.515590 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b4219bd1-353a-415e-a327-c12d0dcb8a40 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 8478f8e3-cdb3-437f-a710-b2230e5b8be7] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:51.521391 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b4219bd1-353a-415e-a327-c12d0dcb8a40 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:51.521833 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b4219bd1-353a-415e-a327-c12d0dcb8a40 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:51.522610 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b4219bd1-353a-415e-a327-c12d0dcb8a40 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:51.523034 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b4219bd1-353a-415e-a327-c12d0dcb8a40 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:51.552055 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b4219bd1-353a-415e-a327-c12d0dcb8a40 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:51.552493 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b4219bd1-353a-415e-a327-c12d0dcb8a40 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:51.552927 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.objects.instance [None req-b4219bd1-353a-415e-a327-c12d0dcb8a40 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lazy-loading 'fault' on Instance uuid 8478f8e3-cdb3-437f-a710-b2230e5b8be7 {{(pid=115747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:16:51.592201 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-b4219bd1-353a-415e-a327-c12d0dcb8a40 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:51.599801 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b4219bd1-353a-415e-a327-c12d0dcb8a40 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/8478f8e3-cdb3-437f-a710-b2230e5b8be7" status: 200 len: 1308 microversion: 2.1 time: 0.089133 Oct 29 01:16:51.600358 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 309/643] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:16:51 2021] GET /compute/v2.1/servers/8478f8e3-cdb3-437f-a710-b2230e5b8be7 => generated 1308 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:51.893262 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-ed44018e-df2c-46a1-9b0b-d5450f2fc495 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:51.894007 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-ed44018e-df2c-46a1-9b0b-d5450f2fc495 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:51.900329 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ed44018e-df2c-46a1-9b0b-d5450f2fc495 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:51.901145 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ed44018e-df2c-46a1-9b0b-d5450f2fc495 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:51.901916 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ed44018e-df2c-46a1-9b0b-d5450f2fc495 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:51.902343 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ed44018e-df2c-46a1-9b0b-d5450f2fc495 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:52.028033 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-ed44018e-df2c-46a1-9b0b-d5450f2fc495 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:52.037270 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-ed44018e-df2c-46a1-9b0b-d5450f2fc495 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1568 microversion: 2.1 time: 0.149067 Oct 29 01:16:52.037842 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 335/644] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:16:51 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:52.618768 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-24e21dd7-4223-41c1-a4c0-3296eefc80a9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:52.619395 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-24e21dd7-4223-41c1-a4c0-3296eefc80a9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 8478f8e3-cdb3-437f-a710-b2230e5b8be7] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:52.626104 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-24e21dd7-4223-41c1-a4c0-3296eefc80a9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:52.626732 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-24e21dd7-4223-41c1-a4c0-3296eefc80a9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:52.627597 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-24e21dd7-4223-41c1-a4c0-3296eefc80a9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:52.628027 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-24e21dd7-4223-41c1-a4c0-3296eefc80a9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:52.642169 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.wsgi [None req-24e21dd7-4223-41c1-a4c0-3296eefc80a9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] HTTP exception thrown: Instance 8478f8e3-cdb3-437f-a710-b2230e5b8be7 could not be found. Oct 29 01:16:52.642774 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-24e21dd7-4223-41c1-a4c0-3296eefc80a9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Returning 404 to user: Instance 8478f8e3-cdb3-437f-a710-b2230e5b8be7 could not be found. {{(pid=115747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:16:52.644042 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-24e21dd7-4223-41c1-a4c0-3296eefc80a9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/8478f8e3-cdb3-437f-a710-b2230e5b8be7" status: 404 len: 111 microversion: 2.1 time: 0.029035 Oct 29 01:16:52.644558 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 310/645] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:16:52 2021] GET /compute/v2.1/servers/8478f8e3-cdb3-437f-a710-b2230e5b8be7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:16:53.054603 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-18f2e7a0-80d7-472b-8ccc-d7b0a8787596 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:53.055267 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-18f2e7a0-80d7-472b-8ccc-d7b0a8787596 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:53.061435 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-18f2e7a0-80d7-472b-8ccc-d7b0a8787596 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:53.062535 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-18f2e7a0-80d7-472b-8ccc-d7b0a8787596 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:53.063291 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-18f2e7a0-80d7-472b-8ccc-d7b0a8787596 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:53.063722 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-18f2e7a0-80d7-472b-8ccc-d7b0a8787596 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:53.185181 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-18f2e7a0-80d7-472b-8ccc-d7b0a8787596 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:53.192909 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-18f2e7a0-80d7-472b-8ccc-d7b0a8787596 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1568 microversion: 2.1 time: 0.141980 Oct 29 01:16:53.193468 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 336/646] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:16:53 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:54.209699 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-84553af8-5f23-4c8e-a257-390f6e9c22d5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:54.210275 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-84553af8-5f23-4c8e-a257-390f6e9c22d5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:54.216819 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-84553af8-5f23-4c8e-a257-390f6e9c22d5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:54.217265 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-84553af8-5f23-4c8e-a257-390f6e9c22d5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:54.218532 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-84553af8-5f23-4c8e-a257-390f6e9c22d5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:54.218959 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-84553af8-5f23-4c8e-a257-390f6e9c22d5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:54.341823 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-84553af8-5f23-4c8e-a257-390f6e9c22d5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:54.350005 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-84553af8-5f23-4c8e-a257-390f6e9c22d5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1568 microversion: 2.1 time: 0.143955 Oct 29 01:16:54.350584 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 311/647] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:16:54 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:55.366773 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-de5dbd08-5479-4393-bec2-9877bc883df4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:55.367374 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-de5dbd08-5479-4393-bec2-9877bc883df4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:55.373638 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-de5dbd08-5479-4393-bec2-9877bc883df4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:55.374687 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-de5dbd08-5479-4393-bec2-9877bc883df4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:55.375423 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-de5dbd08-5479-4393-bec2-9877bc883df4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:55.375847 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-de5dbd08-5479-4393-bec2-9877bc883df4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:55.497555 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-de5dbd08-5479-4393-bec2-9877bc883df4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:55.505824 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-de5dbd08-5479-4393-bec2-9877bc883df4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1568 microversion: 2.1 time: 0.142727 Oct 29 01:16:55.506406 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 337/648] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:16:55 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:56.524663 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ca7041ba-197c-462b-a694-7605a2f8d558 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:56.525332 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ca7041ba-197c-462b-a694-7605a2f8d558 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:56.532623 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ca7041ba-197c-462b-a694-7605a2f8d558 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:56.533266 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ca7041ba-197c-462b-a694-7605a2f8d558 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:56.534127 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ca7041ba-197c-462b-a694-7605a2f8d558 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:56.534840 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ca7041ba-197c-462b-a694-7605a2f8d558 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:56.671042 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-ca7041ba-197c-462b-a694-7605a2f8d558 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:56.679167 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ca7041ba-197c-462b-a694-7605a2f8d558 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1568 microversion: 2.1 time: 0.159700 Oct 29 01:16:56.679732 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 312/649] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:16:56 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:57.697747 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-03a1ed77-86aa-4f06-b087-c2e0a94fd2cb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:57.698351 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-03a1ed77-86aa-4f06-b087-c2e0a94fd2cb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:57.704983 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-03a1ed77-86aa-4f06-b087-c2e0a94fd2cb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:57.705427 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-03a1ed77-86aa-4f06-b087-c2e0a94fd2cb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:57.706189 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-03a1ed77-86aa-4f06-b087-c2e0a94fd2cb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:57.706647 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-03a1ed77-86aa-4f06-b087-c2e0a94fd2cb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:57.829745 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-03a1ed77-86aa-4f06-b087-c2e0a94fd2cb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:57.837482 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-03a1ed77-86aa-4f06-b087-c2e0a94fd2cb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1568 microversion: 2.1 time: 0.143462 Oct 29 01:16:57.838042 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 338/650] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:16:57 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:58.854772 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-6aa07c4e-e538-44f3-9970-2727958b2183 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:58.855377 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-6aa07c4e-e538-44f3-9970-2727958b2183 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:16:58.862065 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6aa07c4e-e538-44f3-9970-2727958b2183 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:58.862526 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6aa07c4e-e538-44f3-9970-2727958b2183 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:58.863284 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6aa07c4e-e538-44f3-9970-2727958b2183 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:16:58.863716 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6aa07c4e-e538-44f3-9970-2727958b2183 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:16:58.982105 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-6aa07c4e-e538-44f3-9970-2727958b2183 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:58.990280 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-6aa07c4e-e538-44f3-9970-2727958b2183 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1568 microversion: 2.1 time: 0.139377 Oct 29 01:16:58.990868 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 313/651] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:16:58 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:00.007553 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-190c7533-f069-4703-b6c9-dffb009cd9f7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:00.008188 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-190c7533-f069-4703-b6c9-dffb009cd9f7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:00.015698 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-190c7533-f069-4703-b6c9-dffb009cd9f7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:00.016147 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-190c7533-f069-4703-b6c9-dffb009cd9f7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:00.016912 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-190c7533-f069-4703-b6c9-dffb009cd9f7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:00.017345 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-190c7533-f069-4703-b6c9-dffb009cd9f7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:00.134262 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-190c7533-f069-4703-b6c9-dffb009cd9f7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:00.142540 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-190c7533-f069-4703-b6c9-dffb009cd9f7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1568 microversion: 2.1 time: 0.138641 Oct 29 01:17:00.143100 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 339/652] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:00 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:01.158855 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-e97c7df5-2a12-433b-a5ea-1047ce1670f9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:01.159465 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-e97c7df5-2a12-433b-a5ea-1047ce1670f9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:01.165676 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e97c7df5-2a12-433b-a5ea-1047ce1670f9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:01.166121 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e97c7df5-2a12-433b-a5ea-1047ce1670f9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:01.166919 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e97c7df5-2a12-433b-a5ea-1047ce1670f9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:01.167355 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e97c7df5-2a12-433b-a5ea-1047ce1670f9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:01.290085 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-e97c7df5-2a12-433b-a5ea-1047ce1670f9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:01.297736 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-e97c7df5-2a12-433b-a5ea-1047ce1670f9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1568 microversion: 2.1 time: 0.142474 Oct 29 01:17:01.298290 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 314/653] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:01 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:02.315056 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-030cfb02-bf9f-4b90-9929-10c99abc9c5d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:02.315659 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-030cfb02-bf9f-4b90-9929-10c99abc9c5d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:02.321963 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-030cfb02-bf9f-4b90-9929-10c99abc9c5d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:02.322438 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-030cfb02-bf9f-4b90-9929-10c99abc9c5d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:02.323208 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-030cfb02-bf9f-4b90-9929-10c99abc9c5d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:02.323646 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-030cfb02-bf9f-4b90-9929-10c99abc9c5d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:02.444689 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-030cfb02-bf9f-4b90-9929-10c99abc9c5d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:02.446887 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-cc80da4b-37dc-421a-acc1-6aea79b064bf tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-642596488", "imageRef": "3fef3f0d-d772-4999-b764-d6690634a06d", "flavorRef": "452", "networks": [{"uuid": "27173245-d0a5-41d2-a1be-c4a03b369c4b"}]}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:02.453068 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-030cfb02-bf9f-4b90-9929-10c99abc9c5d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1568 microversion: 2.1 time: 0.142375 Oct 29 01:17:02.454044 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 340/654] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:02 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:02.496785 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.network.neutron [None req-cc80da4b-37dc-421a-acc1-6aea79b064bf tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] validate_networks() for [('27173245-d0a5-41d2-a1be-c4a03b369c4b', None, None, None, None, None)] {{(pid=115747) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 01:17:02.834274 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-cc80da4b-37dc-421a-acc1-6aea79b064bf tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Flavor limits 0:0:0 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:17:02.834751 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-cc80da4b-37dc-421a-acc1-6aea79b064bf tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Image limits 0:0:0 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:17:02.835255 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-cc80da4b-37dc-421a-acc1-6aea79b064bf tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Flavor pref 0:0:0 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:17:02.835661 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-cc80da4b-37dc-421a-acc1-6aea79b064bf tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Image pref 0:0:0 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:17:02.836070 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-cc80da4b-37dc-421a-acc1-6aea79b064bf tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:17:02.844849 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cc80da4b-37dc-421a-acc1-6aea79b064bf tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:02.845292 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cc80da4b-37dc-421a-acc1-6aea79b064bf tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:02.846090 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cc80da4b-37dc-421a-acc1-6aea79b064bf tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:02.846567 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cc80da4b-37dc-421a-acc1-6aea79b064bf tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:02.862834 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.quota [None req-cc80da4b-37dc-421a-acc1-6aea79b064bf tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Getting quotas for project 24b83d8a1a4943748e8980793c6fbec7. Resources: {'instances', 'cores', 'ram'} {{(pid=115747) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:17:02.866853 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.quota [None req-cc80da4b-37dc-421a-acc1-6aea79b064bf tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Getting quotas for user 35b5e84fef6c4b3dabb6caaa8ad3aa2a and project 24b83d8a1a4943748e8980793c6fbec7. Resources: {'instances', 'cores', 'ram'} {{(pid=115747) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:17:02.877992 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-cc80da4b-37dc-421a-acc1-6aea79b064bf tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Going to run 1 instances... {{(pid=115747) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 01:17:02.880269 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-cc80da4b-37dc-421a-acc1-6aea79b064bf tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3fef3f0d-d772-4999-b764-d6690634a06d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 01:17:02.923816 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-cc80da4b-37dc-421a-acc1-6aea79b064bf tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.480617 Oct 29 01:17:02.924487 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 315/655] 10.222.0.90 () {60 vars in 1146 bytes} [Fri Oct 29 01:17:02 2021] POST /compute/v2.1/servers => generated 380 bytes in 482 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 01:17:02.934156 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f89d7787-aa2d-474b-a21b-5efc1a69da13 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:02.934790 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f89d7787-aa2d-474b-a21b-5efc1a69da13 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:02.985382 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-f89d7787-aa2d-474b-a21b-5efc1a69da13 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:02.991784 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f89d7787-aa2d-474b-a21b-5efc1a69da13 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1218 microversion: 2.1 time: 0.061291 Oct 29 01:17:02.992346 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 341/656] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:02 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1218 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:03.471503 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-073384fb-3d30-421b-bd41-509383566cd7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:03.472116 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-073384fb-3d30-421b-bd41-509383566cd7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:03.477929 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-073384fb-3d30-421b-bd41-509383566cd7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:03.478433 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-073384fb-3d30-421b-bd41-509383566cd7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:03.479211 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-073384fb-3d30-421b-bd41-509383566cd7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:03.479644 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-073384fb-3d30-421b-bd41-509383566cd7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:03.602448 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-073384fb-3d30-421b-bd41-509383566cd7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:03.610213 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-073384fb-3d30-421b-bd41-509383566cd7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1568 microversion: 2.1 time: 0.143553 Oct 29 01:17:03.610817 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 316/657] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:03 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:03.932750 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-b813847a-20dd-43ce-9ec4-8625d9e1427b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-106260691", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1685738325", "security_groups": [{"name": "tempest-secgroup-smoke-275931958"}], "block_device_mapping_v2": [{"uuid": "b4c0948a-7c83-4b77-a9aa-6e419ed8ce93", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e48074f6-6fab-44e6-a44e-4ac3f949f062"}]}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:04.008851 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f6a69800-97cf-4e2e-8b93-ce282b0fa24b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:04.009459 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f6a69800-97cf-4e2e-8b93-ce282b0fa24b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:04.016037 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f6a69800-97cf-4e2e-8b93-ce282b0fa24b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:04.016487 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f6a69800-97cf-4e2e-8b93-ce282b0fa24b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:04.017490 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f6a69800-97cf-4e2e-8b93-ce282b0fa24b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:04.017936 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f6a69800-97cf-4e2e-8b93-ce282b0fa24b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:04.036350 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.network.neutron [None req-b813847a-20dd-43ce-9ec4-8625d9e1427b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] validate_networks() for [('e48074f6-6fab-44e6-a44e-4ac3f949f062', None, None, None, None, None)] {{(pid=115748) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 01:17:04.130354 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-f6a69800-97cf-4e2e-8b93-ce282b0fa24b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:04.140859 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f6a69800-97cf-4e2e-8b93-ce282b0fa24b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1278 microversion: 2.1 time: 0.136137 Oct 29 01:17:04.151366 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 317/658] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:04 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1278 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:17:04.448717 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.virt.hardware [None req-b813847a-20dd-43ce-9ec4-8625d9e1427b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Flavor limits 0:0:0 {{(pid=115748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:17:04.449536 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.virt.hardware [None req-b813847a-20dd-43ce-9ec4-8625d9e1427b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Image limits 0:0:0 {{(pid=115748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:17:04.450135 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.virt.hardware [None req-b813847a-20dd-43ce-9ec4-8625d9e1427b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Flavor pref 0:0:0 {{(pid=115748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:17:04.450570 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.virt.hardware [None req-b813847a-20dd-43ce-9ec4-8625d9e1427b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Image pref 0:0:0 {{(pid=115748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:17:04.450974 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.virt.hardware [None req-b813847a-20dd-43ce-9ec4-8625d9e1427b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:17:04.460751 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b813847a-20dd-43ce-9ec4-8625d9e1427b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:04.461234 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b813847a-20dd-43ce-9ec4-8625d9e1427b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:04.462105 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b813847a-20dd-43ce-9ec4-8625d9e1427b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:04.462778 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b813847a-20dd-43ce-9ec4-8625d9e1427b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:04.478560 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.quota [None req-b813847a-20dd-43ce-9ec4-8625d9e1427b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Getting quotas for project ccd9f9783640477abd2d011a323a6f06. Resources: {'instances', 'cores', 'ram'} {{(pid=115748) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:17:04.482473 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.quota [None req-b813847a-20dd-43ce-9ec4-8625d9e1427b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Getting quotas for user fe886b061dd447649b65fc919fb6dd87 and project ccd9f9783640477abd2d011a323a6f06. Resources: {'instances', 'cores', 'ram'} {{(pid=115748) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:17:04.536514 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-b813847a-20dd-43ce-9ec4-8625d9e1427b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Going to run 1 instances... {{(pid=115748) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 01:17:04.538674 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-b813847a-20dd-43ce-9ec4-8625d9e1427b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b4c0948a-7c83-4b77-a9aa-6e419ed8ce93',volume_size=None,volume_type=None)] {{(pid=115748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 01:17:04.627360 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-92fe0885-b888-4760-bf62-d4672b6221d1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:04.628242 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-92fe0885-b888-4760-bf62-d4672b6221d1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:04.635316 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-92fe0885-b888-4760-bf62-d4672b6221d1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:04.635756 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-92fe0885-b888-4760-bf62-d4672b6221d1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:04.636709 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-92fe0885-b888-4760-bf62-d4672b6221d1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:04.637145 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-92fe0885-b888-4760-bf62-d4672b6221d1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:04.667431 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-b813847a-20dd-43ce-9ec4-8625d9e1427b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.738314 Oct 29 01:17:04.674213 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 342/659] 10.222.0.90 () {60 vars in 1146 bytes} [Fri Oct 29 01:17:03 2021] POST /compute/v2.1/servers => generated 405 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:17:04.679219 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-b1470d0d-2061-4ad5-8d14-c16b643380d8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:04.680003 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-b1470d0d-2061-4ad5-8d14-c16b643380d8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:04.752682 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-b1470d0d-2061-4ad5-8d14-c16b643380d8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:04.759537 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-b1470d0d-2061-4ad5-8d14-c16b643380d8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1094 microversion: 2.1 time: 0.083966 Oct 29 01:17:04.760133 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 343/660] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:04 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1094 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:04.830258 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-92fe0885-b888-4760-bf62-d4672b6221d1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:04.838376 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-92fe0885-b888-4760-bf62-d4672b6221d1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1568 microversion: 2.1 time: 0.215182 Oct 29 01:17:04.848080 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 318/661] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:04 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1568 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:17:05.159084 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-b66d0d8c-ba20-41af-bb7f-2582ce1ba0e3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:05.159700 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-b66d0d8c-ba20-41af-bb7f-2582ce1ba0e3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:05.168893 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b66d0d8c-ba20-41af-bb7f-2582ce1ba0e3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:05.169463 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b66d0d8c-ba20-41af-bb7f-2582ce1ba0e3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:05.170977 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b66d0d8c-ba20-41af-bb7f-2582ce1ba0e3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:05.171284 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b66d0d8c-ba20-41af-bb7f-2582ce1ba0e3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:05.329157 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-b66d0d8c-ba20-41af-bb7f-2582ce1ba0e3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:05.336637 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-b66d0d8c-ba20-41af-bb7f-2582ce1ba0e3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1318 microversion: 2.1 time: 0.183426 Oct 29 01:17:05.337195 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 344/662] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:05 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:05.432040 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [req-b7acbc9e-f917-4090-93a0-a5b556440ff1 req-e483baed-458d-4338-bfa0-4a08f55f7df6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97b0ab6c-d7cb-4e53-9288-3b6b2040a24d", "tag": "b603e09e-bba1-4da7-9338-7f280edb3e9c"}]} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:05.433587 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:17:05.433587 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: warnings.warn(msg) Oct 29 01:17:05.440555 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-b7acbc9e-f917-4090-93a0-a5b556440ff1 req-e483baed-458d-4338-bfa0-4a08f55f7df6 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:05.441495 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-b7acbc9e-f917-4090-93a0-a5b556440ff1 req-e483baed-458d-4338-bfa0-4a08f55f7df6 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:05.455651 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.compute.server_external_events [req-b7acbc9e-f917-4090-93a0-a5b556440ff1 req-e483baed-458d-4338-bfa0-4a08f55f7df6 service nova] Creating event network-changed:b603e09e-bba1-4da7-9338-7f280edb3e9c for instance 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d on hv-cinder-81558 Oct 29 01:17:05.460353 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [req-b7acbc9e-f917-4090-93a0-a5b556440ff1 req-e483baed-458d-4338-bfa0-4a08f55f7df6 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031937 Oct 29 01:17:05.460945 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 319/663] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:17:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:05.776832 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-6d3f1964-5d11-4634-92e9-04b752019131 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:05.777438 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-6d3f1964-5d11-4634-92e9-04b752019131 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:05.783194 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6d3f1964-5d11-4634-92e9-04b752019131 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:05.783643 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6d3f1964-5d11-4634-92e9-04b752019131 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:05.784413 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6d3f1964-5d11-4634-92e9-04b752019131 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:05.784851 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6d3f1964-5d11-4634-92e9-04b752019131 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:05.845118 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-6d3f1964-5d11-4634-92e9-04b752019131 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:05.852292 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-6d3f1964-5d11-4634-92e9-04b752019131 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1192 microversion: 2.1 time: 0.079127 Oct 29 01:17:05.852893 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 345/664] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:05 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1192 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:05.856010 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-6e819ddc-bfa7-44c9-ae58-00d139d07170 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:05.856835 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-6e819ddc-bfa7-44c9-ae58-00d139d07170 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:05.869661 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6e819ddc-bfa7-44c9-ae58-00d139d07170 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:05.870129 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6e819ddc-bfa7-44c9-ae58-00d139d07170 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:05.870932 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6e819ddc-bfa7-44c9-ae58-00d139d07170 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:05.871371 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6e819ddc-bfa7-44c9-ae58-00d139d07170 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:06.009949 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-6e819ddc-bfa7-44c9-ae58-00d139d07170 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:06.018260 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-6e819ddc-bfa7-44c9-ae58-00d139d07170 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1568 microversion: 2.1 time: 0.166149 Oct 29 01:17:06.019453 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 320/665] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:05 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:17:06.354006 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-99f1bd13-250f-4b3f-8924-992d45b2dd80 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:06.354725 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-99f1bd13-250f-4b3f-8924-992d45b2dd80 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:06.361712 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-99f1bd13-250f-4b3f-8924-992d45b2dd80 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:06.362166 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-99f1bd13-250f-4b3f-8924-992d45b2dd80 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:06.362974 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-99f1bd13-250f-4b3f-8924-992d45b2dd80 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:06.363401 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-99f1bd13-250f-4b3f-8924-992d45b2dd80 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:06.487635 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-99f1bd13-250f-4b3f-8924-992d45b2dd80 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:06.495241 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-99f1bd13-250f-4b3f-8924-992d45b2dd80 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1318 microversion: 2.1 time: 0.144979 Oct 29 01:17:06.495902 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 346/666] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:06 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:06.869842 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-1f2b4e81-51e1-4c3b-9d55-9d6c132eba8a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:06.870566 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-1f2b4e81-51e1-4c3b-9d55-9d6c132eba8a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:06.877509 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1f2b4e81-51e1-4c3b-9d55-9d6c132eba8a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:06.877947 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1f2b4e81-51e1-4c3b-9d55-9d6c132eba8a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:06.878759 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1f2b4e81-51e1-4c3b-9d55-9d6c132eba8a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:06.879199 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1f2b4e81-51e1-4c3b-9d55-9d6c132eba8a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:06.947693 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-1f2b4e81-51e1-4c3b-9d55-9d6c132eba8a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:06.956498 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-1f2b4e81-51e1-4c3b-9d55-9d6c132eba8a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1210 microversion: 2.1 time: 0.090174 Oct 29 01:17:06.957210 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 321/667] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:06 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1210 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:17:07.036006 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-a0528146-e5c4-4d5a-b6d3-f7ce2b4b9d23 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:07.037110 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-a0528146-e5c4-4d5a-b6d3-f7ce2b4b9d23 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:07.046013 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a0528146-e5c4-4d5a-b6d3-f7ce2b4b9d23 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:07.046921 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a0528146-e5c4-4d5a-b6d3-f7ce2b4b9d23 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:07.048200 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a0528146-e5c4-4d5a-b6d3-f7ce2b4b9d23 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:07.048653 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a0528146-e5c4-4d5a-b6d3-f7ce2b4b9d23 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:07.176286 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-a0528146-e5c4-4d5a-b6d3-f7ce2b4b9d23 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:07.183988 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-a0528146-e5c4-4d5a-b6d3-f7ce2b4b9d23 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1568 microversion: 2.1 time: 0.152517 Oct 29 01:17:07.184551 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 347/668] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:07 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:07.514250 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-70a09c9d-06f3-461e-958a-97b723b5cc4d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:07.515182 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-70a09c9d-06f3-461e-958a-97b723b5cc4d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:07.521710 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-70a09c9d-06f3-461e-958a-97b723b5cc4d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:07.523359 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-70a09c9d-06f3-461e-958a-97b723b5cc4d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:07.524347 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-70a09c9d-06f3-461e-958a-97b723b5cc4d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:07.524894 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-70a09c9d-06f3-461e-958a-97b723b5cc4d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:07.646167 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-70a09c9d-06f3-461e-958a-97b723b5cc4d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:07.653419 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-70a09c9d-06f3-461e-958a-97b723b5cc4d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1318 microversion: 2.1 time: 0.143732 Oct 29 01:17:07.654064 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 322/669] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:07 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:07.933315 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [req-67e39a88-7a88-4d5e-bee8-e02de161529a req-e4341958-b719-4a51-b69f-ba758809f9fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11a30efc-58bb-4139-a2ca-1712680c7fde", "tag": "a1c1c487-5f02-4bbf-96cd-d6b3e55b076a"}]} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:07.935076 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:17:07.935076 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: warnings.warn(msg) Oct 29 01:17:07.943625 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-67e39a88-7a88-4d5e-bee8-e02de161529a req-e4341958-b719-4a51-b69f-ba758809f9fb service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:07.944095 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-67e39a88-7a88-4d5e-bee8-e02de161529a req-e4341958-b719-4a51-b69f-ba758809f9fb service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:07.962340 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.compute.server_external_events [req-67e39a88-7a88-4d5e-bee8-e02de161529a req-e4341958-b719-4a51-b69f-ba758809f9fb service nova] Creating event network-changed:a1c1c487-5f02-4bbf-96cd-d6b3e55b076a for instance 11a30efc-58bb-4139-a2ca-1712680c7fde on hv-cinder-81558 Oct 29 01:17:07.967973 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [req-67e39a88-7a88-4d5e-bee8-e02de161529a req-e4341958-b719-4a51-b69f-ba758809f9fb service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039237 Oct 29 01:17:07.969003 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 348/670] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:17:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:07.974494 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9589d01f-7c6e-43fe-95c0-e4f169359e29 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:07.975209 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9589d01f-7c6e-43fe-95c0-e4f169359e29 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:07.981815 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9589d01f-7c6e-43fe-95c0-e4f169359e29 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:07.982267 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9589d01f-7c6e-43fe-95c0-e4f169359e29 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:07.983239 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9589d01f-7c6e-43fe-95c0-e4f169359e29 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:07.983674 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9589d01f-7c6e-43fe-95c0-e4f169359e29 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:08.116302 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-9589d01f-7c6e-43fe-95c0-e4f169359e29 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:08.124448 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9589d01f-7c6e-43fe-95c0-e4f169359e29 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1265 microversion: 2.1 time: 0.154446 Oct 29 01:17:08.125017 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 323/671] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:07 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:17:08.201301 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-678ea4dc-06f7-4633-aa7a-7081895e1198 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:08.202084 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-678ea4dc-06f7-4633-aa7a-7081895e1198 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:08.208268 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-678ea4dc-06f7-4633-aa7a-7081895e1198 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:08.208722 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-678ea4dc-06f7-4633-aa7a-7081895e1198 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:08.209479 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-678ea4dc-06f7-4633-aa7a-7081895e1198 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:08.209914 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-678ea4dc-06f7-4633-aa7a-7081895e1198 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:08.330298 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-678ea4dc-06f7-4633-aa7a-7081895e1198 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:08.338611 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-678ea4dc-06f7-4633-aa7a-7081895e1198 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1568 microversion: 2.1 time: 0.140809 Oct 29 01:17:08.339182 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 349/672] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:08 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:08.672344 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-8233326f-9132-4d2d-a894-918149b6772a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:08.672956 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-8233326f-9132-4d2d-a894-918149b6772a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:08.679630 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8233326f-9132-4d2d-a894-918149b6772a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:08.680071 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8233326f-9132-4d2d-a894-918149b6772a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:08.680900 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8233326f-9132-4d2d-a894-918149b6772a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:08.681325 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8233326f-9132-4d2d-a894-918149b6772a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:08.814833 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-8233326f-9132-4d2d-a894-918149b6772a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:08.823184 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-8233326f-9132-4d2d-a894-918149b6772a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1318 microversion: 2.1 time: 0.154489 Oct 29 01:17:08.823764 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 324/673] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:08 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:09.140808 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-8b03c421-6e16-4161-b795-a5a8ca80eb7c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:09.141420 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-8b03c421-6e16-4161-b795-a5a8ca80eb7c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:09.147673 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8b03c421-6e16-4161-b795-a5a8ca80eb7c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:09.148126 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8b03c421-6e16-4161-b795-a5a8ca80eb7c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:09.148889 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8b03c421-6e16-4161-b795-a5a8ca80eb7c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:09.149325 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8b03c421-6e16-4161-b795-a5a8ca80eb7c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:09.270617 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-8b03c421-6e16-4161-b795-a5a8ca80eb7c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:09.277861 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-8b03c421-6e16-4161-b795-a5a8ca80eb7c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1265 microversion: 2.1 time: 0.140713 Oct 29 01:17:09.278445 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 350/674] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:09 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1265 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:09.355728 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-97abcf88-5a9e-4381-b440-471ffaa6b044 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:09.356459 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-97abcf88-5a9e-4381-b440-471ffaa6b044 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:09.363072 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-97abcf88-5a9e-4381-b440-471ffaa6b044 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:09.363517 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-97abcf88-5a9e-4381-b440-471ffaa6b044 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:09.364283 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-97abcf88-5a9e-4381-b440-471ffaa6b044 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:09.364716 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-97abcf88-5a9e-4381-b440-471ffaa6b044 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:09.483256 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-97abcf88-5a9e-4381-b440-471ffaa6b044 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:09.490819 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-97abcf88-5a9e-4381-b440-471ffaa6b044 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1568 microversion: 2.1 time: 0.138804 Oct 29 01:17:09.491387 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 325/675] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:09 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:09.840761 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c01c66bb-6514-46eb-8291-5e9f1e6fbbed tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:09.841400 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c01c66bb-6514-46eb-8291-5e9f1e6fbbed tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:09.848219 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c01c66bb-6514-46eb-8291-5e9f1e6fbbed tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:09.848666 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c01c66bb-6514-46eb-8291-5e9f1e6fbbed tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:09.849435 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c01c66bb-6514-46eb-8291-5e9f1e6fbbed tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:09.849867 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c01c66bb-6514-46eb-8291-5e9f1e6fbbed tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:09.968552 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-c01c66bb-6514-46eb-8291-5e9f1e6fbbed tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:09.976036 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c01c66bb-6514-46eb-8291-5e9f1e6fbbed tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1318 microversion: 2.1 time: 0.139226 Oct 29 01:17:09.976604 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 351/676] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:09 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1318 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:10.294951 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a8842332-66a4-4c0c-9d10-8a3c9ed45cf3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:10.295458 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a8842332-66a4-4c0c-9d10-8a3c9ed45cf3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:10.301252 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a8842332-66a4-4c0c-9d10-8a3c9ed45cf3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:10.301703 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a8842332-66a4-4c0c-9d10-8a3c9ed45cf3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:10.302485 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a8842332-66a4-4c0c-9d10-8a3c9ed45cf3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:10.302919 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a8842332-66a4-4c0c-9d10-8a3c9ed45cf3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:10.425695 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-a8842332-66a4-4c0c-9d10-8a3c9ed45cf3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:10.432908 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a8842332-66a4-4c0c-9d10-8a3c9ed45cf3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1265 microversion: 2.1 time: 0.142253 Oct 29 01:17:10.433485 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 326/677] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:10 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1265 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:10.507833 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-056fe281-3afc-4610-af4f-f3d26261e6c6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:10.508433 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-056fe281-3afc-4610-af4f-f3d26261e6c6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:10.515195 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-056fe281-3afc-4610-af4f-f3d26261e6c6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:10.515665 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-056fe281-3afc-4610-af4f-f3d26261e6c6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:10.516409 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-056fe281-3afc-4610-af4f-f3d26261e6c6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:10.516842 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-056fe281-3afc-4610-af4f-f3d26261e6c6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:10.639052 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-056fe281-3afc-4610-af4f-f3d26261e6c6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:10.646887 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-056fe281-3afc-4610-af4f-f3d26261e6c6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1568 microversion: 2.1 time: 0.142660 Oct 29 01:17:10.647465 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 352/678] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:10 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:10.691829 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [req-a1b317bb-05ad-4c4a-aa54-138e2345f0fa req-229d9604-1b96-44af-83cc-d97e4c387290 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97b0ab6c-d7cb-4e53-9288-3b6b2040a24d", "name": "network-vif-plugged", "status": "completed", "tag": "b603e09e-bba1-4da7-9338-7f280edb3e9c"}]} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:10.693408 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:17:10.693408 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: warnings.warn(msg) Oct 29 01:17:10.701432 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-a1b317bb-05ad-4c4a-aa54-138e2345f0fa req-229d9604-1b96-44af-83cc-d97e4c387290 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:10.702463 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-a1b317bb-05ad-4c4a-aa54-138e2345f0fa req-229d9604-1b96-44af-83cc-d97e4c387290 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:10.713933 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.compute.server_external_events [req-a1b317bb-05ad-4c4a-aa54-138e2345f0fa req-229d9604-1b96-44af-83cc-d97e4c387290 service nova] Creating event network-vif-plugged:b603e09e-bba1-4da7-9338-7f280edb3e9c for instance 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d on hv-cinder-81558 Oct 29 01:17:10.719078 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [req-a1b317bb-05ad-4c4a-aa54-138e2345f0fa req-229d9604-1b96-44af-83cc-d97e4c387290 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030857 Oct 29 01:17:10.719670 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 327/679] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:17:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:10.992390 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f175e7a7-5ac7-4e4c-941a-aa5d68059585 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:10.993004 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f175e7a7-5ac7-4e4c-941a-aa5d68059585 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:10.998771 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f175e7a7-5ac7-4e4c-941a-aa5d68059585 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:10.999224 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f175e7a7-5ac7-4e4c-941a-aa5d68059585 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:10.999990 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f175e7a7-5ac7-4e4c-941a-aa5d68059585 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:11.000425 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f175e7a7-5ac7-4e4c-941a-aa5d68059585 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:11.118786 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-f175e7a7-5ac7-4e4c-941a-aa5d68059585 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:11.126482 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f175e7a7-5ac7-4e4c-941a-aa5d68059585 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1318 microversion: 2.1 time: 0.137751 Oct 29 01:17:11.127041 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 353/680] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:10 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1318 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:11.449284 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-34d66348-dbea-4b1f-89af-b62b86f57ab0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:11.449985 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-34d66348-dbea-4b1f-89af-b62b86f57ab0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:11.456677 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-34d66348-dbea-4b1f-89af-b62b86f57ab0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:11.457123 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-34d66348-dbea-4b1f-89af-b62b86f57ab0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:11.457879 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-34d66348-dbea-4b1f-89af-b62b86f57ab0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:11.458337 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-34d66348-dbea-4b1f-89af-b62b86f57ab0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:11.581394 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-34d66348-dbea-4b1f-89af-b62b86f57ab0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:11.588520 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-34d66348-dbea-4b1f-89af-b62b86f57ab0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1265 microversion: 2.1 time: 0.143224 Oct 29 01:17:11.589100 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 328/681] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:11 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1265 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:11.662568 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-beca9339-4964-47da-8139-12e6c5bd0771 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:11.663164 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-beca9339-4964-47da-8139-12e6c5bd0771 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:11.670517 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-beca9339-4964-47da-8139-12e6c5bd0771 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:11.670996 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-beca9339-4964-47da-8139-12e6c5bd0771 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:11.671767 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-beca9339-4964-47da-8139-12e6c5bd0771 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:11.672201 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-beca9339-4964-47da-8139-12e6c5bd0771 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:11.792441 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-beca9339-4964-47da-8139-12e6c5bd0771 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:11.800759 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-beca9339-4964-47da-8139-12e6c5bd0771 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1548 microversion: 2.1 time: 0.141931 Oct 29 01:17:11.801460 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 354/682] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:11 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1548 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:11.816567 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-540d7215-3bcf-46af-835e-473f098ac823 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:11.817051 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-540d7215-3bcf-46af-835e-473f098ac823 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:11.822698 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-540d7215-3bcf-46af-835e-473f098ac823 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:11.823135 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-540d7215-3bcf-46af-835e-473f098ac823 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:11.823881 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-540d7215-3bcf-46af-835e-473f098ac823 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:11.824309 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-540d7215-3bcf-46af-835e-473f098ac823 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:11.901922 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.wsgi [None req-540d7215-3bcf-46af-835e-473f098ac823 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] HTTP exception thrown: Cannot 'detach_volume' instance 0ff6277c-b59e-467c-82d4-631046fb03d9 while it is in vm_state rescued Oct 29 01:17:11.902663 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-540d7215-3bcf-46af-835e-473f098ac823 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Returning 409 to user: Cannot 'detach_volume' instance 0ff6277c-b59e-467c-82d4-631046fb03d9 while it is in vm_state rescued {{(pid=115747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:17:11.904010 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-540d7215-3bcf-46af-835e-473f098ac823 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "DELETE /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments/23c26adc-b125-45d9-b8ba-8febe3ea4192" status: 409 len: 152 microversion: 2.1 time: 0.090668 Oct 29 01:17:11.904571 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 329/683] 10.222.0.90 () {58 vars in 1415 bytes} [Fri Oct 29 01:17:11 2021] DELETE /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments/23c26adc-b125-45d9-b8ba-8febe3ea4192 => generated 152 bytes in 92 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:17:11.913138 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-3d489a1d-5ff8-45d4-bb55-853d42e29791 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:11.913666 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-3d489a1d-5ff8-45d4-bb55-853d42e29791 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:11.920207 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3d489a1d-5ff8-45d4-bb55-853d42e29791 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:11.920671 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3d489a1d-5ff8-45d4-bb55-853d42e29791 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:11.921446 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3d489a1d-5ff8-45d4-bb55-853d42e29791 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:11.921879 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3d489a1d-5ff8-45d4-bb55-853d42e29791 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:11.984622 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-3d489a1d-5ff8-45d4-bb55-853d42e29791 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "POST /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/action" status: 202 len: 0 microversion: 2.1 time: 0.074944 Oct 29 01:17:11.985250 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 355/684] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:17:11 2021] POST /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:17:11.993321 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b14718d0-0240-428a-ae35-14fa4a613fca tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:11.993942 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b14718d0-0240-428a-ae35-14fa4a613fca tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:11.999879 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b14718d0-0240-428a-ae35-14fa4a613fca tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:12.000327 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b14718d0-0240-428a-ae35-14fa4a613fca tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:12.001281 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b14718d0-0240-428a-ae35-14fa4a613fca tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:12.001527 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b14718d0-0240-428a-ae35-14fa4a613fca tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:12.122263 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-b14718d0-0240-428a-ae35-14fa4a613fca tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:12.130141 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b14718d0-0240-428a-ae35-14fa4a613fca tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1556 microversion: 2.1 time: 0.140596 Oct 29 01:17:12.130732 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 330/685] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:11 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1556 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:17:12.143391 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-70d98f1f-4c05-4c65-9491-4d313e643f8a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:12.144180 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-70d98f1f-4c05-4c65-9491-4d313e643f8a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:12.150129 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-70d98f1f-4c05-4c65-9491-4d313e643f8a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:12.150747 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-70d98f1f-4c05-4c65-9491-4d313e643f8a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:12.151611 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-70d98f1f-4c05-4c65-9491-4d313e643f8a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:12.152126 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-70d98f1f-4c05-4c65-9491-4d313e643f8a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:12.278006 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-70d98f1f-4c05-4c65-9491-4d313e643f8a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:12.285166 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-70d98f1f-4c05-4c65-9491-4d313e643f8a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1318 microversion: 2.1 time: 0.145792 Oct 29 01:17:12.285733 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 356/686] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:12 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:12.604793 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c30e76ba-332a-49ac-b6a2-90ddc1e95e38 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:12.605375 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c30e76ba-332a-49ac-b6a2-90ddc1e95e38 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:12.612110 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c30e76ba-332a-49ac-b6a2-90ddc1e95e38 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:12.612552 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c30e76ba-332a-49ac-b6a2-90ddc1e95e38 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:12.613312 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c30e76ba-332a-49ac-b6a2-90ddc1e95e38 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:12.613742 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c30e76ba-332a-49ac-b6a2-90ddc1e95e38 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:12.733178 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c30e76ba-332a-49ac-b6a2-90ddc1e95e38 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:12.740606 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c30e76ba-332a-49ac-b6a2-90ddc1e95e38 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1265 microversion: 2.1 time: 0.139412 Oct 29 01:17:12.741170 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 331/687] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:12 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1265 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:13.146876 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e0c913ae-914c-4ee9-9fbb-77d7acfd991b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:13.147482 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-e0c913ae-914c-4ee9-9fbb-77d7acfd991b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:13.153753 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e0c913ae-914c-4ee9-9fbb-77d7acfd991b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:13.154269 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e0c913ae-914c-4ee9-9fbb-77d7acfd991b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:13.155060 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e0c913ae-914c-4ee9-9fbb-77d7acfd991b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:13.155497 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e0c913ae-914c-4ee9-9fbb-77d7acfd991b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:13.273102 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-e0c913ae-914c-4ee9-9fbb-77d7acfd991b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:13.280844 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-e0c913ae-914c-4ee9-9fbb-77d7acfd991b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1556 microversion: 2.1 time: 0.137605 Oct 29 01:17:13.281406 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 357/688] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:13 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1556 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:13.302138 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-02170c99-b61b-4bba-b7c8-d1d836f8f97f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:13.302773 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-02170c99-b61b-4bba-b7c8-d1d836f8f97f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:13.308386 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-02170c99-b61b-4bba-b7c8-d1d836f8f97f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:13.308827 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-02170c99-b61b-4bba-b7c8-d1d836f8f97f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:13.310116 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-02170c99-b61b-4bba-b7c8-d1d836f8f97f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:13.310586 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-02170c99-b61b-4bba-b7c8-d1d836f8f97f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:13.431706 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-02170c99-b61b-4bba-b7c8-d1d836f8f97f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:13.438825 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-02170c99-b61b-4bba-b7c8-d1d836f8f97f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1507 microversion: 2.1 time: 0.140338 Oct 29 01:17:13.439382 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 332/689] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:13 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1507 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:13.455223 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f0b85a17-e4cb-46a7-a408-e20bfd0efbf7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "83b8cfc7-3e81-413f-9854-1aaebf9058bf", "device": "/dev/sdb"}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:13.456355 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f0b85a17-e4cb-46a7-a408-e20bfd0efbf7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:13.462084 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f0b85a17-e4cb-46a7-a408-e20bfd0efbf7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:13.462597 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f0b85a17-e4cb-46a7-a408-e20bfd0efbf7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:13.463356 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f0b85a17-e4cb-46a7-a408-e20bfd0efbf7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:13.463789 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f0b85a17-e4cb-46a7-a408-e20bfd0efbf7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:13.723626 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f0b85a17-e4cb-46a7-a408-e20bfd0efbf7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "POST /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272304 Oct 29 01:17:13.724247 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 358/690] 10.222.0.90 () {60 vars in 1322 bytes} [Fri Oct 29 01:17:13 2021] POST /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:13.758531 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-07ee5b5b-d9a8-469a-b3c3-c5afa2e8a0c0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:13.759220 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-07ee5b5b-d9a8-469a-b3c3-c5afa2e8a0c0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:13.766838 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-07ee5b5b-d9a8-469a-b3c3-c5afa2e8a0c0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:13.767348 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-07ee5b5b-d9a8-469a-b3c3-c5afa2e8a0c0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:13.768201 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-07ee5b5b-d9a8-469a-b3c3-c5afa2e8a0c0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:13.768832 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-07ee5b5b-d9a8-469a-b3c3-c5afa2e8a0c0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:13.892101 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-07ee5b5b-d9a8-469a-b3c3-c5afa2e8a0c0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:13.899367 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-07ee5b5b-d9a8-469a-b3c3-c5afa2e8a0c0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1265 microversion: 2.1 time: 0.145545 Oct 29 01:17:13.899921 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 333/691] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:13 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:14.298383 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-65e50a76-cf0d-470a-b0f2-f894003ffca0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:14.299034 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-65e50a76-cf0d-470a-b0f2-f894003ffca0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:14.305071 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-65e50a76-cf0d-470a-b0f2-f894003ffca0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:14.305525 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-65e50a76-cf0d-470a-b0f2-f894003ffca0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:14.306291 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-65e50a76-cf0d-470a-b0f2-f894003ffca0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:14.306757 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-65e50a76-cf0d-470a-b0f2-f894003ffca0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:14.426200 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-65e50a76-cf0d-470a-b0f2-f894003ffca0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:14.433895 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-65e50a76-cf0d-470a-b0f2-f894003ffca0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1556 microversion: 2.1 time: 0.140145 Oct 29 01:17:14.434477 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 359/692] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:14 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1556 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:14.916414 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-87a6a9e8-ec27-4093-9228-304a93eb7d56 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:14.917012 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-87a6a9e8-ec27-4093-9228-304a93eb7d56 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:14.923810 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-87a6a9e8-ec27-4093-9228-304a93eb7d56 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:14.924193 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-87a6a9e8-ec27-4093-9228-304a93eb7d56 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:14.924939 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-87a6a9e8-ec27-4093-9228-304a93eb7d56 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:14.925402 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-87a6a9e8-ec27-4093-9228-304a93eb7d56 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:15.048825 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-87a6a9e8-ec27-4093-9228-304a93eb7d56 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:15.056090 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-87a6a9e8-ec27-4093-9228-304a93eb7d56 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1265 microversion: 2.1 time: 0.143332 Oct 29 01:17:15.056642 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 334/693] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:14 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1265 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:15.098615 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-777e5086-dd2a-4267-b7f5-ca748dd905d9 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:15.099109 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-777e5086-dd2a-4267-b7f5-ca748dd905d9 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:15.105227 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-777e5086-dd2a-4267-b7f5-ca748dd905d9 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:15.105695 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-777e5086-dd2a-4267-b7f5-ca748dd905d9 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:15.107077 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-777e5086-dd2a-4267-b7f5-ca748dd905d9 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:15.107562 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-777e5086-dd2a-4267-b7f5-ca748dd905d9 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:15.134907 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-777e5086-dd2a-4267-b7f5-ca748dd905d9 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/os-volume_attachments/88a409f2-6048-4e85-9e8c-e9096e338844" status: 200 len: 194 microversion: 2.20 time: 0.040352 Oct 29 01:17:15.135472 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 360/694] 10.222.0.90 () {60 vars in 1453 bytes} [Fri Oct 29 01:17:15 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/os-volume_attachments/88a409f2-6048-4e85-9e8c-e9096e338844 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:17:15.192668 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-bcf49ab4-c579-4ce7-bb6c-c632b8caf596 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:15.193156 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-bcf49ab4-c579-4ce7-bb6c-c632b8caf596 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:15.198899 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bcf49ab4-c579-4ce7-bb6c-c632b8caf596 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:15.199345 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bcf49ab4-c579-4ce7-bb6c-c632b8caf596 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:15.200102 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bcf49ab4-c579-4ce7-bb6c-c632b8caf596 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:15.200563 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bcf49ab4-c579-4ce7-bb6c-c632b8caf596 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:15.282278 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.objects.instance [None req-bcf49ab4-c579-4ce7-bb6c-c632b8caf596 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lazy-loading 'services' on Instance uuid 27a73464-dcac-4be6-a392-58d40a0296a8 {{(pid=115747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:17:15.350673 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-bcf49ab4-c579-4ce7-bb6c-c632b8caf596 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "DELETE /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/os-volume_attachments/88a409f2-6048-4e85-9e8c-e9096e338844" status: 202 len: 0 microversion: 2.20 time: 0.161546 Oct 29 01:17:15.351278 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 335/695] 10.222.0.90 () {60 vars in 1456 bytes} [Fri Oct 29 01:17:15 2021] DELETE /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/os-volume_attachments/88a409f2-6048-4e85-9e8c-e9096e338844 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:17:15.359380 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f03b268c-a7af-47c8-ac17-fbbc6f447132 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:15.360352 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f03b268c-a7af-47c8-ac17-fbbc6f447132 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:15.366116 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f03b268c-a7af-47c8-ac17-fbbc6f447132 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:15.366593 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f03b268c-a7af-47c8-ac17-fbbc6f447132 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:15.367357 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f03b268c-a7af-47c8-ac17-fbbc6f447132 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:15.367846 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f03b268c-a7af-47c8-ac17-fbbc6f447132 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:15.397273 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f03b268c-a7af-47c8-ac17-fbbc6f447132 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041596 Oct 29 01:17:15.397841 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 361/696] 10.222.0.90 () {60 vars in 1342 bytes} [Fri Oct 29 01:17:15 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:17:15.451101 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c398d63d-90f7-4314-9ac8-8a9d416b3f53 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:15.451798 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c398d63d-90f7-4314-9ac8-8a9d416b3f53 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:15.457895 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c398d63d-90f7-4314-9ac8-8a9d416b3f53 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:15.458350 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c398d63d-90f7-4314-9ac8-8a9d416b3f53 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:15.459168 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c398d63d-90f7-4314-9ac8-8a9d416b3f53 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:15.459561 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c398d63d-90f7-4314-9ac8-8a9d416b3f53 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:15.587111 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c398d63d-90f7-4314-9ac8-8a9d416b3f53 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:15.595421 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c398d63d-90f7-4314-9ac8-8a9d416b3f53 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1562 microversion: 2.1 time: 0.148785 Oct 29 01:17:15.595978 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 336/697] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:15 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1562 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:15.659609 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-494097f9-5e6b-40db-8702-90522359b46c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:15.660097 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-494097f9-5e6b-40db-8702-90522359b46c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:15.666214 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-494097f9-5e6b-40db-8702-90522359b46c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:15.666688 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-494097f9-5e6b-40db-8702-90522359b46c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:15.667446 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-494097f9-5e6b-40db-8702-90522359b46c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:15.667872 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-494097f9-5e6b-40db-8702-90522359b46c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:15.743190 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.objects.instance [None req-494097f9-5e6b-40db-8702-90522359b46c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lazy-loading 'services' on Instance uuid 0ff6277c-b59e-467c-82d4-631046fb03d9 {{(pid=115748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:17:15.812213 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-494097f9-5e6b-40db-8702-90522359b46c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "DELETE /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments/23c26adc-b125-45d9-b8ba-8febe3ea4192" status: 202 len: 0 microversion: 2.1 time: 0.156057 Oct 29 01:17:15.812804 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 362/698] 10.222.0.90 () {58 vars in 1415 bytes} [Fri Oct 29 01:17:15 2021] DELETE /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments/23c26adc-b125-45d9-b8ba-8febe3ea4192 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:17:15.820876 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-221e081e-1409-43b5-91ff-e1484751b1e2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:15.821861 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-221e081e-1409-43b5-91ff-e1484751b1e2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:15.828771 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-221e081e-1409-43b5-91ff-e1484751b1e2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:15.829218 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-221e081e-1409-43b5-91ff-e1484751b1e2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:15.829989 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-221e081e-1409-43b5-91ff-e1484751b1e2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:15.830431 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-221e081e-1409-43b5-91ff-e1484751b1e2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:15.863338 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-221e081e-1409-43b5-91ff-e1484751b1e2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046116 Oct 29 01:17:15.863911 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 337/699] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:17:15 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:16.072931 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-cc04e22f-5cee-41d2-94bc-be4c73fb7e6c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:16.073628 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-cc04e22f-5cee-41d2-94bc-be4c73fb7e6c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:16.079979 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cc04e22f-5cee-41d2-94bc-be4c73fb7e6c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:16.080423 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cc04e22f-5cee-41d2-94bc-be4c73fb7e6c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:16.081222 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cc04e22f-5cee-41d2-94bc-be4c73fb7e6c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:16.081653 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cc04e22f-5cee-41d2-94bc-be4c73fb7e6c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:16.199680 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-cc04e22f-5cee-41d2-94bc-be4c73fb7e6c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:16.207136 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-cc04e22f-5cee-41d2-94bc-be4c73fb7e6c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1265 microversion: 2.1 time: 0.138198 Oct 29 01:17:16.207693 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 363/700] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:16 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1265 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:16.409338 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-5a2bdfa0-ba28-4152-aebb-81d8cbefd65d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:16.410242 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-5a2bdfa0-ba28-4152-aebb-81d8cbefd65d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:16.416417 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5a2bdfa0-ba28-4152-aebb-81d8cbefd65d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:16.416861 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5a2bdfa0-ba28-4152-aebb-81d8cbefd65d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:16.417620 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5a2bdfa0-ba28-4152-aebb-81d8cbefd65d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:16.418053 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5a2bdfa0-ba28-4152-aebb-81d8cbefd65d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:16.446677 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-5a2bdfa0-ba28-4152-aebb-81d8cbefd65d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041076 Oct 29 01:17:16.447229 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 338/701] 10.222.0.90 () {60 vars in 1342 bytes} [Fri Oct 29 01:17:16 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:17:16.875616 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-61991ff8-1ad4-44a7-86bb-da1fd04f9a87 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:16.876612 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-61991ff8-1ad4-44a7-86bb-da1fd04f9a87 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:16.882836 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-61991ff8-1ad4-44a7-86bb-da1fd04f9a87 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:16.883301 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-61991ff8-1ad4-44a7-86bb-da1fd04f9a87 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:16.884054 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-61991ff8-1ad4-44a7-86bb-da1fd04f9a87 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:16.884483 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-61991ff8-1ad4-44a7-86bb-da1fd04f9a87 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:16.912852 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-61991ff8-1ad4-44a7-86bb-da1fd04f9a87 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041589 Oct 29 01:17:16.913425 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 364/702] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:17:16 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:17.223403 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-e11a52f4-af65-4157-8fb1-b5cf4da2ce5f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:17.224046 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-e11a52f4-af65-4157-8fb1-b5cf4da2ce5f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:17.229883 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e11a52f4-af65-4157-8fb1-b5cf4da2ce5f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:17.230342 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e11a52f4-af65-4157-8fb1-b5cf4da2ce5f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:17.231174 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e11a52f4-af65-4157-8fb1-b5cf4da2ce5f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:17.232202 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e11a52f4-af65-4157-8fb1-b5cf4da2ce5f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:17.353424 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-e11a52f4-af65-4157-8fb1-b5cf4da2ce5f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:17.361247 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-e11a52f4-af65-4157-8fb1-b5cf4da2ce5f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1265 microversion: 2.1 time: 0.141496 Oct 29 01:17:17.361817 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 339/703] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:17 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1265 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:17.458049 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f429a1c5-81be-477b-9ecc-6a578ecaeeee tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:17.458941 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f429a1c5-81be-477b-9ecc-6a578ecaeeee tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:17.464938 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f429a1c5-81be-477b-9ecc-6a578ecaeeee tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:17.465371 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f429a1c5-81be-477b-9ecc-6a578ecaeeee tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:17.466632 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f429a1c5-81be-477b-9ecc-6a578ecaeeee tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:17.467076 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f429a1c5-81be-477b-9ecc-6a578ecaeeee tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:17.496351 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f429a1c5-81be-477b-9ecc-6a578ecaeeee tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042040 Oct 29 01:17:17.497038 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 365/704] 10.222.0.90 () {60 vars in 1342 bytes} [Fri Oct 29 01:17:17 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:17:17.924205 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-4b1e01e0-31c1-44b8-a4d5-6beaf3c3ffd2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:17.925125 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-4b1e01e0-31c1-44b8-a4d5-6beaf3c3ffd2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:17.931297 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4b1e01e0-31c1-44b8-a4d5-6beaf3c3ffd2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:17.931751 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4b1e01e0-31c1-44b8-a4d5-6beaf3c3ffd2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:17.932517 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4b1e01e0-31c1-44b8-a4d5-6beaf3c3ffd2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:17.932952 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4b1e01e0-31c1-44b8-a4d5-6beaf3c3ffd2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:17.963550 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-4b1e01e0-31c1-44b8-a4d5-6beaf3c3ffd2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043127 Oct 29 01:17:17.964127 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 340/705] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:17:17 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:18.378345 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-23912ebe-75eb-4021-a040-8c166a1395c2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:18.379004 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-23912ebe-75eb-4021-a040-8c166a1395c2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:18.385153 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-23912ebe-75eb-4021-a040-8c166a1395c2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:18.385595 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-23912ebe-75eb-4021-a040-8c166a1395c2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:18.386348 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-23912ebe-75eb-4021-a040-8c166a1395c2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:18.386803 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-23912ebe-75eb-4021-a040-8c166a1395c2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:18.502613 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-23912ebe-75eb-4021-a040-8c166a1395c2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:18.507742 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-db6d9c41-75b2-4f6e-abcf-95f9959e2362 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:18.508698 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-db6d9c41-75b2-4f6e-abcf-95f9959e2362 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:18.509926 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-23912ebe-75eb-4021-a040-8c166a1395c2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1265 microversion: 2.1 time: 0.135188 Oct 29 01:17:18.510733 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 366/706] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:18 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1265 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:18.514321 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-db6d9c41-75b2-4f6e-abcf-95f9959e2362 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:18.514794 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-db6d9c41-75b2-4f6e-abcf-95f9959e2362 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:18.515546 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-db6d9c41-75b2-4f6e-abcf-95f9959e2362 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:18.515968 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-db6d9c41-75b2-4f6e-abcf-95f9959e2362 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:18.544261 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-db6d9c41-75b2-4f6e-abcf-95f9959e2362 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039693 Oct 29 01:17:18.544803 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 341/707] 10.222.0.90 () {60 vars in 1342 bytes} [Fri Oct 29 01:17:18 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:17:18.726622 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [req-316c4590-396a-4ba2-b1b0-54e6c0769401 req-92c64380-c43e-431f-8748-c8224a75298c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11a30efc-58bb-4139-a2ca-1712680c7fde", "name": "network-vif-plugged", "status": "completed", "tag": "a1c1c487-5f02-4bbf-96cd-d6b3e55b076a"}]} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:18.728135 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:17:18.728135 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: warnings.warn(msg) Oct 29 01:17:18.736260 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-316c4590-396a-4ba2-b1b0-54e6c0769401 req-92c64380-c43e-431f-8748-c8224a75298c service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:18.736836 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-316c4590-396a-4ba2-b1b0-54e6c0769401 req-92c64380-c43e-431f-8748-c8224a75298c service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:18.749203 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.compute.server_external_events [req-316c4590-396a-4ba2-b1b0-54e6c0769401 req-92c64380-c43e-431f-8748-c8224a75298c service nova] Creating event network-vif-plugged:a1c1c487-5f02-4bbf-96cd-d6b3e55b076a for instance 11a30efc-58bb-4139-a2ca-1712680c7fde on hv-cinder-81558 Oct 29 01:17:18.755415 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [req-316c4590-396a-4ba2-b1b0-54e6c0769401 req-92c64380-c43e-431f-8748-c8224a75298c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032282 Oct 29 01:17:18.756347 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 367/708] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:17:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:17:18.976135 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-de9f6701-8254-466e-bb32-35ae100901bc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:18.977867 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-de9f6701-8254-466e-bb32-35ae100901bc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:18.985229 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-de9f6701-8254-466e-bb32-35ae100901bc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:18.985953 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-de9f6701-8254-466e-bb32-35ae100901bc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:18.986553 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-de9f6701-8254-466e-bb32-35ae100901bc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:18.986986 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-de9f6701-8254-466e-bb32-35ae100901bc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:19.015847 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-de9f6701-8254-466e-bb32-35ae100901bc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043708 Oct 29 01:17:19.016614 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 342/709] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:17:18 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:19.526874 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-13e437ea-af27-4ac4-b50b-f8a82e89397a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:19.527576 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-13e437ea-af27-4ac4-b50b-f8a82e89397a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:19.533991 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-13e437ea-af27-4ac4-b50b-f8a82e89397a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:19.534467 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-13e437ea-af27-4ac4-b50b-f8a82e89397a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:19.535232 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-13e437ea-af27-4ac4-b50b-f8a82e89397a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:19.535665 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-13e437ea-af27-4ac4-b50b-f8a82e89397a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:19.555945 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-fc6fcce9-e8dc-4340-8a7e-497d9e95bacb tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:19.556845 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-fc6fcce9-e8dc-4340-8a7e-497d9e95bacb tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:19.563052 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fc6fcce9-e8dc-4340-8a7e-497d9e95bacb tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:19.563491 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fc6fcce9-e8dc-4340-8a7e-497d9e95bacb tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:19.564240 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fc6fcce9-e8dc-4340-8a7e-497d9e95bacb tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:19.564667 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fc6fcce9-e8dc-4340-8a7e-497d9e95bacb tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:19.594235 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-fc6fcce9-e8dc-4340-8a7e-497d9e95bacb tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042039 Oct 29 01:17:19.594826 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 343/710] 10.222.0.90 () {60 vars in 1342 bytes} [Fri Oct 29 01:17:19 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:17:19.655613 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-13e437ea-af27-4ac4-b50b-f8a82e89397a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:19.662843 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-13e437ea-af27-4ac4-b50b-f8a82e89397a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1265 microversion: 2.1 time: 0.139994 Oct 29 01:17:19.663413 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 368/711] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:19 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1265 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:20.027387 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b7756222-6283-4c21-8dec-595647a6fd27 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:20.028413 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b7756222-6283-4c21-8dec-595647a6fd27 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:20.034621 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b7756222-6283-4c21-8dec-595647a6fd27 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:20.035064 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b7756222-6283-4c21-8dec-595647a6fd27 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:20.035820 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b7756222-6283-4c21-8dec-595647a6fd27 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:20.036246 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b7756222-6283-4c21-8dec-595647a6fd27 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:20.066667 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b7756222-6283-4c21-8dec-595647a6fd27 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043221 Oct 29 01:17:20.067234 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 344/712] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:17:20 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:20.605318 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-0819dd94-c694-4dec-80b4-432635db15e1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:20.606230 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-0819dd94-c694-4dec-80b4-432635db15e1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:20.612851 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0819dd94-c694-4dec-80b4-432635db15e1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:20.613383 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0819dd94-c694-4dec-80b4-432635db15e1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:20.614212 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0819dd94-c694-4dec-80b4-432635db15e1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:20.614711 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0819dd94-c694-4dec-80b4-432635db15e1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:20.645214 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-0819dd94-c694-4dec-80b4-432635db15e1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043735 Oct 29 01:17:20.645771 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 369/713] 10.222.0.90 () {60 vars in 1342 bytes} [Fri Oct 29 01:17:20 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:17:20.679204 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-e682e933-2a4a-46aa-9ae3-c8843a6c43cd tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:20.679800 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-e682e933-2a4a-46aa-9ae3-c8843a6c43cd tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:20.685406 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e682e933-2a4a-46aa-9ae3-c8843a6c43cd tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:20.685848 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e682e933-2a4a-46aa-9ae3-c8843a6c43cd tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:20.686627 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e682e933-2a4a-46aa-9ae3-c8843a6c43cd tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:20.687053 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e682e933-2a4a-46aa-9ae3-c8843a6c43cd tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:20.808066 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-e682e933-2a4a-46aa-9ae3-c8843a6c43cd tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:20.815428 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-e682e933-2a4a-46aa-9ae3-c8843a6c43cd tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1451 microversion: 2.1 time: 0.139830 Oct 29 01:17:20.815971 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 345/714] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:20 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1451 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:20.832096 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d6f36490-d862-4c79-8572-0a5ea0ae13fc tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:20.832703 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d6f36490-d862-4c79-8572-0a5ea0ae13fc tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:20.838476 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d6f36490-d862-4c79-8572-0a5ea0ae13fc tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:20.838927 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d6f36490-d862-4c79-8572-0a5ea0ae13fc tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:20.839687 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d6f36490-d862-4c79-8572-0a5ea0ae13fc tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:20.840117 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d6f36490-d862-4c79-8572-0a5ea0ae13fc tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:20.957796 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-d6f36490-d862-4c79-8572-0a5ea0ae13fc tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:20.965587 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d6f36490-d862-4c79-8572-0a5ea0ae13fc tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1451 microversion: 2.1 time: 0.137067 Oct 29 01:17:20.966156 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 370/715] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:20 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1451 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:21.079029 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-086256c2-37bb-4901-82f5-3e1d5ae2ee1f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:21.080273 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-086256c2-37bb-4901-82f5-3e1d5ae2ee1f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:21.086637 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-086256c2-37bb-4901-82f5-3e1d5ae2ee1f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:21.087168 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-086256c2-37bb-4901-82f5-3e1d5ae2ee1f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:21.088080 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-086256c2-37bb-4901-82f5-3e1d5ae2ee1f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:21.088586 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-086256c2-37bb-4901-82f5-3e1d5ae2ee1f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:21.122478 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-086256c2-37bb-4901-82f5-3e1d5ae2ee1f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047669 Oct 29 01:17:21.123052 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 346/716] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:17:21 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:21.657138 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d852c66c-b1df-46be-9e8d-22e4457d2ac1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:21.658043 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d852c66c-b1df-46be-9e8d-22e4457d2ac1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:21.664605 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d852c66c-b1df-46be-9e8d-22e4457d2ac1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:21.665061 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d852c66c-b1df-46be-9e8d-22e4457d2ac1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:21.665835 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d852c66c-b1df-46be-9e8d-22e4457d2ac1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:21.666270 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d852c66c-b1df-46be-9e8d-22e4457d2ac1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:21.696908 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d852c66c-b1df-46be-9e8d-22e4457d2ac1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044046 Oct 29 01:17:21.697491 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 371/717] 10.222.0.90 () {60 vars in 1342 bytes} [Fri Oct 29 01:17:21 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:17:22.133575 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-4eb23f61-4132-4c7a-816f-73a22378ebcf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:22.134661 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-4eb23f61-4132-4c7a-816f-73a22378ebcf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:22.142397 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4eb23f61-4132-4c7a-816f-73a22378ebcf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:22.142929 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4eb23f61-4132-4c7a-816f-73a22378ebcf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:22.143767 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4eb23f61-4132-4c7a-816f-73a22378ebcf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:22.144269 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4eb23f61-4132-4c7a-816f-73a22378ebcf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:22.181210 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-4eb23f61-4132-4c7a-816f-73a22378ebcf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050497 Oct 29 01:17:22.182309 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 347/718] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:17:22 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:22.676561 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-5abe9365-2048-4cef-824d-c4b84283945b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:22.677086 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-5abe9365-2048-4cef-824d-c4b84283945b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:22.683238 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5abe9365-2048-4cef-824d-c4b84283945b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:22.683679 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5abe9365-2048-4cef-824d-c4b84283945b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:22.685306 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5abe9365-2048-4cef-824d-c4b84283945b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:22.685735 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5abe9365-2048-4cef-824d-c4b84283945b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:22.708649 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-5b87a7dc-1412-4eec-9f1b-e7f84c57a8ef tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:22.709206 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.objects.instance [None req-5abe9365-2048-4cef-824d-c4b84283945b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lazy-loading 'flavor' on Instance uuid efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd {{(pid=115748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:17:22.709536 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-5b87a7dc-1412-4eec-9f1b-e7f84c57a8ef tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:22.715431 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5b87a7dc-1412-4eec-9f1b-e7f84c57a8ef tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:22.715869 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5b87a7dc-1412-4eec-9f1b-e7f84c57a8ef tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:22.716822 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5b87a7dc-1412-4eec-9f1b-e7f84c57a8ef tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:22.717264 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5b87a7dc-1412-4eec-9f1b-e7f84c57a8ef tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:22.747912 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-5b87a7dc-1412-4eec-9f1b-e7f84c57a8ef tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042380 Oct 29 01:17:22.754478 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 348/719] 10.222.0.90 () {60 vars in 1342 bytes} [Fri Oct 29 01:17:22 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:17:22.783455 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-5abe9365-2048-4cef-824d-c4b84283945b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "POST /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd/action" status: 202 len: 0 microversion: 2.1 time: 0.110589 Oct 29 01:17:22.784187 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 372/720] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:17:22 2021] POST /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:17:22.792240 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-05354b67-feae-4d1a-8df3-19ee49e93907 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:22.792997 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-05354b67-feae-4d1a-8df3-19ee49e93907 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:22.800500 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-05354b67-feae-4d1a-8df3-19ee49e93907 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:22.801222 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-05354b67-feae-4d1a-8df3-19ee49e93907 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:22.802005 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-05354b67-feae-4d1a-8df3-19ee49e93907 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:22.802452 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-05354b67-feae-4d1a-8df3-19ee49e93907 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:22.814977 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c47096bc-f5b9-4786-b6f2-064b93373509 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:22.815701 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c47096bc-f5b9-4786-b6f2-064b93373509 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:22.824854 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c47096bc-f5b9-4786-b6f2-064b93373509 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:22.825612 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c47096bc-f5b9-4786-b6f2-064b93373509 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:22.826379 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c47096bc-f5b9-4786-b6f2-064b93373509 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:22.826994 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c47096bc-f5b9-4786-b6f2-064b93373509 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:22.858001 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c47096bc-f5b9-4786-b6f2-064b93373509 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Going to try to terminate instance {{(pid=115748) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 01:17:22.936296 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c47096bc-f5b9-4786-b6f2-064b93373509 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "DELETE /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 204 len: 0 microversion: 2.20 time: 0.126919 Oct 29 01:17:22.936887 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 373/721] 10.222.0.90 () {60 vars in 1279 bytes} [Fri Oct 29 01:17:22 2021] DELETE /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 01:17:22.945779 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e1d91c71-52ed-41f3-9dbc-59ac720b1ac8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:22.946571 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-e1d91c71-52ed-41f3-9dbc-59ac720b1ac8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:22.961390 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e1d91c71-52ed-41f3-9dbc-59ac720b1ac8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:22.961390 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e1d91c71-52ed-41f3-9dbc-59ac720b1ac8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:22.961390 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e1d91c71-52ed-41f3-9dbc-59ac720b1ac8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:22.961390 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e1d91c71-52ed-41f3-9dbc-59ac720b1ac8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:23.032150 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-05354b67-feae-4d1a-8df3-19ee49e93907 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:23.039758 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-05354b67-feae-4d1a-8df3-19ee49e93907 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.251292 Oct 29 01:17:23.040322 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 349/722] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:22 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:23.158882 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-e1d91c71-52ed-41f3-9dbc-59ac720b1ac8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:23.177815 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-e1d91c71-52ed-41f3-9dbc-59ac720b1ac8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:23.177815 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-e1d91c71-52ed-41f3-9dbc-59ac720b1ac8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:23.177815 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-e1d91c71-52ed-41f3-9dbc-59ac720b1ac8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1723 microversion: 2.20 time: 0.230212 Oct 29 01:17:23.178066 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [req-8e1aaaa6-f0b3-4c71-9122-e2ad69f9d0da req-8b654bd8-e2fb-4377-8604-a9c566537a0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11a30efc-58bb-4139-a2ca-1712680c7fde", "tag": "a1c1c487-5f02-4bbf-96cd-d6b3e55b076a"}]} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:23.178066 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:17:23.178066 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: warnings.warn(msg) Oct 29 01:17:23.182493 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 374/723] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:17:22 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:17:23.184120 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-8e1aaaa6-f0b3-4c71-9122-e2ad69f9d0da req-8b654bd8-e2fb-4377-8604-a9c566537a0e service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:23.184898 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-8e1aaaa6-f0b3-4c71-9122-e2ad69f9d0da req-8b654bd8-e2fb-4377-8604-a9c566537a0e service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:23.193666 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d12a6664-1c53-46e7-ae0f-90be45965257 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:23.194580 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d12a6664-1c53-46e7-ae0f-90be45965257 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:23.196307 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.compute.server_external_events [req-8e1aaaa6-f0b3-4c71-9122-e2ad69f9d0da req-8b654bd8-e2fb-4377-8604-a9c566537a0e service nova] Creating event network-changed:a1c1c487-5f02-4bbf-96cd-d6b3e55b076a for instance 11a30efc-58bb-4139-a2ca-1712680c7fde on hv-cinder-81558 Oct 29 01:17:23.201415 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d12a6664-1c53-46e7-ae0f-90be45965257 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:23.201596 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [req-8e1aaaa6-f0b3-4c71-9122-e2ad69f9d0da req-8b654bd8-e2fb-4377-8604-a9c566537a0e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030913 Oct 29 01:17:23.202338 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d12a6664-1c53-46e7-ae0f-90be45965257 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:23.202805 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 350/724] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:17:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:17:23.203696 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d12a6664-1c53-46e7-ae0f-90be45965257 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:23.204240 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d12a6664-1c53-46e7-ae0f-90be45965257 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:23.234757 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d12a6664-1c53-46e7-ae0f-90be45965257 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045044 Oct 29 01:17:23.235322 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 375/725] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:17:23 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:17:24.057493 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9bfdce3d-c703-4b24-baee-5c3b28d705ec tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:24.058199 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9bfdce3d-c703-4b24-baee-5c3b28d705ec tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:24.065394 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9bfdce3d-c703-4b24-baee-5c3b28d705ec tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:24.065847 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9bfdce3d-c703-4b24-baee-5c3b28d705ec tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:24.066789 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9bfdce3d-c703-4b24-baee-5c3b28d705ec tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:24.067228 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9bfdce3d-c703-4b24-baee-5c3b28d705ec tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:24.190010 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-9bfdce3d-c703-4b24-baee-5c3b28d705ec tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:24.191831 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-923625c4-7f7a-43ee-a3ee-f4722cdf5d69 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:24.192570 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-923625c4-7f7a-43ee-a3ee-f4722cdf5d69 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:24.198455 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9bfdce3d-c703-4b24-baee-5c3b28d705ec tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.144931 Oct 29 01:17:24.198900 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-923625c4-7f7a-43ee-a3ee-f4722cdf5d69 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:24.199349 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-923625c4-7f7a-43ee-a3ee-f4722cdf5d69 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:24.200206 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-923625c4-7f7a-43ee-a3ee-f4722cdf5d69 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:24.201241 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-923625c4-7f7a-43ee-a3ee-f4722cdf5d69 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:24.208720 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 351/726] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:24 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:24.245833 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-145f312d-4575-4ffe-9b51-b93220cdb1d0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:24.246889 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-145f312d-4575-4ffe-9b51-b93220cdb1d0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:24.253918 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-145f312d-4575-4ffe-9b51-b93220cdb1d0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:24.254505 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-145f312d-4575-4ffe-9b51-b93220cdb1d0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:24.255292 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-145f312d-4575-4ffe-9b51-b93220cdb1d0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:24.255729 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-145f312d-4575-4ffe-9b51-b93220cdb1d0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:24.287688 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-145f312d-4575-4ffe-9b51-b93220cdb1d0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045766 Oct 29 01:17:24.288283 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 352/727] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:17:24 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:17:24.333025 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-923625c4-7f7a-43ee-a3ee-f4722cdf5d69 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:24.340644 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-923625c4-7f7a-43ee-a3ee-f4722cdf5d69 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:24.342161 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-923625c4-7f7a-43ee-a3ee-f4722cdf5d69 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:24.343400 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-923625c4-7f7a-43ee-a3ee-f4722cdf5d69 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1723 microversion: 2.20 time: 0.155921 Oct 29 01:17:24.343949 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 376/728] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:17:24 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:17:25.216979 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ddb3fc18-44ea-4907-b7d2-32c3756d9dd4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:25.217494 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ddb3fc18-44ea-4907-b7d2-32c3756d9dd4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:25.223701 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ddb3fc18-44ea-4907-b7d2-32c3756d9dd4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:25.224147 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ddb3fc18-44ea-4907-b7d2-32c3756d9dd4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:25.224942 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ddb3fc18-44ea-4907-b7d2-32c3756d9dd4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:25.225379 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ddb3fc18-44ea-4907-b7d2-32c3756d9dd4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:25.299177 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-38ece61d-14ed-4812-99ea-91ae3786fd0a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:25.300168 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-38ece61d-14ed-4812-99ea-91ae3786fd0a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:25.306412 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-38ece61d-14ed-4812-99ea-91ae3786fd0a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:25.306859 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-38ece61d-14ed-4812-99ea-91ae3786fd0a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:25.307626 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-38ece61d-14ed-4812-99ea-91ae3786fd0a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:25.308060 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-38ece61d-14ed-4812-99ea-91ae3786fd0a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:25.345327 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-38ece61d-14ed-4812-99ea-91ae3786fd0a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048207 Oct 29 01:17:25.345923 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 377/729] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:17:25 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:17:25.354311 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-ddb3fc18-44ea-4907-b7d2-32c3756d9dd4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:25.361738 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-bdf3ef25-7af4-4e08-88f6-011ce4a4e0ca tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:25.362059 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-bdf3ef25-7af4-4e08-88f6-011ce4a4e0ca tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:25.363094 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ddb3fc18-44ea-4907-b7d2-32c3756d9dd4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.150405 Oct 29 01:17:25.363671 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 353/730] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:25 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:25.371109 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bdf3ef25-7af4-4e08-88f6-011ce4a4e0ca tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:25.371563 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bdf3ef25-7af4-4e08-88f6-011ce4a4e0ca tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:25.372339 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bdf3ef25-7af4-4e08-88f6-011ce4a4e0ca tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:25.372877 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bdf3ef25-7af4-4e08-88f6-011ce4a4e0ca tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:25.501593 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-bdf3ef25-7af4-4e08-88f6-011ce4a4e0ca tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:25.509407 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-bdf3ef25-7af4-4e08-88f6-011ce4a4e0ca tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:25.510960 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-bdf3ef25-7af4-4e08-88f6-011ce4a4e0ca tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:25.512098 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-bdf3ef25-7af4-4e08-88f6-011ce4a4e0ca tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1723 microversion: 2.20 time: 0.155005 Oct 29 01:17:25.512650 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 378/731] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:17:25 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:17:26.356407 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d0f3c6a8-bf9e-46c1-8023-1658c0b00c33 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:26.357966 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d0f3c6a8-bf9e-46c1-8023-1658c0b00c33 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:26.364749 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d0f3c6a8-bf9e-46c1-8023-1658c0b00c33 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:26.365242 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d0f3c6a8-bf9e-46c1-8023-1658c0b00c33 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:26.366051 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d0f3c6a8-bf9e-46c1-8023-1658c0b00c33 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:26.366609 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d0f3c6a8-bf9e-46c1-8023-1658c0b00c33 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:26.380591 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-17ab8f5c-ef03-490b-8a6f-3a69eac099e3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:26.381450 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-17ab8f5c-ef03-490b-8a6f-3a69eac099e3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:26.388025 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-17ab8f5c-ef03-490b-8a6f-3a69eac099e3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:26.388809 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-17ab8f5c-ef03-490b-8a6f-3a69eac099e3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:26.389941 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-17ab8f5c-ef03-490b-8a6f-3a69eac099e3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:26.390362 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-17ab8f5c-ef03-490b-8a6f-3a69eac099e3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:26.400355 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d0f3c6a8-bf9e-46c1-8023-1658c0b00c33 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047625 Oct 29 01:17:26.404694 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 354/732] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:17:26 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:26.529623 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-17ab8f5c-ef03-490b-8a6f-3a69eac099e3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:26.533800 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-eb2a0963-ace9-4770-99f8-5544a5059069 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:26.535231 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-eb2a0963-ace9-4770-99f8-5544a5059069 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:26.537613 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-17ab8f5c-ef03-490b-8a6f-3a69eac099e3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.160814 Oct 29 01:17:26.543241 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-eb2a0963-ace9-4770-99f8-5544a5059069 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:26.544222 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-eb2a0963-ace9-4770-99f8-5544a5059069 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:26.544994 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-eb2a0963-ace9-4770-99f8-5544a5059069 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:26.545904 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-eb2a0963-ace9-4770-99f8-5544a5059069 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:26.547173 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 379/733] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:26 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:17:26.612401 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-eb2a0963-ace9-4770-99f8-5544a5059069 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:26.620700 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-eb2a0963-ace9-4770-99f8-5544a5059069 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:26.622239 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-eb2a0963-ace9-4770-99f8-5544a5059069 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:26.623524 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-eb2a0963-ace9-4770-99f8-5544a5059069 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 200 len: 1655 microversion: 2.20 time: 0.096195 Oct 29 01:17:26.624248 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 355/734] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:17:26 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 1655 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:26.728806 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [req-b1b1345c-a6ca-42cf-af3d-23a33803277a req-c88ac380-0c7d-485d-b39c-0cba109f4ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27a73464-dcac-4be6-a392-58d40a0296a8", "name": "network-vif-deleted", "tag": "f3a5c6a4-eba2-4bfd-91f6-59386b7c88e8"}]} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:26.730304 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:17:26.730304 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: warnings.warn(msg) Oct 29 01:17:26.738415 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-b1b1345c-a6ca-42cf-af3d-23a33803277a req-c88ac380-0c7d-485d-b39c-0cba109f4ae8 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:26.738978 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-b1b1345c-a6ca-42cf-af3d-23a33803277a req-c88ac380-0c7d-485d-b39c-0cba109f4ae8 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:26.752187 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.compute.server_external_events [req-b1b1345c-a6ca-42cf-af3d-23a33803277a req-c88ac380-0c7d-485d-b39c-0cba109f4ae8 service nova] Creating event network-vif-deleted:f3a5c6a4-eba2-4bfd-91f6-59386b7c88e8 for instance 27a73464-dcac-4be6-a392-58d40a0296a8 on hv-cinder-81558 Oct 29 01:17:26.757242 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [req-b1b1345c-a6ca-42cf-af3d-23a33803277a req-c88ac380-0c7d-485d-b39c-0cba109f4ae8 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032020 Oct 29 01:17:26.757920 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 380/735] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:17:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:27.412836 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-4bf0cbbd-c57e-4591-a040-97d0eee9d2bf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:27.415539 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-4bf0cbbd-c57e-4591-a040-97d0eee9d2bf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:27.423838 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4bf0cbbd-c57e-4591-a040-97d0eee9d2bf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:27.424908 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4bf0cbbd-c57e-4591-a040-97d0eee9d2bf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:27.425850 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4bf0cbbd-c57e-4591-a040-97d0eee9d2bf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:27.426878 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4bf0cbbd-c57e-4591-a040-97d0eee9d2bf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:27.467852 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-4bf0cbbd-c57e-4591-a040-97d0eee9d2bf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059088 Oct 29 01:17:27.472271 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 356/736] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:17:27 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:27.555365 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2e277a5b-4a57-41a4-a44d-2f57c4f55cd9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:27.556058 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2e277a5b-4a57-41a4-a44d-2f57c4f55cd9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:27.563033 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2e277a5b-4a57-41a4-a44d-2f57c4f55cd9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:27.563541 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2e277a5b-4a57-41a4-a44d-2f57c4f55cd9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:27.564308 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2e277a5b-4a57-41a4-a44d-2f57c4f55cd9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:27.564733 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2e277a5b-4a57-41a4-a44d-2f57c4f55cd9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:27.641470 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-978fccab-a20f-4b97-818e-735acb28545c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:27.642196 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-978fccab-a20f-4b97-818e-735acb28545c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:27.648614 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-978fccab-a20f-4b97-818e-735acb28545c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:27.649345 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-978fccab-a20f-4b97-818e-735acb28545c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:27.650327 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-978fccab-a20f-4b97-818e-735acb28545c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:27.651239 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-978fccab-a20f-4b97-818e-735acb28545c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:27.671312 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.wsgi [None req-978fccab-a20f-4b97-818e-735acb28545c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] HTTP exception thrown: Instance 27a73464-dcac-4be6-a392-58d40a0296a8 could not be found. Oct 29 01:17:27.671914 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-978fccab-a20f-4b97-818e-735acb28545c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Returning 404 to user: Instance 27a73464-dcac-4be6-a392-58d40a0296a8 could not be found. {{(pid=115747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:17:27.672768 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-978fccab-a20f-4b97-818e-735acb28545c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 404 len: 111 microversion: 2.20 time: 0.035452 Oct 29 01:17:27.673279 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 357/737] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:17:27 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 29 01:17:27.683138 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-92991ec3-7fff-45b7-893d-fb9b91d46c5c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '.version_select at 0x7f6029d2d280>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:27.719480 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-2e277a5b-4a57-41a4-a44d-2f57c4f55cd9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:27.728248 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2e277a5b-4a57-41a4-a44d-2f57c4f55cd9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.177346 Oct 29 01:17:27.729529 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 381/738] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:27 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:27.745568 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-92991ec3-7fff-45b7-893d-fb9b91d46c5c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1520794761" status: 204 len: 0 microversion: 2.20 time: 0.066128 Oct 29 01:17:27.751795 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 358/739] 10.222.0.90 () {60 vars in 1261 bytes} [Fri Oct 29 01:17:27 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1520794761 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 01:17:28.431471 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-ae6f34ee-53cb-4833-a206-4a04c56b9af5 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'create', calling method: .version_select at 0x7f602937c4c0>, body: {"keypair": {"name": "tempest-keypair-910147812"}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:28.448291 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.quota [None req-ae6f34ee-53cb-4833-a206-4a04c56b9af5 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Getting quotas for project 0da5b2a4f59a412d95c116ace173e394. Resources: {'key_pairs'} {{(pid=115748) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:17:28.452019 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.quota [None req-ae6f34ee-53cb-4833-a206-4a04c56b9af5 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Getting quotas for user 5bca27fde6ce471d900a7de497f487f6 and project 0da5b2a4f59a412d95c116ace173e394. Resources: {'key_pairs'} {{(pid=115748) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:17:28.479128 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-41b3c91b-6a00-4ad1-9189-28630dfbf137 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:28.480786 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-41b3c91b-6a00-4ad1-9189-28630dfbf137 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:28.488287 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-41b3c91b-6a00-4ad1-9189-28630dfbf137 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:28.488738 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-41b3c91b-6a00-4ad1-9189-28630dfbf137 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:28.489507 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-41b3c91b-6a00-4ad1-9189-28630dfbf137 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:28.489950 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-41b3c91b-6a00-4ad1-9189-28630dfbf137 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:28.517653 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-41b3c91b-6a00-4ad1-9189-28630dfbf137 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042833 Oct 29 01:17:28.518199 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 359/740] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:17:28 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:17:28.555093 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.quota [None req-ae6f34ee-53cb-4833-a206-4a04c56b9af5 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Getting quotas for project 0da5b2a4f59a412d95c116ace173e394. Resources: {'key_pairs'} {{(pid=115748) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:17:28.558817 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.quota [None req-ae6f34ee-53cb-4833-a206-4a04c56b9af5 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Getting quotas for user 5bca27fde6ce471d900a7de497f487f6 and project 0da5b2a4f59a412d95c116ace173e394. Resources: {'key_pairs'} {{(pid=115748) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:17:28.571345 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-ae6f34ee-53cb-4833-a206-4a04c56b9af5 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.143567 Oct 29 01:17:28.571929 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 382/741] 10.222.0.90 () {62 vars in 1198 bytes} [Fri Oct 29 01:17:28 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 145 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Oct 29 01:17:28.745192 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-80a73617-1a1e-40c2-a281-9bc3635d1564 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:28.745810 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-80a73617-1a1e-40c2-a281-9bc3635d1564 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:28.751581 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-80a73617-1a1e-40c2-a281-9bc3635d1564 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:28.752026 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-80a73617-1a1e-40c2-a281-9bc3635d1564 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:28.752792 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-80a73617-1a1e-40c2-a281-9bc3635d1564 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:28.753223 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-80a73617-1a1e-40c2-a281-9bc3635d1564 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:28.935551 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-80a73617-1a1e-40c2-a281-9bc3635d1564 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:28.943139 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-80a73617-1a1e-40c2-a281-9bc3635d1564 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.201519 Oct 29 01:17:28.943797 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 360/742] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:28 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:29.529154 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d322e2d2-2af8-47c7-ad41-a67d31bba0c3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:29.530065 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d322e2d2-2af8-47c7-ad41-a67d31bba0c3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:29.536138 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d322e2d2-2af8-47c7-ad41-a67d31bba0c3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:29.536591 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d322e2d2-2af8-47c7-ad41-a67d31bba0c3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:29.537354 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d322e2d2-2af8-47c7-ad41-a67d31bba0c3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:29.537790 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d322e2d2-2af8-47c7-ad41-a67d31bba0c3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:29.571834 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d322e2d2-2af8-47c7-ad41-a67d31bba0c3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046559 Oct 29 01:17:29.572719 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 383/743] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:17:29 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:29.892991 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-af13969d-11f5-4765-8919-a4162769d2c3 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1528004017", "imageRef": "3fef3f0d-d772-4999-b764-d6690634a06d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7752f1e5-4ffa-49a3-bdd2-70599dc227a3"}], "security_groups": [{"name": "tempest-securitygroup--1310836096"}], "key_name": "tempest-keypair-910147812", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:29.960853 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-fe10a7e9-c7ca-4681-9c5f-a6af513980a2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:29.961725 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-fe10a7e9-c7ca-4681-9c5f-a6af513980a2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:29.969688 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fe10a7e9-c7ca-4681-9c5f-a6af513980a2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:29.970125 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fe10a7e9-c7ca-4681-9c5f-a6af513980a2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:29.970949 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fe10a7e9-c7ca-4681-9c5f-a6af513980a2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:29.971534 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fe10a7e9-c7ca-4681-9c5f-a6af513980a2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:29.996113 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.network.neutron [None req-af13969d-11f5-4765-8919-a4162769d2c3 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] validate_networks() for [('7752f1e5-4ffa-49a3-bdd2-70599dc227a3', None, None, None, None, None)] {{(pid=115747) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 01:17:30.283519 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-fe10a7e9-c7ca-4681-9c5f-a6af513980a2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:30.291518 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-fe10a7e9-c7ca-4681-9c5f-a6af513980a2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.334284 Oct 29 01:17:30.292253 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 384/744] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:29 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:17:30.534632 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-af13969d-11f5-4765-8919-a4162769d2c3 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Flavor limits 0:0:0 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:17:30.535224 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-af13969d-11f5-4765-8919-a4162769d2c3 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Image limits 0:0:0 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:17:30.535693 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-af13969d-11f5-4765-8919-a4162769d2c3 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Flavor pref 0:0:0 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:17:30.536097 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-af13969d-11f5-4765-8919-a4162769d2c3 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Image pref 0:0:0 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:17:30.536502 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-af13969d-11f5-4765-8919-a4162769d2c3 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:17:30.545250 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-af13969d-11f5-4765-8919-a4162769d2c3 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:30.545695 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-af13969d-11f5-4765-8919-a4162769d2c3 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:30.546541 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-af13969d-11f5-4765-8919-a4162769d2c3 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:30.546973 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-af13969d-11f5-4765-8919-a4162769d2c3 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:30.563536 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.quota [None req-af13969d-11f5-4765-8919-a4162769d2c3 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Getting quotas for project 0da5b2a4f59a412d95c116ace173e394. Resources: {'instances', 'cores', 'ram'} {{(pid=115747) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:17:30.567852 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.quota [None req-af13969d-11f5-4765-8919-a4162769d2c3 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Getting quotas for user 5bca27fde6ce471d900a7de497f487f6 and project 0da5b2a4f59a412d95c116ace173e394. Resources: {'instances', 'cores', 'ram'} {{(pid=115747) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:17:30.579943 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-af13969d-11f5-4765-8919-a4162769d2c3 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Going to run 1 instances... {{(pid=115747) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 01:17:30.582532 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-af13969d-11f5-4765-8919-a4162769d2c3 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3fef3f0d-d772-4999-b764-d6690634a06d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 01:17:30.584596 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e9f71c9e-0fa9-475b-b17c-e4f7515fb7f5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:30.585678 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-e9f71c9e-0fa9-475b-b17c-e4f7515fb7f5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:30.596181 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e9f71c9e-0fa9-475b-b17c-e4f7515fb7f5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:30.597217 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e9f71c9e-0fa9-475b-b17c-e4f7515fb7f5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:30.598128 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e9f71c9e-0fa9-475b-b17c-e4f7515fb7f5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:30.598882 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e9f71c9e-0fa9-475b-b17c-e4f7515fb7f5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:30.634874 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-af13969d-11f5-4765-8919-a4162769d2c3 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.747630 Oct 29 01:17:30.635830 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 361/745] 10.222.0.90 () {62 vars in 1187 bytes} [Fri Oct 29 01:17:29 2021] POST /compute/v2.1/servers => generated 402 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 01:17:30.644682 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-e9f71c9e-0fa9-475b-b17c-e4f7515fb7f5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064071 Oct 29 01:17:30.648729 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 385/746] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:17:30 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:17:30.648887 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-e7574ab6-6fe0-4f07-82d6-a290324b0e0d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:30.648887 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-e7574ab6-6fe0-4f07-82d6-a290324b0e0d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:30.706519 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-e7574ab6-6fe0-4f07-82d6-a290324b0e0d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:30.714157 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-e7574ab6-6fe0-4f07-82d6-a290324b0e0d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:30.715759 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-e7574ab6-6fe0-4f07-82d6-a290324b0e0d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:30.716935 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-e7574ab6-6fe0-4f07-82d6-a290324b0e0d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e" status: 200 len: 1281 microversion: 2.20 time: 0.072763 Oct 29 01:17:30.717511 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 362/747] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:17:30 2021] GET /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e => generated 1281 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:31.309115 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-916af061-919e-4be0-ab88-30216454a203 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:31.309727 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-916af061-919e-4be0-ab88-30216454a203 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:31.316722 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-916af061-919e-4be0-ab88-30216454a203 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:31.317178 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-916af061-919e-4be0-ab88-30216454a203 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:31.317947 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-916af061-919e-4be0-ab88-30216454a203 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:31.318604 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-916af061-919e-4be0-ab88-30216454a203 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:31.443124 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-916af061-919e-4be0-ab88-30216454a203 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:31.450493 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-916af061-919e-4be0-ab88-30216454a203 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.145041 Oct 29 01:17:31.451058 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 386/748] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:31 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:31.656362 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-272e6abb-f150-452c-9ef5-f84e959852e0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:31.657331 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-272e6abb-f150-452c-9ef5-f84e959852e0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:31.664152 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-272e6abb-f150-452c-9ef5-f84e959852e0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:31.664659 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-272e6abb-f150-452c-9ef5-f84e959852e0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:31.665413 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-272e6abb-f150-452c-9ef5-f84e959852e0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:31.665844 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-272e6abb-f150-452c-9ef5-f84e959852e0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:31.697076 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-272e6abb-f150-452c-9ef5-f84e959852e0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044827 Oct 29 01:17:31.697768 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 363/749] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:17:31 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:31.734737 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-8815e155-4128-4806-9c18-c0f2d939b603 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:31.735341 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-8815e155-4128-4806-9c18-c0f2d939b603 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:31.741680 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8815e155-4128-4806-9c18-c0f2d939b603 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:31.742118 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8815e155-4128-4806-9c18-c0f2d939b603 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:31.742955 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8815e155-4128-4806-9c18-c0f2d939b603 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:31.743427 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8815e155-4128-4806-9c18-c0f2d939b603 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:31.811973 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-8815e155-4128-4806-9c18-c0f2d939b603 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:31.821001 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-8815e155-4128-4806-9c18-c0f2d939b603 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:31.822631 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-8815e155-4128-4806-9c18-c0f2d939b603 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:31.824038 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-8815e155-4128-4806-9c18-c0f2d939b603 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e" status: 200 len: 1341 microversion: 2.20 time: 0.093642 Oct 29 01:17:31.824796 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 387/750] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:17:31 2021] GET /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e => generated 1341 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:32.469692 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c029ff17-1451-4960-9be6-c1acfdaf0cac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:32.469932 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c029ff17-1451-4960-9be6-c1acfdaf0cac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:32.476284 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c029ff17-1451-4960-9be6-c1acfdaf0cac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:32.476782 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c029ff17-1451-4960-9be6-c1acfdaf0cac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:32.477603 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c029ff17-1451-4960-9be6-c1acfdaf0cac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:32.478084 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c029ff17-1451-4960-9be6-c1acfdaf0cac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:32.611463 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c029ff17-1451-4960-9be6-c1acfdaf0cac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:32.619480 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c029ff17-1451-4960-9be6-c1acfdaf0cac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.153821 Oct 29 01:17:32.620072 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 364/751] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:32 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:17:32.708639 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-703ea5bf-f50f-4698-88a4-2fd2a4cc0294 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:32.709797 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-703ea5bf-f50f-4698-88a4-2fd2a4cc0294 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:32.717639 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-703ea5bf-f50f-4698-88a4-2fd2a4cc0294 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:32.718330 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-703ea5bf-f50f-4698-88a4-2fd2a4cc0294 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:32.719494 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-703ea5bf-f50f-4698-88a4-2fd2a4cc0294 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:32.720008 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-703ea5bf-f50f-4698-88a4-2fd2a4cc0294 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:32.751780 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-703ea5bf-f50f-4698-88a4-2fd2a4cc0294 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046906 Oct 29 01:17:32.755688 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 388/752] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:17:32 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:32.843830 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ff103c90-e6dd-40fa-b9ed-9d502dbaf039 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:32.844431 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ff103c90-e6dd-40fa-b9ed-9d502dbaf039 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:32.850637 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ff103c90-e6dd-40fa-b9ed-9d502dbaf039 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:32.851080 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ff103c90-e6dd-40fa-b9ed-9d502dbaf039 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:32.851840 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ff103c90-e6dd-40fa-b9ed-9d502dbaf039 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:32.852587 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ff103c90-e6dd-40fa-b9ed-9d502dbaf039 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:32.983964 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-ff103c90-e6dd-40fa-b9ed-9d502dbaf039 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:32.996982 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-ff103c90-e6dd-40fa-b9ed-9d502dbaf039 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:32.999823 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-ff103c90-e6dd-40fa-b9ed-9d502dbaf039 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:33.001114 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ff103c90-e6dd-40fa-b9ed-9d502dbaf039 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e" status: 200 len: 1407 microversion: 2.20 time: 0.161670 Oct 29 01:17:33.002334 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 365/753] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:17:32 2021] GET /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:33.213210 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [req-01da2f82-f306-4ab5-a2f4-5da32a3a2ad1 req-61c4a201-244e-451f-8557-815144a1439b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88c93e0a-61e3-441e-966d-68099633969e", "tag": "e9f39300-bc57-4560-8d70-a8ff52c182b0"}]} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:33.215676 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:17:33.215676 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: warnings.warn(msg) Oct 29 01:17:33.223779 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-01da2f82-f306-4ab5-a2f4-5da32a3a2ad1 req-61c4a201-244e-451f-8557-815144a1439b service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:33.224687 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-01da2f82-f306-4ab5-a2f4-5da32a3a2ad1 req-61c4a201-244e-451f-8557-815144a1439b service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:33.237328 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.compute.server_external_events [req-01da2f82-f306-4ab5-a2f4-5da32a3a2ad1 req-61c4a201-244e-451f-8557-815144a1439b service nova] Creating event network-changed:e9f39300-bc57-4560-8d70-a8ff52c182b0 for instance 88c93e0a-61e3-441e-966d-68099633969e on hv-cinder-81558 Oct 29 01:17:33.243471 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [req-01da2f82-f306-4ab5-a2f4-5da32a3a2ad1 req-61c4a201-244e-451f-8557-815144a1439b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033846 Oct 29 01:17:33.244156 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 389/754] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:17:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:17:33.637703 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a13e2bc4-c318-45b3-9434-1e6faa58c190 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:33.638374 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a13e2bc4-c318-45b3-9434-1e6faa58c190 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:33.644883 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a13e2bc4-c318-45b3-9434-1e6faa58c190 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:33.645334 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a13e2bc4-c318-45b3-9434-1e6faa58c190 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:33.646208 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a13e2bc4-c318-45b3-9434-1e6faa58c190 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:33.646743 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a13e2bc4-c318-45b3-9434-1e6faa58c190 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:33.764501 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-de6eafea-f75c-4f6e-9b4a-7ce104bfc855 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:33.765645 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-de6eafea-f75c-4f6e-9b4a-7ce104bfc855 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:33.772573 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-de6eafea-f75c-4f6e-9b4a-7ce104bfc855 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:33.773129 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-de6eafea-f75c-4f6e-9b4a-7ce104bfc855 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:33.774010 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-de6eafea-f75c-4f6e-9b4a-7ce104bfc855 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:33.774541 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-de6eafea-f75c-4f6e-9b4a-7ce104bfc855 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:33.786494 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-a13e2bc4-c318-45b3-9434-1e6faa58c190 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:33.794317 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a13e2bc4-c318-45b3-9434-1e6faa58c190 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.161388 Oct 29 01:17:33.795655 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 366/755] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:33 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:33.808449 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-de6eafea-f75c-4f6e-9b4a-7ce104bfc855 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048902 Oct 29 01:17:33.809013 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 390/756] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:17:33 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:17:34.020049 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-756504ea-9b7e-47c5-ada3-2a1ca84fbc73 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:34.020659 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-756504ea-9b7e-47c5-ada3-2a1ca84fbc73 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:34.026575 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-756504ea-9b7e-47c5-ada3-2a1ca84fbc73 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:34.027033 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-756504ea-9b7e-47c5-ada3-2a1ca84fbc73 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:34.028447 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-756504ea-9b7e-47c5-ada3-2a1ca84fbc73 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:34.029498 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-756504ea-9b7e-47c5-ada3-2a1ca84fbc73 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:34.149460 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-756504ea-9b7e-47c5-ada3-2a1ca84fbc73 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:34.158013 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-756504ea-9b7e-47c5-ada3-2a1ca84fbc73 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:34.159652 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-756504ea-9b7e-47c5-ada3-2a1ca84fbc73 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:34.160832 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-756504ea-9b7e-47c5-ada3-2a1ca84fbc73 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e" status: 200 len: 1407 microversion: 2.20 time: 0.144861 Oct 29 01:17:34.161457 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 367/757] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:17:34 2021] GET /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e => generated 1407 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:34.814718 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-3e12d74f-0f8c-41ad-ad45-36ebc719fe02 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:34.814718 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-3e12d74f-0f8c-41ad-ad45-36ebc719fe02 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:34.819668 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-7ed0faec-e536-4594-b152-a29d00cda729 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:34.820176 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3e12d74f-0f8c-41ad-ad45-36ebc719fe02 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:34.820613 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-7ed0faec-e536-4594-b152-a29d00cda729 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:34.820723 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3e12d74f-0f8c-41ad-ad45-36ebc719fe02 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:34.821379 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3e12d74f-0f8c-41ad-ad45-36ebc719fe02 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:34.821809 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3e12d74f-0f8c-41ad-ad45-36ebc719fe02 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:34.827652 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7ed0faec-e536-4594-b152-a29d00cda729 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:34.828096 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7ed0faec-e536-4594-b152-a29d00cda729 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:34.829133 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7ed0faec-e536-4594-b152-a29d00cda729 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:34.829565 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7ed0faec-e536-4594-b152-a29d00cda729 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:34.860968 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-7ed0faec-e536-4594-b152-a29d00cda729 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044923 Oct 29 01:17:34.861525 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 368/758] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:17:34 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:17:34.943497 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-3e12d74f-0f8c-41ad-ad45-36ebc719fe02 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:34.951057 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-3e12d74f-0f8c-41ad-ad45-36ebc719fe02 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.141870 Oct 29 01:17:34.951589 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 391/759] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:34 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:35.178655 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-affeeeb1-2511-4243-8724-aac922e8bb05 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:35.179263 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-affeeeb1-2511-4243-8724-aac922e8bb05 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:35.185245 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-affeeeb1-2511-4243-8724-aac922e8bb05 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:35.185690 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-affeeeb1-2511-4243-8724-aac922e8bb05 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:35.186470 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-affeeeb1-2511-4243-8724-aac922e8bb05 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:35.186964 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-affeeeb1-2511-4243-8724-aac922e8bb05 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:35.310835 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-affeeeb1-2511-4243-8724-aac922e8bb05 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:35.318706 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-affeeeb1-2511-4243-8724-aac922e8bb05 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:35.320186 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-affeeeb1-2511-4243-8724-aac922e8bb05 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:35.321264 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-affeeeb1-2511-4243-8724-aac922e8bb05 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e" status: 200 len: 1407 microversion: 2.20 time: 0.146627 Oct 29 01:17:35.321814 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 369/760] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:17:35 2021] GET /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e => generated 1407 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:35.872336 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-79801001-fa02-4e0d-bfab-fd46916882f8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:35.873251 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-79801001-fa02-4e0d-bfab-fd46916882f8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:35.879507 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-79801001-fa02-4e0d-bfab-fd46916882f8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:35.879954 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-79801001-fa02-4e0d-bfab-fd46916882f8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:35.880711 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-79801001-fa02-4e0d-bfab-fd46916882f8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:35.881144 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-79801001-fa02-4e0d-bfab-fd46916882f8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:35.909946 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-79801001-fa02-4e0d-bfab-fd46916882f8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041336 Oct 29 01:17:35.910519 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 392/761] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:17:35 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:35.968371 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f6286604-02f5-4277-a4de-45da224eae26 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:35.969026 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f6286604-02f5-4277-a4de-45da224eae26 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:35.975257 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f6286604-02f5-4277-a4de-45da224eae26 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:35.975692 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f6286604-02f5-4277-a4de-45da224eae26 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:35.976500 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f6286604-02f5-4277-a4de-45da224eae26 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:35.976881 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f6286604-02f5-4277-a4de-45da224eae26 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:36.102751 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-f6286604-02f5-4277-a4de-45da224eae26 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:36.109983 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f6286604-02f5-4277-a4de-45da224eae26 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.145354 Oct 29 01:17:36.110577 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 370/762] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:35 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:36.339125 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-8386af14-e94d-49e5-bd5f-63aa1b3825e8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:36.339636 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-8386af14-e94d-49e5-bd5f-63aa1b3825e8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:36.346035 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8386af14-e94d-49e5-bd5f-63aa1b3825e8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:36.346506 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8386af14-e94d-49e5-bd5f-63aa1b3825e8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:36.347262 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8386af14-e94d-49e5-bd5f-63aa1b3825e8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:36.347687 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8386af14-e94d-49e5-bd5f-63aa1b3825e8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:36.467547 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-8386af14-e94d-49e5-bd5f-63aa1b3825e8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:36.475864 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-8386af14-e94d-49e5-bd5f-63aa1b3825e8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:36.477354 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-8386af14-e94d-49e5-bd5f-63aa1b3825e8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:36.478461 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-8386af14-e94d-49e5-bd5f-63aa1b3825e8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e" status: 200 len: 1407 microversion: 2.20 time: 0.143110 Oct 29 01:17:36.479016 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 393/763] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:17:36 2021] GET /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e => generated 1407 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:36.921087 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d19b0dac-4ac1-403c-9b2c-53a4ee5e7cfa tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:36.921931 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d19b0dac-4ac1-403c-9b2c-53a4ee5e7cfa tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:36.927702 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d19b0dac-4ac1-403c-9b2c-53a4ee5e7cfa tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:36.928146 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d19b0dac-4ac1-403c-9b2c-53a4ee5e7cfa tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:36.928919 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d19b0dac-4ac1-403c-9b2c-53a4ee5e7cfa tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:36.929347 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d19b0dac-4ac1-403c-9b2c-53a4ee5e7cfa tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:36.959725 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d19b0dac-4ac1-403c-9b2c-53a4ee5e7cfa tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042492 Oct 29 01:17:36.960507 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 371/764] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:17:36 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:37.127994 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-027ede56-0c44-414d-b629-320cf2c42602 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:37.128645 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-027ede56-0c44-414d-b629-320cf2c42602 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:37.135171 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-027ede56-0c44-414d-b629-320cf2c42602 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:37.135617 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-027ede56-0c44-414d-b629-320cf2c42602 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:37.136402 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-027ede56-0c44-414d-b629-320cf2c42602 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:37.136828 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-027ede56-0c44-414d-b629-320cf2c42602 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:37.368838 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-027ede56-0c44-414d-b629-320cf2c42602 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:37.376693 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-027ede56-0c44-414d-b629-320cf2c42602 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.252625 Oct 29 01:17:37.377268 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 394/765] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:37 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:37.496342 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-5f2066bf-20be-4d53-be21-03e28ab6efac tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:37.497074 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-5f2066bf-20be-4d53-be21-03e28ab6efac tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:37.503619 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5f2066bf-20be-4d53-be21-03e28ab6efac tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:37.504071 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5f2066bf-20be-4d53-be21-03e28ab6efac tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:37.504832 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5f2066bf-20be-4d53-be21-03e28ab6efac tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:37.505268 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5f2066bf-20be-4d53-be21-03e28ab6efac tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:37.718284 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-5f2066bf-20be-4d53-be21-03e28ab6efac tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:37.731290 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-5f2066bf-20be-4d53-be21-03e28ab6efac tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:37.733882 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-5f2066bf-20be-4d53-be21-03e28ab6efac tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:37.735750 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-5f2066bf-20be-4d53-be21-03e28ab6efac tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e" status: 200 len: 1407 microversion: 2.20 time: 0.242955 Oct 29 01:17:37.736642 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 372/766] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:17:37 2021] GET /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e => generated 1407 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:37.973467 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-b1a52e68-ff42-4983-81cf-7d61b40e1c6b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:37.974783 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-b1a52e68-ff42-4983-81cf-7d61b40e1c6b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:37.982012 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b1a52e68-ff42-4983-81cf-7d61b40e1c6b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:37.982556 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b1a52e68-ff42-4983-81cf-7d61b40e1c6b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:37.983377 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b1a52e68-ff42-4983-81cf-7d61b40e1c6b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:37.983863 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b1a52e68-ff42-4983-81cf-7d61b40e1c6b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:38.016051 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-b1a52e68-ff42-4983-81cf-7d61b40e1c6b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047198 Oct 29 01:17:38.016528 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 395/767] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:17:37 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:38.395644 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-18ab4b14-f5c1-4683-b3e6-d5d8e1c20992 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:38.396553 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-18ab4b14-f5c1-4683-b3e6-d5d8e1c20992 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:38.402016 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-18ab4b14-f5c1-4683-b3e6-d5d8e1c20992 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:38.402495 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-18ab4b14-f5c1-4683-b3e6-d5d8e1c20992 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:38.403266 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-18ab4b14-f5c1-4683-b3e6-d5d8e1c20992 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:38.403689 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-18ab4b14-f5c1-4683-b3e6-d5d8e1c20992 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:38.534932 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-18ab4b14-f5c1-4683-b3e6-d5d8e1c20992 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:38.542433 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-18ab4b14-f5c1-4683-b3e6-d5d8e1c20992 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.152571 Oct 29 01:17:38.543010 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 373/768] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:38 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:38.761133 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e561b436-0814-4e3a-bd74-b5c9be847202 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:38.761910 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-e561b436-0814-4e3a-bd74-b5c9be847202 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:38.772540 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e561b436-0814-4e3a-bd74-b5c9be847202 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:38.773349 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e561b436-0814-4e3a-bd74-b5c9be847202 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:38.774750 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e561b436-0814-4e3a-bd74-b5c9be847202 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:38.775522 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e561b436-0814-4e3a-bd74-b5c9be847202 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:38.856546 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [req-51806ff2-cc49-4772-829e-bde53b66079d req-3d19b9db-a187-4885-908e-c553d9062057 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88c93e0a-61e3-441e-966d-68099633969e", "name": "network-vif-plugged", "status": "completed", "tag": "e9f39300-bc57-4560-8d70-a8ff52c182b0"}]} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:38.861908 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:17:38.861908 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: warnings.warn(msg) Oct 29 01:17:38.874369 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-51806ff2-cc49-4772-829e-bde53b66079d req-3d19b9db-a187-4885-908e-c553d9062057 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:38.874949 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-51806ff2-cc49-4772-829e-bde53b66079d req-3d19b9db-a187-4885-908e-c553d9062057 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:38.886618 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.compute.server_external_events [req-51806ff2-cc49-4772-829e-bde53b66079d req-3d19b9db-a187-4885-908e-c553d9062057 service nova] Creating event network-vif-plugged:e9f39300-bc57-4560-8d70-a8ff52c182b0 for instance 88c93e0a-61e3-441e-966d-68099633969e on hv-cinder-81558 Oct 29 01:17:38.892080 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [req-51806ff2-cc49-4772-829e-bde53b66079d req-3d19b9db-a187-4885-908e-c553d9062057 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043728 Oct 29 01:17:38.892966 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 374/769] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:17:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:38.924662 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-e561b436-0814-4e3a-bd74-b5c9be847202 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:38.932783 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-e561b436-0814-4e3a-bd74-b5c9be847202 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:38.934268 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-e561b436-0814-4e3a-bd74-b5c9be847202 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:38.936413 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-e561b436-0814-4e3a-bd74-b5c9be847202 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e" status: 200 len: 1407 microversion: 2.20 time: 0.179195 Oct 29 01:17:38.937516 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 396/770] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:17:38 2021] GET /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:39.027364 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a1a96bf5-7d4c-42f9-8413-01725e1f0373 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:39.028366 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a1a96bf5-7d4c-42f9-8413-01725e1f0373 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:39.035429 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a1a96bf5-7d4c-42f9-8413-01725e1f0373 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:39.035881 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a1a96bf5-7d4c-42f9-8413-01725e1f0373 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:39.036652 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a1a96bf5-7d4c-42f9-8413-01725e1f0373 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:39.037084 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a1a96bf5-7d4c-42f9-8413-01725e1f0373 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:39.067002 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a1a96bf5-7d4c-42f9-8413-01725e1f0373 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043749 Oct 29 01:17:39.067566 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 375/771] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:17:39 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:39.562009 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-4e28391d-9281-454e-be0e-cc2cde7b678b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:39.562578 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-4e28391d-9281-454e-be0e-cc2cde7b678b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:39.568579 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4e28391d-9281-454e-be0e-cc2cde7b678b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:39.569020 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4e28391d-9281-454e-be0e-cc2cde7b678b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:39.569771 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4e28391d-9281-454e-be0e-cc2cde7b678b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:39.570200 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4e28391d-9281-454e-be0e-cc2cde7b678b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:39.694539 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-4e28391d-9281-454e-be0e-cc2cde7b678b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:39.701934 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-4e28391d-9281-454e-be0e-cc2cde7b678b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.144859 Oct 29 01:17:39.702519 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 397/772] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:39 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:39.955024 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-87398d43-daf0-4e38-98ca-c75c3c17bce4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:39.955622 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-87398d43-daf0-4e38-98ca-c75c3c17bce4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:39.962503 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-87398d43-daf0-4e38-98ca-c75c3c17bce4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:39.962944 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-87398d43-daf0-4e38-98ca-c75c3c17bce4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:39.963708 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-87398d43-daf0-4e38-98ca-c75c3c17bce4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:39.964132 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-87398d43-daf0-4e38-98ca-c75c3c17bce4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:40.080294 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e5517f00-d8af-4323-b31c-752c12b7e37c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:40.081256 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-e5517f00-d8af-4323-b31c-752c12b7e37c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:40.088297 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e5517f00-d8af-4323-b31c-752c12b7e37c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:40.088722 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e5517f00-d8af-4323-b31c-752c12b7e37c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:40.089556 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e5517f00-d8af-4323-b31c-752c12b7e37c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:40.089923 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e5517f00-d8af-4323-b31c-752c12b7e37c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:40.100375 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-87398d43-daf0-4e38-98ca-c75c3c17bce4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:40.108385 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-87398d43-daf0-4e38-98ca-c75c3c17bce4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:40.109885 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-87398d43-daf0-4e38-98ca-c75c3c17bce4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:40.111005 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-87398d43-daf0-4e38-98ca-c75c3c17bce4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e" status: 200 len: 1407 microversion: 2.20 time: 0.160021 Oct 29 01:17:40.111567 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 376/773] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:17:39 2021] GET /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:40.119676 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-e5517f00-d8af-4323-b31c-752c12b7e37c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044686 Oct 29 01:17:40.120224 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 398/774] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:17:40 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:17:40.719866 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-530823b3-f10c-4982-b967-bef7377950b6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:40.720478 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-530823b3-f10c-4982-b967-bef7377950b6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:40.726605 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-530823b3-f10c-4982-b967-bef7377950b6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:40.727068 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-530823b3-f10c-4982-b967-bef7377950b6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:40.727843 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-530823b3-f10c-4982-b967-bef7377950b6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:40.728312 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-530823b3-f10c-4982-b967-bef7377950b6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:40.855148 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-530823b3-f10c-4982-b967-bef7377950b6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:40.862521 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-530823b3-f10c-4982-b967-bef7377950b6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.146853 Oct 29 01:17:40.863088 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 377/775] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:40 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:41.129091 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-7e524df4-9e0c-4f4b-a897-c7c12be01354 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:41.129691 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-7e524df4-9e0c-4f4b-a897-c7c12be01354 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:41.131361 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-acbe4b86-90fa-4ddf-a19d-fda7c5861cb2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:41.132276 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-acbe4b86-90fa-4ddf-a19d-fda7c5861cb2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:41.135760 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7e524df4-9e0c-4f4b-a897-c7c12be01354 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:41.136206 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7e524df4-9e0c-4f4b-a897-c7c12be01354 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:41.136968 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7e524df4-9e0c-4f4b-a897-c7c12be01354 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:41.137394 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7e524df4-9e0c-4f4b-a897-c7c12be01354 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:41.138658 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-acbe4b86-90fa-4ddf-a19d-fda7c5861cb2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:41.139779 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-acbe4b86-90fa-4ddf-a19d-fda7c5861cb2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:41.140551 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-acbe4b86-90fa-4ddf-a19d-fda7c5861cb2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:41.141014 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-acbe4b86-90fa-4ddf-a19d-fda7c5861cb2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:41.170049 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-acbe4b86-90fa-4ddf-a19d-fda7c5861cb2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042573 Oct 29 01:17:41.170661 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 378/776] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:17:41 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:17:41.259950 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-7e524df4-9e0c-4f4b-a897-c7c12be01354 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:41.268354 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-7e524df4-9e0c-4f4b-a897-c7c12be01354 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:41.269864 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-7e524df4-9e0c-4f4b-a897-c7c12be01354 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:41.271037 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-7e524df4-9e0c-4f4b-a897-c7c12be01354 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e" status: 200 len: 1599 microversion: 2.20 time: 0.145641 Oct 29 01:17:41.271583 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 399/777] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:17:41 2021] GET /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e => generated 1599 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:41.287614 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-81f7615d-6997-47af-bcd5-0bda07d964b7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:41.288108 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-81f7615d-6997-47af-bcd5-0bda07d964b7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:41.294116 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-81f7615d-6997-47af-bcd5-0bda07d964b7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:41.294599 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-81f7615d-6997-47af-bcd5-0bda07d964b7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:41.295356 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-81f7615d-6997-47af-bcd5-0bda07d964b7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:41.295788 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-81f7615d-6997-47af-bcd5-0bda07d964b7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:41.376594 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-81f7615d-6997-47af-bcd5-0bda07d964b7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.089867 Oct 29 01:17:41.377197 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 379/778] 10.222.0.90 () {60 vars in 1315 bytes} [Fri Oct 29 01:17:41 2021] GET /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:17:41.878979 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-190d3761-0b68-420e-9d4f-a1efa4d2d8e4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:41.879589 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-190d3761-0b68-420e-9d4f-a1efa4d2d8e4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:41.885432 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-190d3761-0b68-420e-9d4f-a1efa4d2d8e4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:41.885884 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-190d3761-0b68-420e-9d4f-a1efa4d2d8e4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:41.886713 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-190d3761-0b68-420e-9d4f-a1efa4d2d8e4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:41.887150 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-190d3761-0b68-420e-9d4f-a1efa4d2d8e4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:42.099056 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-190d3761-0b68-420e-9d4f-a1efa4d2d8e4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:42.106582 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-190d3761-0b68-420e-9d4f-a1efa4d2d8e4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.231256 Oct 29 01:17:42.107159 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 400/779] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:41 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:42.183875 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9a8bbd86-a776-4f50-a3a2-0a1337368d95 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:42.184920 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9a8bbd86-a776-4f50-a3a2-0a1337368d95 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:42.192284 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9a8bbd86-a776-4f50-a3a2-0a1337368d95 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:42.192734 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9a8bbd86-a776-4f50-a3a2-0a1337368d95 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:42.193502 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9a8bbd86-a776-4f50-a3a2-0a1337368d95 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:42.193939 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9a8bbd86-a776-4f50-a3a2-0a1337368d95 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:42.223823 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9a8bbd86-a776-4f50-a3a2-0a1337368d95 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044079 Oct 29 01:17:42.224392 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 380/780] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:17:42 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:42.600233 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-812159d2-e6fc-4584-a13b-ddf7f594beb9 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:42.601154 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-812159d2-e6fc-4584-a13b-ddf7f594beb9 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:42.608346 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-812159d2-e6fc-4584-a13b-ddf7f594beb9 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:42.609086 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-812159d2-e6fc-4584-a13b-ddf7f594beb9 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:42.609262 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [req-25cd1408-103f-4107-8f6e-d2e015ba9e2c req-38da4bb7-d6d4-471e-9fa1-f6ec7b77ba2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88c93e0a-61e3-441e-966d-68099633969e", "tag": "e9f39300-bc57-4560-8d70-a8ff52c182b0"}]} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:42.609901 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-812159d2-e6fc-4584-a13b-ddf7f594beb9 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:42.610329 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-812159d2-e6fc-4584-a13b-ddf7f594beb9 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:42.611273 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:17:42.611273 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: warnings.warn(msg) Oct 29 01:17:42.618064 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-25cd1408-103f-4107-8f6e-d2e015ba9e2c req-38da4bb7-d6d4-471e-9fa1-f6ec7b77ba2b service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:42.618542 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-25cd1408-103f-4107-8f6e-d2e015ba9e2c req-38da4bb7-d6d4-471e-9fa1-f6ec7b77ba2b service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:42.630454 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.compute.server_external_events [req-25cd1408-103f-4107-8f6e-d2e015ba9e2c req-38da4bb7-d6d4-471e-9fa1-f6ec7b77ba2b service nova] Creating event network-changed:e9f39300-bc57-4560-8d70-a8ff52c182b0 for instance 88c93e0a-61e3-441e-966d-68099633969e on hv-cinder-81558 Oct 29 01:17:42.635572 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [req-25cd1408-103f-4107-8f6e-d2e015ba9e2c req-38da4bb7-d6d4-471e-9fa1-f6ec7b77ba2b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030256 Oct 29 01:17:42.636191 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 381/781] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:17:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:42.751312 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-812159d2-e6fc-4584-a13b-ddf7f594beb9 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action" status: 200 len: 14 microversion: 2.20 time: 0.154769 Oct 29 01:17:42.754665 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 401/782] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:17:42 2021] POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action => generated 14 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:43.125527 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a0930c9f-6eaa-4328-ab1c-fbd57fde8087 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:43.126129 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a0930c9f-6eaa-4328-ab1c-fbd57fde8087 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:43.132456 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a0930c9f-6eaa-4328-ab1c-fbd57fde8087 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:43.132901 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a0930c9f-6eaa-4328-ab1c-fbd57fde8087 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:43.133719 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a0930c9f-6eaa-4328-ab1c-fbd57fde8087 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:43.134238 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a0930c9f-6eaa-4328-ab1c-fbd57fde8087 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:43.236504 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2e65ce7b-e8a0-4138-bbbf-7ff828e41d6c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:43.237762 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2e65ce7b-e8a0-4138-bbbf-7ff828e41d6c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:43.248647 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2e65ce7b-e8a0-4138-bbbf-7ff828e41d6c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:43.248647 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2e65ce7b-e8a0-4138-bbbf-7ff828e41d6c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:43.249987 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2e65ce7b-e8a0-4138-bbbf-7ff828e41d6c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:43.250531 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2e65ce7b-e8a0-4138-bbbf-7ff828e41d6c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:43.266364 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-a0930c9f-6eaa-4328-ab1c-fbd57fde8087 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:43.276477 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a0930c9f-6eaa-4328-ab1c-fbd57fde8087 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.155437 Oct 29 01:17:43.286516 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2e65ce7b-e8a0-4138-bbbf-7ff828e41d6c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053593 Oct 29 01:17:43.286516 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 402/783] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:17:43 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:43.287427 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 382/784] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:43 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:43.822728 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d618b691-2742-4c08-9d09-91de1f69f28d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:43.823695 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d618b691-2742-4c08-9d09-91de1f69f28d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:43.830230 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d618b691-2742-4c08-9d09-91de1f69f28d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:43.830714 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d618b691-2742-4c08-9d09-91de1f69f28d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:43.831476 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d618b691-2742-4c08-9d09-91de1f69f28d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:43.831906 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d618b691-2742-4c08-9d09-91de1f69f28d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:43.928130 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d618b691-2742-4c08-9d09-91de1f69f28d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action" status: 200 len: 14 microversion: 2.20 time: 0.169388 Oct 29 01:17:43.928735 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 403/785] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:17:43 2021] POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action => generated 14 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:44.294642 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b75d6c51-5a86-450b-9832-1841b9341f28 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:44.295187 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b75d6c51-5a86-450b-9832-1841b9341f28 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:44.297074 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-a1caa59f-a48e-47c6-8944-3ddb4efb607e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:44.298082 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-a1caa59f-a48e-47c6-8944-3ddb4efb607e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:44.301451 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b75d6c51-5a86-450b-9832-1841b9341f28 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:44.301898 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b75d6c51-5a86-450b-9832-1841b9341f28 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:44.302690 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b75d6c51-5a86-450b-9832-1841b9341f28 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:44.303182 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b75d6c51-5a86-450b-9832-1841b9341f28 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:44.304847 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a1caa59f-a48e-47c6-8944-3ddb4efb607e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:44.305303 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a1caa59f-a48e-47c6-8944-3ddb4efb607e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:44.306160 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a1caa59f-a48e-47c6-8944-3ddb4efb607e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:44.306630 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a1caa59f-a48e-47c6-8944-3ddb4efb607e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:44.338406 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-a1caa59f-a48e-47c6-8944-3ddb4efb607e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045385 Oct 29 01:17:44.339000 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 404/786] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:17:44 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:17:44.422938 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-b75d6c51-5a86-450b-9832-1841b9341f28 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:44.430197 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b75d6c51-5a86-450b-9832-1841b9341f28 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.139250 Oct 29 01:17:44.430790 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 383/787] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:44 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:44.803433 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [req-9fff0749-dd86-4b64-bfe7-531bd4fc16f9 req-2bac46d3-2335-4b1c-8f2c-988c7cd1fcb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd", "name": "network-vif-unplugged", "status": "completed", "tag": "8d56de6a-a409-4dde-8299-b4d26a45fc41"}]} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:44.805382 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:17:44.805382 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: warnings.warn(msg) Oct 29 01:17:44.815325 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-9fff0749-dd86-4b64-bfe7-531bd4fc16f9 req-2bac46d3-2335-4b1c-8f2c-988c7cd1fcb7 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:44.815789 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-9fff0749-dd86-4b64-bfe7-531bd4fc16f9 req-2bac46d3-2335-4b1c-8f2c-988c7cd1fcb7 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:44.826938 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.compute.server_external_events [req-9fff0749-dd86-4b64-bfe7-531bd4fc16f9 req-2bac46d3-2335-4b1c-8f2c-988c7cd1fcb7 service nova] Creating event network-vif-unplugged:8d56de6a-a409-4dde-8299-b4d26a45fc41 for instance efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd on hv-cinder-81558 Oct 29 01:17:44.832021 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [req-9fff0749-dd86-4b64-bfe7-531bd4fc16f9 req-2bac46d3-2335-4b1c-8f2c-988c7cd1fcb7 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036909 Oct 29 01:17:44.832786 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 405/788] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:17:44 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:44.938047 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-664a9fc7-b03d-4168-8a0d-abf87a7745e9 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:44.938896 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-664a9fc7-b03d-4168-8a0d-abf87a7745e9 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:44.944698 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-664a9fc7-b03d-4168-8a0d-abf87a7745e9 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:44.945135 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-664a9fc7-b03d-4168-8a0d-abf87a7745e9 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:44.945881 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-664a9fc7-b03d-4168-8a0d-abf87a7745e9 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:44.946303 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-664a9fc7-b03d-4168-8a0d-abf87a7745e9 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:45.044267 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-664a9fc7-b03d-4168-8a0d-abf87a7745e9 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action" status: 200 len: 14 microversion: 2.20 time: 0.109709 Oct 29 01:17:45.044894 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 384/789] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:17:44 2021] POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:45.350536 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d8ffafc2-18e8-462a-a90d-9d0d45742ffc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:45.351556 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d8ffafc2-18e8-462a-a90d-9d0d45742ffc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:45.357579 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d8ffafc2-18e8-462a-a90d-9d0d45742ffc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:45.358019 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d8ffafc2-18e8-462a-a90d-9d0d45742ffc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:45.358811 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d8ffafc2-18e8-462a-a90d-9d0d45742ffc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:45.359243 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d8ffafc2-18e8-462a-a90d-9d0d45742ffc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:45.387378 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d8ffafc2-18e8-462a-a90d-9d0d45742ffc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041409 Oct 29 01:17:45.387929 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 406/790] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:17:45 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:45.447877 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-4b54047c-4f30-43e7-9a51-645c7d7269bc tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:45.448580 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-4b54047c-4f30-43e7-9a51-645c7d7269bc tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:45.456254 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4b54047c-4f30-43e7-9a51-645c7d7269bc tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:45.456698 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4b54047c-4f30-43e7-9a51-645c7d7269bc tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:45.457448 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4b54047c-4f30-43e7-9a51-645c7d7269bc tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:45.457875 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4b54047c-4f30-43e7-9a51-645c7d7269bc tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:45.591206 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-4b54047c-4f30-43e7-9a51-645c7d7269bc tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:45.599249 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-4b54047c-4f30-43e7-9a51-645c7d7269bc tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.155349 Oct 29 01:17:45.599810 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 385/791] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:45 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:46.062092 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-6f163421-aa51-4c6c-a921-58c5a8111df6 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:46.063034 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-6f163421-aa51-4c6c-a921-58c5a8111df6 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:46.069393 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6f163421-aa51-4c6c-a921-58c5a8111df6 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:46.069860 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6f163421-aa51-4c6c-a921-58c5a8111df6 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:46.070656 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6f163421-aa51-4c6c-a921-58c5a8111df6 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:46.071082 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6f163421-aa51-4c6c-a921-58c5a8111df6 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:46.174963 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-6f163421-aa51-4c6c-a921-58c5a8111df6 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action" status: 200 len: 14 microversion: 2.20 time: 0.116408 Oct 29 01:17:46.175596 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 407/792] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:17:46 2021] POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:17:46.399652 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-efab3d2e-d3a2-4fbd-a27c-b62ce17d12fb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:46.400557 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-efab3d2e-d3a2-4fbd-a27c-b62ce17d12fb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:46.406725 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-efab3d2e-d3a2-4fbd-a27c-b62ce17d12fb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:46.407169 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-efab3d2e-d3a2-4fbd-a27c-b62ce17d12fb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:46.407933 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-efab3d2e-d3a2-4fbd-a27c-b62ce17d12fb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:46.408359 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-efab3d2e-d3a2-4fbd-a27c-b62ce17d12fb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:46.438888 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-efab3d2e-d3a2-4fbd-a27c-b62ce17d12fb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042914 Oct 29 01:17:46.439447 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 386/793] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:17:46 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:46.616076 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-ef952667-b633-4d15-b025-f6bff94641e5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:46.616768 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-ef952667-b633-4d15-b025-f6bff94641e5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:46.624085 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ef952667-b633-4d15-b025-f6bff94641e5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:46.624518 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ef952667-b633-4d15-b025-f6bff94641e5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:46.625281 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ef952667-b633-4d15-b025-f6bff94641e5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:46.625715 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ef952667-b633-4d15-b025-f6bff94641e5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:46.748523 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-ef952667-b633-4d15-b025-f6bff94641e5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:46.756425 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-ef952667-b633-4d15-b025-f6bff94641e5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.144379 Oct 29 01:17:46.756997 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 408/794] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:46 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:47.185774 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-012616b7-4bf8-4ac2-ab80-fa568c5a5eaf tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:47.186716 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-012616b7-4bf8-4ac2-ab80-fa568c5a5eaf tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:47.192880 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-012616b7-4bf8-4ac2-ab80-fa568c5a5eaf tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:47.193327 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-012616b7-4bf8-4ac2-ab80-fa568c5a5eaf tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:47.194084 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-012616b7-4bf8-4ac2-ab80-fa568c5a5eaf tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:47.194543 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-012616b7-4bf8-4ac2-ab80-fa568c5a5eaf tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:47.282183 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-012616b7-4bf8-4ac2-ab80-fa568c5a5eaf tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action" status: 200 len: 14 microversion: 2.20 time: 0.099894 Oct 29 01:17:47.282944 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 387/795] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:17:47 2021] POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:47.451674 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2e311068-4422-4acc-b77a-216db094732b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:47.451674 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2e311068-4422-4acc-b77a-216db094732b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:47.458040 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2e311068-4422-4acc-b77a-216db094732b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:47.458515 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2e311068-4422-4acc-b77a-216db094732b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:47.459449 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2e311068-4422-4acc-b77a-216db094732b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:47.460737 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2e311068-4422-4acc-b77a-216db094732b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:47.491663 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2e311068-4422-4acc-b77a-216db094732b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045155 Oct 29 01:17:47.492231 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 409/796] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:17:47 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:47.773297 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ddd6c450-49fc-4a67-a3f2-b6e34a67c666 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:47.774015 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ddd6c450-49fc-4a67-a3f2-b6e34a67c666 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:47.781571 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ddd6c450-49fc-4a67-a3f2-b6e34a67c666 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:47.782022 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ddd6c450-49fc-4a67-a3f2-b6e34a67c666 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:47.782812 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ddd6c450-49fc-4a67-a3f2-b6e34a67c666 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:47.783243 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ddd6c450-49fc-4a67-a3f2-b6e34a67c666 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:47.905339 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-ddd6c450-49fc-4a67-a3f2-b6e34a67c666 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:47.913037 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ddd6c450-49fc-4a67-a3f2-b6e34a67c666 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.143755 Oct 29 01:17:47.913610 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 388/797] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:47 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:48.293032 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-91602291-7a07-435d-b304-426fd2ff8aed tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:48.293941 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-91602291-7a07-435d-b304-426fd2ff8aed tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:48.300718 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-91602291-7a07-435d-b304-426fd2ff8aed tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:48.301157 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-91602291-7a07-435d-b304-426fd2ff8aed tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:48.301916 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-91602291-7a07-435d-b304-426fd2ff8aed tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:48.302344 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-91602291-7a07-435d-b304-426fd2ff8aed tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:48.424922 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-91602291-7a07-435d-b304-426fd2ff8aed tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action" status: 200 len: 14 microversion: 2.20 time: 0.135293 Oct 29 01:17:48.425498 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 410/798] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:17:48 2021] POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action => generated 14 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:48.503486 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-28368749-c4b9-4c2a-8328-39ca25ac8950 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:48.504399 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-28368749-c4b9-4c2a-8328-39ca25ac8950 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:48.511205 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-28368749-c4b9-4c2a-8328-39ca25ac8950 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:48.511645 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-28368749-c4b9-4c2a-8328-39ca25ac8950 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:48.512425 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-28368749-c4b9-4c2a-8328-39ca25ac8950 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:48.512854 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-28368749-c4b9-4c2a-8328-39ca25ac8950 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:48.541375 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-28368749-c4b9-4c2a-8328-39ca25ac8950 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042099 Oct 29 01:17:48.541929 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 389/799] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:17:48 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:48.929909 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-57087825-9920-4632-a50d-da0b41b65cd6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:48.930780 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-57087825-9920-4632-a50d-da0b41b65cd6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:48.937848 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-57087825-9920-4632-a50d-da0b41b65cd6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:48.938289 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-57087825-9920-4632-a50d-da0b41b65cd6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:48.939093 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-57087825-9920-4632-a50d-da0b41b65cd6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:48.939522 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-57087825-9920-4632-a50d-da0b41b65cd6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:49.064928 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-57087825-9920-4632-a50d-da0b41b65cd6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:49.072862 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-57087825-9920-4632-a50d-da0b41b65cd6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.147001 Oct 29 01:17:49.073438 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 411/800] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:48 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:49.435626 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-63e21a03-7e6b-4565-b888-656e618c3bc7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:49.437032 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-63e21a03-7e6b-4565-b888-656e618c3bc7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:49.443214 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-63e21a03-7e6b-4565-b888-656e618c3bc7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:49.443664 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-63e21a03-7e6b-4565-b888-656e618c3bc7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:49.444435 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-63e21a03-7e6b-4565-b888-656e618c3bc7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:49.444869 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-63e21a03-7e6b-4565-b888-656e618c3bc7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:49.537729 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-63e21a03-7e6b-4565-b888-656e618c3bc7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action" status: 200 len: 14 microversion: 2.20 time: 0.105702 Oct 29 01:17:49.538481 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 390/801] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:17:49 2021] POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:49.551897 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e3983644-17bf-400b-b94a-a51d1197a218 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:49.552808 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-e3983644-17bf-400b-b94a-a51d1197a218 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:49.559442 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e3983644-17bf-400b-b94a-a51d1197a218 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:49.559943 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e3983644-17bf-400b-b94a-a51d1197a218 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:49.560809 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e3983644-17bf-400b-b94a-a51d1197a218 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:49.561756 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e3983644-17bf-400b-b94a-a51d1197a218 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:49.591615 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-e3983644-17bf-400b-b94a-a51d1197a218 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043431 Oct 29 01:17:49.592169 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 412/802] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:17:49 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:50.091347 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-08b80b9c-c871-4020-8bfb-16e87eeacdb7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:50.091928 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-08b80b9c-c871-4020-8bfb-16e87eeacdb7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:50.099136 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-08b80b9c-c871-4020-8bfb-16e87eeacdb7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:50.099578 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-08b80b9c-c871-4020-8bfb-16e87eeacdb7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:50.100331 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-08b80b9c-c871-4020-8bfb-16e87eeacdb7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:50.100765 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-08b80b9c-c871-4020-8bfb-16e87eeacdb7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:50.228744 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-08b80b9c-c871-4020-8bfb-16e87eeacdb7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:50.237269 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-08b80b9c-c871-4020-8bfb-16e87eeacdb7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.150177 Oct 29 01:17:50.237836 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 391/803] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:50 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:50.547725 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-05913a30-2e38-433a-911e-ba0188be207a tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:50.548647 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-05913a30-2e38-433a-911e-ba0188be207a tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:50.554988 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-05913a30-2e38-433a-911e-ba0188be207a tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:50.555440 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-05913a30-2e38-433a-911e-ba0188be207a tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:50.556212 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-05913a30-2e38-433a-911e-ba0188be207a tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:50.556652 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-05913a30-2e38-433a-911e-ba0188be207a tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:50.602934 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-0fc2dcc0-edfd-45c9-bf8d-aa2b4b8ba7f3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:50.603878 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-0fc2dcc0-edfd-45c9-bf8d-aa2b4b8ba7f3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:50.609995 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0fc2dcc0-edfd-45c9-bf8d-aa2b4b8ba7f3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:50.610469 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0fc2dcc0-edfd-45c9-bf8d-aa2b4b8ba7f3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:50.611228 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0fc2dcc0-edfd-45c9-bf8d-aa2b4b8ba7f3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:50.611655 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0fc2dcc0-edfd-45c9-bf8d-aa2b4b8ba7f3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:50.642169 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-0fc2dcc0-edfd-45c9-bf8d-aa2b4b8ba7f3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042922 Oct 29 01:17:50.642765 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 392/804] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:17:50 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:17:50.650572 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-05913a30-2e38-433a-911e-ba0188be207a tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action" status: 200 len: 14 microversion: 2.20 time: 0.106439 Oct 29 01:17:50.651201 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 413/805] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:17:50 2021] POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:51.253980 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-284a7e27-9ea9-4232-9875-616d2f39ee2c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:51.254558 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-284a7e27-9ea9-4232-9875-616d2f39ee2c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:51.260947 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-284a7e27-9ea9-4232-9875-616d2f39ee2c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:51.261387 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-284a7e27-9ea9-4232-9875-616d2f39ee2c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:51.262165 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-284a7e27-9ea9-4232-9875-616d2f39ee2c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:51.262606 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-284a7e27-9ea9-4232-9875-616d2f39ee2c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:51.384241 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-284a7e27-9ea9-4232-9875-616d2f39ee2c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:51.392106 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-284a7e27-9ea9-4232-9875-616d2f39ee2c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.141880 Oct 29 01:17:51.392681 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 393/806] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:51 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:51.654117 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-41d30e4b-40af-4a50-9046-17a72075d9be tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:51.655636 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-41d30e4b-40af-4a50-9046-17a72075d9be tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:51.661780 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-79e8d18b-99b0-473b-be7e-998b438e4ea7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:51.662473 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-41d30e4b-40af-4a50-9046-17a72075d9be tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:51.662724 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-79e8d18b-99b0-473b-be7e-998b438e4ea7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:51.662922 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-41d30e4b-40af-4a50-9046-17a72075d9be tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:51.663690 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-41d30e4b-40af-4a50-9046-17a72075d9be tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:51.664230 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-41d30e4b-40af-4a50-9046-17a72075d9be tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:51.668482 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-79e8d18b-99b0-473b-be7e-998b438e4ea7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:51.668928 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-79e8d18b-99b0-473b-be7e-998b438e4ea7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:51.669689 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-79e8d18b-99b0-473b-be7e-998b438e4ea7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:51.670121 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-79e8d18b-99b0-473b-be7e-998b438e4ea7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:51.694137 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-41d30e4b-40af-4a50-9046-17a72075d9be tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044140 Oct 29 01:17:51.694726 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 414/807] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:17:51 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:51.762640 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-79e8d18b-99b0-473b-be7e-998b438e4ea7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action" status: 200 len: 14 microversion: 2.20 time: 0.104435 Oct 29 01:17:51.763226 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 394/808] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:17:51 2021] POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:17:52.409414 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2e3250ac-0289-4768-b2d9-58a03738fbf6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:52.410048 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2e3250ac-0289-4768-b2d9-58a03738fbf6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:52.416334 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2e3250ac-0289-4768-b2d9-58a03738fbf6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:52.416783 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2e3250ac-0289-4768-b2d9-58a03738fbf6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:52.417576 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2e3250ac-0289-4768-b2d9-58a03738fbf6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:52.418007 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2e3250ac-0289-4768-b2d9-58a03738fbf6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:52.540790 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-2e3250ac-0289-4768-b2d9-58a03738fbf6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:52.548201 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2e3250ac-0289-4768-b2d9-58a03738fbf6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.142450 Oct 29 01:17:52.548787 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 415/809] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:52 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:52.706728 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-bad8ce56-9272-4761-bdff-821cadc731c2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:52.707732 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-bad8ce56-9272-4761-bdff-821cadc731c2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:52.714584 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bad8ce56-9272-4761-bdff-821cadc731c2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:52.715034 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bad8ce56-9272-4761-bdff-821cadc731c2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:52.715806 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bad8ce56-9272-4761-bdff-821cadc731c2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:52.716241 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bad8ce56-9272-4761-bdff-821cadc731c2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:52.745690 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-bad8ce56-9272-4761-bdff-821cadc731c2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044007 Oct 29 01:17:52.746246 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 395/810] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:17:52 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:52.773122 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-98559a90-11a4-4cab-afba-9241170a37a0 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:52.773962 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-98559a90-11a4-4cab-afba-9241170a37a0 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:52.780277 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-98559a90-11a4-4cab-afba-9241170a37a0 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:52.780723 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-98559a90-11a4-4cab-afba-9241170a37a0 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:52.781483 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-98559a90-11a4-4cab-afba-9241170a37a0 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:52.781913 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-98559a90-11a4-4cab-afba-9241170a37a0 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:52.890093 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-98559a90-11a4-4cab-afba-9241170a37a0 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action" status: 200 len: 14 microversion: 2.20 time: 0.120593 Oct 29 01:17:52.891033 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 416/811] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:17:52 2021] POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:17:53.565163 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-452a974d-4be7-4325-9a73-9b4d649d5e74 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:53.565691 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-452a974d-4be7-4325-9a73-9b4d649d5e74 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:53.571923 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-452a974d-4be7-4325-9a73-9b4d649d5e74 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:53.572371 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-452a974d-4be7-4325-9a73-9b4d649d5e74 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:53.573135 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-452a974d-4be7-4325-9a73-9b4d649d5e74 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:53.573565 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-452a974d-4be7-4325-9a73-9b4d649d5e74 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:53.702717 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-452a974d-4be7-4325-9a73-9b4d649d5e74 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:53.710298 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-452a974d-4be7-4325-9a73-9b4d649d5e74 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.148956 Oct 29 01:17:53.710919 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 396/812] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:53 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:53.757538 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d7909ba7-ae25-45a5-bd95-190a5c34cce2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:53.758566 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d7909ba7-ae25-45a5-bd95-190a5c34cce2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:53.765847 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d7909ba7-ae25-45a5-bd95-190a5c34cce2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:53.766295 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d7909ba7-ae25-45a5-bd95-190a5c34cce2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:53.767081 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d7909ba7-ae25-45a5-bd95-190a5c34cce2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:53.767511 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d7909ba7-ae25-45a5-bd95-190a5c34cce2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:53.797011 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d7909ba7-ae25-45a5-bd95-190a5c34cce2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043628 Oct 29 01:17:53.797660 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 417/813] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:17:53 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:53.900814 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-5d23436d-35b1-4e95-b386-5a7617f6da37 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:53.901732 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-5d23436d-35b1-4e95-b386-5a7617f6da37 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:53.907965 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5d23436d-35b1-4e95-b386-5a7617f6da37 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:53.908412 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5d23436d-35b1-4e95-b386-5a7617f6da37 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:53.909192 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5d23436d-35b1-4e95-b386-5a7617f6da37 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:53.909608 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5d23436d-35b1-4e95-b386-5a7617f6da37 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:54.008591 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-5d23436d-35b1-4e95-b386-5a7617f6da37 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action" status: 200 len: 14 microversion: 2.20 time: 0.111269 Oct 29 01:17:54.009232 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 397/814] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:17:53 2021] POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:54.727825 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f087ae01-9a02-43f0-a986-40a6c78b04a2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:54.728434 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f087ae01-9a02-43f0-a986-40a6c78b04a2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:54.735468 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f087ae01-9a02-43f0-a986-40a6c78b04a2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:54.735917 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f087ae01-9a02-43f0-a986-40a6c78b04a2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:54.736686 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f087ae01-9a02-43f0-a986-40a6c78b04a2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:54.737117 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f087ae01-9a02-43f0-a986-40a6c78b04a2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:54.809378 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-7032ae57-c7fd-4329-b1d2-d4e898eb4279 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:54.810404 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-7032ae57-c7fd-4329-b1d2-d4e898eb4279 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:54.817333 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7032ae57-c7fd-4329-b1d2-d4e898eb4279 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:54.817780 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7032ae57-c7fd-4329-b1d2-d4e898eb4279 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:54.818580 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7032ae57-c7fd-4329-b1d2-d4e898eb4279 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:54.819013 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7032ae57-c7fd-4329-b1d2-d4e898eb4279 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:54.850627 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-7032ae57-c7fd-4329-b1d2-d4e898eb4279 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045310 Oct 29 01:17:54.851202 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 398/815] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:17:54 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:17:54.862784 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-f087ae01-9a02-43f0-a986-40a6c78b04a2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:54.870072 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f087ae01-9a02-43f0-a986-40a6c78b04a2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.145974 Oct 29 01:17:54.870672 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 418/816] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:54 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:55.020208 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c0dcee9a-027a-4754-8d1b-928ad0b10069 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:55.021041 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c0dcee9a-027a-4754-8d1b-928ad0b10069 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:55.027365 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c0dcee9a-027a-4754-8d1b-928ad0b10069 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:55.027807 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c0dcee9a-027a-4754-8d1b-928ad0b10069 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:55.028566 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c0dcee9a-027a-4754-8d1b-928ad0b10069 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:55.028996 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c0dcee9a-027a-4754-8d1b-928ad0b10069 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:55.128996 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c0dcee9a-027a-4754-8d1b-928ad0b10069 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action" status: 200 len: 14 microversion: 2.20 time: 0.112424 Oct 29 01:17:55.129625 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 399/817] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:17:55 2021] POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:55.861507 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-7a9f8305-8716-47cb-9c02-300d0f04c3d1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:55.862449 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-7a9f8305-8716-47cb-9c02-300d0f04c3d1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:55.869408 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7a9f8305-8716-47cb-9c02-300d0f04c3d1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:55.870116 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7a9f8305-8716-47cb-9c02-300d0f04c3d1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:55.870661 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7a9f8305-8716-47cb-9c02-300d0f04c3d1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:55.871100 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7a9f8305-8716-47cb-9c02-300d0f04c3d1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:55.890458 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-0305c712-e9d3-4727-99d2-55a10ccc1c09 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:55.890458 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-0305c712-e9d3-4727-99d2-55a10ccc1c09 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:55.894632 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0305c712-e9d3-4727-99d2-55a10ccc1c09 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:55.895077 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0305c712-e9d3-4727-99d2-55a10ccc1c09 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:55.895841 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0305c712-e9d3-4727-99d2-55a10ccc1c09 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:55.896268 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0305c712-e9d3-4727-99d2-55a10ccc1c09 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:55.902695 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-7a9f8305-8716-47cb-9c02-300d0f04c3d1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045361 Oct 29 01:17:55.903285 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 419/818] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:17:55 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:56.019905 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-0305c712-e9d3-4727-99d2-55a10ccc1c09 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:56.027736 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-0305c712-e9d3-4727-99d2-55a10ccc1c09 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.144101 Oct 29 01:17:56.028298 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 400/819] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:55 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:17:56.139859 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d8f7c11f-56f8-4433-b55b-e623b1bfdae0 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:56.140770 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d8f7c11f-56f8-4433-b55b-e623b1bfdae0 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:56.147063 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d8f7c11f-56f8-4433-b55b-e623b1bfdae0 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:56.147512 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d8f7c11f-56f8-4433-b55b-e623b1bfdae0 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:56.148274 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d8f7c11f-56f8-4433-b55b-e623b1bfdae0 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:56.148706 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d8f7c11f-56f8-4433-b55b-e623b1bfdae0 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:56.252540 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d8f7c11f-56f8-4433-b55b-e623b1bfdae0 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action" status: 200 len: 6451 microversion: 2.20 time: 0.116174 Oct 29 01:17:56.253258 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 420/820] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:17:56 2021] POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action => generated 6451 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:56.914227 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b1560df7-8e87-49df-9cf0-41af99e90cb5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:56.915188 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b1560df7-8e87-49df-9cf0-41af99e90cb5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:56.921350 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b1560df7-8e87-49df-9cf0-41af99e90cb5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:56.921788 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b1560df7-8e87-49df-9cf0-41af99e90cb5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:56.922873 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b1560df7-8e87-49df-9cf0-41af99e90cb5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:56.923297 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b1560df7-8e87-49df-9cf0-41af99e90cb5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:56.954169 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b1560df7-8e87-49df-9cf0-41af99e90cb5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043679 Oct 29 01:17:56.954767 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 401/821] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:17:56 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:57.045184 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-414b098f-3e36-4d62-ae7f-9ad62fba36fb tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:57.045895 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-414b098f-3e36-4d62-ae7f-9ad62fba36fb tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:57.052652 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-414b098f-3e36-4d62-ae7f-9ad62fba36fb tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:57.053095 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-414b098f-3e36-4d62-ae7f-9ad62fba36fb tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:57.053847 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-414b098f-3e36-4d62-ae7f-9ad62fba36fb tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:57.054272 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-414b098f-3e36-4d62-ae7f-9ad62fba36fb tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:57.178301 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-414b098f-3e36-4d62-ae7f-9ad62fba36fb tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:57.186204 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-414b098f-3e36-4d62-ae7f-9ad62fba36fb tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.145066 Oct 29 01:17:57.187283 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 421/822] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:57 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:57.263682 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-cf21f6cb-2ee7-4ce1-a63a-3553ded1d37b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:57.265173 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-cf21f6cb-2ee7-4ce1-a63a-3553ded1d37b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:57.271510 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cf21f6cb-2ee7-4ce1-a63a-3553ded1d37b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:57.271957 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cf21f6cb-2ee7-4ce1-a63a-3553ded1d37b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:57.272749 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cf21f6cb-2ee7-4ce1-a63a-3553ded1d37b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:57.273183 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cf21f6cb-2ee7-4ce1-a63a-3553ded1d37b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:57.394962 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-cf21f6cb-2ee7-4ce1-a63a-3553ded1d37b tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action" status: 200 len: 12971 microversion: 2.20 time: 0.134852 Oct 29 01:17:57.395600 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 402/823] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:17:57 2021] POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action => generated 12971 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:17:57.965003 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2a3c7eb5-3572-4ef7-8533-2c481548d130 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:57.965911 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2a3c7eb5-3572-4ef7-8533-2c481548d130 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:57.972581 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2a3c7eb5-3572-4ef7-8533-2c481548d130 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:57.973025 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2a3c7eb5-3572-4ef7-8533-2c481548d130 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:57.973779 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2a3c7eb5-3572-4ef7-8533-2c481548d130 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:57.974209 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2a3c7eb5-3572-4ef7-8533-2c481548d130 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:58.003027 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2a3c7eb5-3572-4ef7-8533-2c481548d130 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041817 Oct 29 01:17:58.003574 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 422/824] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:17:57 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:58.204763 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-357216d9-a3c6-4a14-9fb0-fb2f7ea39a5e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:58.205749 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-357216d9-a3c6-4a14-9fb0-fb2f7ea39a5e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:58.212613 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-357216d9-a3c6-4a14-9fb0-fb2f7ea39a5e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:58.213058 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-357216d9-a3c6-4a14-9fb0-fb2f7ea39a5e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:58.213821 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-357216d9-a3c6-4a14-9fb0-fb2f7ea39a5e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:58.214260 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-357216d9-a3c6-4a14-9fb0-fb2f7ea39a5e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:58.334425 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-357216d9-a3c6-4a14-9fb0-fb2f7ea39a5e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:58.341937 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-357216d9-a3c6-4a14-9fb0-fb2f7ea39a5e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.141739 Oct 29 01:17:58.342521 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 403/825] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:58 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:58.406218 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-6a9cb7c8-0b11-456b-98a7-01b4e76e3ea1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:58.407208 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-6a9cb7c8-0b11-456b-98a7-01b4e76e3ea1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:58.413358 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6a9cb7c8-0b11-456b-98a7-01b4e76e3ea1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:58.413800 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6a9cb7c8-0b11-456b-98a7-01b4e76e3ea1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:58.414603 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6a9cb7c8-0b11-456b-98a7-01b4e76e3ea1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:58.415057 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6a9cb7c8-0b11-456b-98a7-01b4e76e3ea1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:58.519015 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-6a9cb7c8-0b11-456b-98a7-01b4e76e3ea1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action" status: 200 len: 18155 microversion: 2.20 time: 0.116163 Oct 29 01:17:58.519818 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 423/826] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:17:58 2021] POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action => generated 18155 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:17:59.014363 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d319df88-61e1-4a5c-8ab6-83e975b94df4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:59.015348 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d319df88-61e1-4a5c-8ab6-83e975b94df4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:59.021569 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d319df88-61e1-4a5c-8ab6-83e975b94df4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:59.022019 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d319df88-61e1-4a5c-8ab6-83e975b94df4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:59.022819 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d319df88-61e1-4a5c-8ab6-83e975b94df4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:59.023254 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d319df88-61e1-4a5c-8ab6-83e975b94df4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:59.052005 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d319df88-61e1-4a5c-8ab6-83e975b94df4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041330 Oct 29 01:17:59.052569 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 404/827] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:17:59 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:59.360455 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d72ba330-d212-4b20-ab8a-b2f072e90ff8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:59.361176 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d72ba330-d212-4b20-ab8a-b2f072e90ff8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:59.368023 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d72ba330-d212-4b20-ab8a-b2f072e90ff8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:59.368460 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d72ba330-d212-4b20-ab8a-b2f072e90ff8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:59.369219 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d72ba330-d212-4b20-ab8a-b2f072e90ff8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:59.369647 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d72ba330-d212-4b20-ab8a-b2f072e90ff8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:59.500917 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-d72ba330-d212-4b20-ab8a-b2f072e90ff8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:59.508814 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d72ba330-d212-4b20-ab8a-b2f072e90ff8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.153097 Oct 29 01:17:59.509394 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 424/828] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:17:59 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:59.530108 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-8688c7a6-b063-451a-95bd-3abcc76bfec2 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:59.532059 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-8688c7a6-b063-451a-95bd-3abcc76bfec2 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:17:59.537918 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8688c7a6-b063-451a-95bd-3abcc76bfec2 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:59.538369 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8688c7a6-b063-451a-95bd-3abcc76bfec2 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:59.539167 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8688c7a6-b063-451a-95bd-3abcc76bfec2 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:17:59.539606 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8688c7a6-b063-451a-95bd-3abcc76bfec2 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:17:59.673634 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-8688c7a6-b063-451a-95bd-3abcc76bfec2 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action" status: 200 len: 18356 microversion: 2.20 time: 0.146899 Oct 29 01:17:59.674481 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 405/829] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:17:59 2021] POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action => generated 18356 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:18:00.064673 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-a31bdbcd-f2a3-4244-8ffa-2934d282dda3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:00.065588 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-a31bdbcd-f2a3-4244-8ffa-2934d282dda3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:00.071859 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a31bdbcd-f2a3-4244-8ffa-2934d282dda3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:00.072360 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a31bdbcd-f2a3-4244-8ffa-2934d282dda3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:00.073102 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a31bdbcd-f2a3-4244-8ffa-2934d282dda3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:00.073501 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a31bdbcd-f2a3-4244-8ffa-2934d282dda3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:00.103712 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-a31bdbcd-f2a3-4244-8ffa-2934d282dda3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043615 Oct 29 01:18:00.104271 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 425/830] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:00 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:00.526969 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b566d0c3-f948-4a7e-ba8d-4e9c29b2c5cf tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:00.527660 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b566d0c3-f948-4a7e-ba8d-4e9c29b2c5cf tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:00.534561 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b566d0c3-f948-4a7e-ba8d-4e9c29b2c5cf tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:00.535137 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b566d0c3-f948-4a7e-ba8d-4e9c29b2c5cf tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:00.535742 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b566d0c3-f948-4a7e-ba8d-4e9c29b2c5cf tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:00.536169 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b566d0c3-f948-4a7e-ba8d-4e9c29b2c5cf tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:00.669055 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-b566d0c3-f948-4a7e-ba8d-4e9c29b2c5cf tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:00.678200 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b566d0c3-f948-4a7e-ba8d-4e9c29b2c5cf tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.155082 Oct 29 01:18:00.680129 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 406/831] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:00 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:00.684999 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-819e3ef2-78b4-4f23-b056-85d9958a7a0d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:18:00.686127 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-819e3ef2-78b4-4f23-b056-85d9958a7a0d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:00.692553 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-819e3ef2-78b4-4f23-b056-85d9958a7a0d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:00.693002 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-819e3ef2-78b4-4f23-b056-85d9958a7a0d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:00.693776 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-819e3ef2-78b4-4f23-b056-85d9958a7a0d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:00.694207 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-819e3ef2-78b4-4f23-b056-85d9958a7a0d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:00.796346 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-819e3ef2-78b4-4f23-b056-85d9958a7a0d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action" status: 200 len: 20985 microversion: 2.20 time: 0.115021 Oct 29 01:18:00.797956 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 426/832] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:18:00 2021] POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action => generated 20985 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:18:01.115226 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-63e47362-25c5-436a-ae30-9713dcb06a45 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:01.116141 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-63e47362-25c5-436a-ae30-9713dcb06a45 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:01.122375 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-63e47362-25c5-436a-ae30-9713dcb06a45 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:01.122846 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-63e47362-25c5-436a-ae30-9713dcb06a45 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:01.123603 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-63e47362-25c5-436a-ae30-9713dcb06a45 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:01.124033 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-63e47362-25c5-436a-ae30-9713dcb06a45 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:01.156181 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-63e47362-25c5-436a-ae30-9713dcb06a45 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044702 Oct 29 01:18:01.156739 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 407/833] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:01 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:01.701678 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f0319e18-6712-4ed2-8915-16f087a15268 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:01.702259 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f0319e18-6712-4ed2-8915-16f087a15268 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:01.710060 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f0319e18-6712-4ed2-8915-16f087a15268 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:01.710537 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f0319e18-6712-4ed2-8915-16f087a15268 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:01.711303 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f0319e18-6712-4ed2-8915-16f087a15268 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:01.711745 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f0319e18-6712-4ed2-8915-16f087a15268 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:01.810952 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-0462fbf4-803c-42e4-865d-824a89ca7de4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:18:01.811959 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-0462fbf4-803c-42e4-865d-824a89ca7de4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:01.819135 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0462fbf4-803c-42e4-865d-824a89ca7de4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:01.819664 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0462fbf4-803c-42e4-865d-824a89ca7de4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:01.820503 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0462fbf4-803c-42e4-865d-824a89ca7de4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:01.821005 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0462fbf4-803c-42e4-865d-824a89ca7de4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:01.845958 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-f0319e18-6712-4ed2-8915-16f087a15268 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:01.854174 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f0319e18-6712-4ed2-8915-16f087a15268 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.156872 Oct 29 01:18:01.854904 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 427/834] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:01 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:01.924842 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-0462fbf4-803c-42e4-865d-824a89ca7de4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action" status: 200 len: 22711 microversion: 2.20 time: 0.119112 Oct 29 01:18:01.925742 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 408/835] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:18:01 2021] POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action => generated 22711 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:18:02.167915 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-77cf6dca-a532-4314-8cee-0234b3db0d84 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:02.168818 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-77cf6dca-a532-4314-8cee-0234b3db0d84 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:02.175758 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-77cf6dca-a532-4314-8cee-0234b3db0d84 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:02.176203 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-77cf6dca-a532-4314-8cee-0234b3db0d84 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:02.176980 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-77cf6dca-a532-4314-8cee-0234b3db0d84 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:02.177413 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-77cf6dca-a532-4314-8cee-0234b3db0d84 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:02.208411 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-77cf6dca-a532-4314-8cee-0234b3db0d84 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044366 Oct 29 01:18:02.209211 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 428/836] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:02 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:02.872526 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-03ee6a78-50f1-40f8-82cf-80038a21dc15 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:02.873211 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-03ee6a78-50f1-40f8-82cf-80038a21dc15 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:02.880995 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-03ee6a78-50f1-40f8-82cf-80038a21dc15 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:02.881437 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-03ee6a78-50f1-40f8-82cf-80038a21dc15 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:02.882195 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-03ee6a78-50f1-40f8-82cf-80038a21dc15 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:02.882648 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-03ee6a78-50f1-40f8-82cf-80038a21dc15 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:02.936568 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-6f25138d-66f1-4590-9453-f53e23e40270 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:18:02.937505 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-6f25138d-66f1-4590-9453-f53e23e40270 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:02.944621 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6f25138d-66f1-4590-9453-f53e23e40270 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:02.945087 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6f25138d-66f1-4590-9453-f53e23e40270 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:02.945855 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6f25138d-66f1-4590-9453-f53e23e40270 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:02.946286 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6f25138d-66f1-4590-9453-f53e23e40270 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:03.012607 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-03ee6a78-50f1-40f8-82cf-80038a21dc15 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:03.020972 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-03ee6a78-50f1-40f8-82cf-80038a21dc15 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.152657 Oct 29 01:18:03.021538 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 409/837] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:02 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:03.043935 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-6f25138d-66f1-4590-9453-f53e23e40270 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action" status: 200 len: 23791 microversion: 2.20 time: 0.111196 Oct 29 01:18:03.044571 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 429/838] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:18:02 2021] POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action => generated 23791 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:18:03.220234 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-fa64f283-8148-4723-bd6b-090a074d9c08 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:03.221061 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-fa64f283-8148-4723-bd6b-090a074d9c08 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:03.227476 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fa64f283-8148-4723-bd6b-090a074d9c08 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:03.227925 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fa64f283-8148-4723-bd6b-090a074d9c08 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:03.228705 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fa64f283-8148-4723-bd6b-090a074d9c08 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:03.229148 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fa64f283-8148-4723-bd6b-090a074d9c08 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:03.261098 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-fa64f283-8148-4723-bd6b-090a074d9c08 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044677 Oct 29 01:18:03.261657 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 410/839] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:03 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:04.038993 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-0165a328-5133-4565-a822-fb2120f50b69 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:04.039602 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-0165a328-5133-4565-a822-fb2120f50b69 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:04.046353 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0165a328-5133-4565-a822-fb2120f50b69 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:04.046836 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0165a328-5133-4565-a822-fb2120f50b69 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:04.047605 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0165a328-5133-4565-a822-fb2120f50b69 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:04.048041 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0165a328-5133-4565-a822-fb2120f50b69 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:04.054795 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a471141a-5c02-4b40-b8d7-db5fee105a97 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:18:04.055704 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a471141a-5c02-4b40-b8d7-db5fee105a97 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:04.062195 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a471141a-5c02-4b40-b8d7-db5fee105a97 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:04.062680 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a471141a-5c02-4b40-b8d7-db5fee105a97 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:04.063458 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a471141a-5c02-4b40-b8d7-db5fee105a97 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:04.063934 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a471141a-5c02-4b40-b8d7-db5fee105a97 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:04.173859 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a471141a-5c02-4b40-b8d7-db5fee105a97 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action" status: 200 len: 25216 microversion: 2.20 time: 0.122382 Oct 29 01:18:04.177737 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 411/840] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:18:04 2021] POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action => generated 25216 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:18:04.180355 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-0165a328-5133-4565-a822-fb2120f50b69 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:04.188194 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-0165a328-5133-4565-a822-fb2120f50b69 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.153434 Oct 29 01:18:04.188750 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 430/841] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:04 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:04.273579 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f72cdc7c-e117-4a25-81c7-0ea2f3d0c022 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:04.274724 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f72cdc7c-e117-4a25-81c7-0ea2f3d0c022 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:04.281569 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f72cdc7c-e117-4a25-81c7-0ea2f3d0c022 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:04.282007 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f72cdc7c-e117-4a25-81c7-0ea2f3d0c022 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:04.282901 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f72cdc7c-e117-4a25-81c7-0ea2f3d0c022 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:04.283859 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f72cdc7c-e117-4a25-81c7-0ea2f3d0c022 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:04.313664 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f72cdc7c-e117-4a25-81c7-0ea2f3d0c022 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044157 Oct 29 01:18:04.314120 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 412/842] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:04 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:05.185470 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c6038ed4-1247-46f8-85ae-8a69efacbdbf tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:18:05.186383 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c6038ed4-1247-46f8-85ae-8a69efacbdbf tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:05.192651 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c6038ed4-1247-46f8-85ae-8a69efacbdbf tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:05.193102 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c6038ed4-1247-46f8-85ae-8a69efacbdbf tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:05.193873 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c6038ed4-1247-46f8-85ae-8a69efacbdbf tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:05.194308 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c6038ed4-1247-46f8-85ae-8a69efacbdbf tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:05.205445 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-bdfdad02-1279-4876-b85d-210d0b0d231b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:05.206298 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-bdfdad02-1279-4876-b85d-210d0b0d231b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:05.212569 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bdfdad02-1279-4876-b85d-210d0b0d231b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:05.212945 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bdfdad02-1279-4876-b85d-210d0b0d231b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:05.213696 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bdfdad02-1279-4876-b85d-210d0b0d231b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:05.214121 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bdfdad02-1279-4876-b85d-210d0b0d231b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:05.297951 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c6038ed4-1247-46f8-85ae-8a69efacbdbf tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action" status: 200 len: 26456 microversion: 2.20 time: 0.116076 Oct 29 01:18:05.299211 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 431/843] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:18:05 2021] POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action => generated 26456 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:18:05.325565 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c97600ea-ab83-461e-956b-07724e562246 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:05.326696 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c97600ea-ab83-461e-956b-07724e562246 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:05.333738 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c97600ea-ab83-461e-956b-07724e562246 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:05.334186 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c97600ea-ab83-461e-956b-07724e562246 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:05.334986 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c97600ea-ab83-461e-956b-07724e562246 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:05.335419 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c97600ea-ab83-461e-956b-07724e562246 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:05.338878 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-bdfdad02-1279-4876-b85d-210d0b0d231b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:05.346815 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-bdfdad02-1279-4876-b85d-210d0b0d231b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.145028 Oct 29 01:18:05.347373 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 413/844] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:05 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:18:05.365936 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c97600ea-ab83-461e-956b-07724e562246 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044687 Oct 29 01:18:05.366509 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 432/845] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:05 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:18:06.310854 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-3e788a08-c113-41e3-ad3e-51699b482a22 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:18:06.311673 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-3e788a08-c113-41e3-ad3e-51699b482a22 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:06.317819 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3e788a08-c113-41e3-ad3e-51699b482a22 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:06.318304 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3e788a08-c113-41e3-ad3e-51699b482a22 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:06.319103 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3e788a08-c113-41e3-ad3e-51699b482a22 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:06.319534 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3e788a08-c113-41e3-ad3e-51699b482a22 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:06.363483 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-70faea89-4a10-4c2c-b406-754954e1bf9b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:06.364094 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-70faea89-4a10-4c2c-b406-754954e1bf9b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:06.372075 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-70faea89-4a10-4c2c-b406-754954e1bf9b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:06.372348 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-70faea89-4a10-4c2c-b406-754954e1bf9b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:06.373353 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-70faea89-4a10-4c2c-b406-754954e1bf9b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:06.373781 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-70faea89-4a10-4c2c-b406-754954e1bf9b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:06.424786 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-3e788a08-c113-41e3-ad3e-51699b482a22 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action" status: 200 len: 27413 microversion: 2.20 time: 0.118037 Oct 29 01:18:06.425431 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 414/846] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:18:06 2021] POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action => generated 27413 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:18:06.430283 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-74c4fb2f-61e9-48e4-83bf-d4c7b6f1745d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:06.431316 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-74c4fb2f-61e9-48e4-83bf-d4c7b6f1745d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:06.438126 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-74c4fb2f-61e9-48e4-83bf-d4c7b6f1745d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:06.438592 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-74c4fb2f-61e9-48e4-83bf-d4c7b6f1745d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:06.439390 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-74c4fb2f-61e9-48e4-83bf-d4c7b6f1745d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:06.439816 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-74c4fb2f-61e9-48e4-83bf-d4c7b6f1745d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:06.470903 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-74c4fb2f-61e9-48e4-83bf-d4c7b6f1745d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043725 Oct 29 01:18:06.471494 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 415/847] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:06 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:06.497660 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-70faea89-4a10-4c2c-b406-754954e1bf9b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:06.505060 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-70faea89-4a10-4c2c-b406-754954e1bf9b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.145225 Oct 29 01:18:06.505615 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 433/848] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:06 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:18:07.436414 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-272660f8-0d7d-48d6-a3f8-469b2159bfed tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:18:07.437326 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-272660f8-0d7d-48d6-a3f8-469b2159bfed tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:07.444044 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-272660f8-0d7d-48d6-a3f8-469b2159bfed tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:07.444496 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-272660f8-0d7d-48d6-a3f8-469b2159bfed tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:07.445293 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-272660f8-0d7d-48d6-a3f8-469b2159bfed tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:07.445726 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-272660f8-0d7d-48d6-a3f8-469b2159bfed tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:07.482686 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-615a726d-0b45-4710-ab18-1377c2dc4ec0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:07.483598 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-615a726d-0b45-4710-ab18-1377c2dc4ec0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:07.490551 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-615a726d-0b45-4710-ab18-1377c2dc4ec0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:07.490999 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-615a726d-0b45-4710-ab18-1377c2dc4ec0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:07.491765 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-615a726d-0b45-4710-ab18-1377c2dc4ec0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:07.492199 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-615a726d-0b45-4710-ab18-1377c2dc4ec0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:07.522575 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-615a726d-0b45-4710-ab18-1377c2dc4ec0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043974 Oct 29 01:18:07.523133 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 434/849] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:07 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:18:07.527277 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-094d0ade-e0da-44f2-9613-3fb10d3ff8ab tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:07.527873 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-094d0ade-e0da-44f2-9613-3fb10d3ff8ab tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:07.533197 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-094d0ade-e0da-44f2-9613-3fb10d3ff8ab tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:07.533638 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-094d0ade-e0da-44f2-9613-3fb10d3ff8ab tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:07.534414 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-094d0ade-e0da-44f2-9613-3fb10d3ff8ab tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:07.534844 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-094d0ade-e0da-44f2-9613-3fb10d3ff8ab tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:07.555117 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-272660f8-0d7d-48d6-a3f8-469b2159bfed tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action" status: 200 len: 27838 microversion: 2.20 time: 0.122215 Oct 29 01:18:07.559011 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 416/850] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:18:07 2021] POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action => generated 27838 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:18:07.659148 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-094d0ade-e0da-44f2-9613-3fb10d3ff8ab tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:07.666815 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-094d0ade-e0da-44f2-9613-3fb10d3ff8ab tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.142629 Oct 29 01:18:07.667317 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 435/851] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:07 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:08.534111 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d920f166-a9d4-4237-b092-5d4e64144598 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:08.535145 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d920f166-a9d4-4237-b092-5d4e64144598 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:08.541902 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d920f166-a9d4-4237-b092-5d4e64144598 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:08.542343 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d920f166-a9d4-4237-b092-5d4e64144598 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:08.543124 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d920f166-a9d4-4237-b092-5d4e64144598 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:08.543552 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d920f166-a9d4-4237-b092-5d4e64144598 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:08.566711 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-783831a2-e9f9-43c9-96c0-158210d53be1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:18:08.567634 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-783831a2-e9f9-43c9-96c0-158210d53be1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:08.572790 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d920f166-a9d4-4237-b092-5d4e64144598 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043315 Oct 29 01:18:08.573355 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 417/852] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:08 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:08.573970 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-783831a2-e9f9-43c9-96c0-158210d53be1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:08.574448 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-783831a2-e9f9-43c9-96c0-158210d53be1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:08.575257 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-783831a2-e9f9-43c9-96c0-158210d53be1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:08.575689 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-783831a2-e9f9-43c9-96c0-158210d53be1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:08.682785 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-251dbf70-0dd6-409e-a43f-dfaa92bef448 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:08.683394 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-251dbf70-0dd6-409e-a43f-dfaa92bef448 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:08.689561 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-251dbf70-0dd6-409e-a43f-dfaa92bef448 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:08.690007 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-251dbf70-0dd6-409e-a43f-dfaa92bef448 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:08.690811 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-251dbf70-0dd6-409e-a43f-dfaa92bef448 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:08.691246 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-251dbf70-0dd6-409e-a43f-dfaa92bef448 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:08.815430 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-251dbf70-0dd6-409e-a43f-dfaa92bef448 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:08.823147 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-251dbf70-0dd6-409e-a43f-dfaa92bef448 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.143872 Oct 29 01:18:08.823713 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 418/853] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:08 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:18:09.584325 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9cf2e89c-c320-455c-96a5-4dd6050b82de tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:09.585266 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9cf2e89c-c320-455c-96a5-4dd6050b82de tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:09.591696 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9cf2e89c-c320-455c-96a5-4dd6050b82de tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:09.592142 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9cf2e89c-c320-455c-96a5-4dd6050b82de tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:09.592909 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9cf2e89c-c320-455c-96a5-4dd6050b82de tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:09.593345 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9cf2e89c-c320-455c-96a5-4dd6050b82de tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:09.623710 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9cf2e89c-c320-455c-96a5-4dd6050b82de tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043323 Oct 29 01:18:09.624179 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 419/854] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:09 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:18:09.840985 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-0b188c2a-5685-42ce-a074-887dae5271d7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:09.841617 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-0b188c2a-5685-42ce-a074-887dae5271d7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:09.847996 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0b188c2a-5685-42ce-a074-887dae5271d7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:09.848441 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0b188c2a-5685-42ce-a074-887dae5271d7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:09.849193 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0b188c2a-5685-42ce-a074-887dae5271d7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:09.849620 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0b188c2a-5685-42ce-a074-887dae5271d7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:09.970919 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-0b188c2a-5685-42ce-a074-887dae5271d7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:09.978669 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-0b188c2a-5685-42ce-a074-887dae5271d7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.141356 Oct 29 01:18:09.979586 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 420/855] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:09 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:18:10.634520 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-556c3702-a791-4de3-ae5b-52b0bad2caed tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:10.635992 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-556c3702-a791-4de3-ae5b-52b0bad2caed tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:10.643297 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-556c3702-a791-4de3-ae5b-52b0bad2caed tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:10.643748 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-556c3702-a791-4de3-ae5b-52b0bad2caed tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:10.644528 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-556c3702-a791-4de3-ae5b-52b0bad2caed tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:10.644968 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-556c3702-a791-4de3-ae5b-52b0bad2caed tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:10.676338 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-556c3702-a791-4de3-ae5b-52b0bad2caed tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045584 Oct 29 01:18:10.677336 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 421/856] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:10 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:18:10.702215 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-783831a2-e9f9-43c9-96c0-158210d53be1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action" status: 200 len: 28190 microversion: 2.20 time: 2.139157 Oct 29 01:18:10.702915 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 436/857] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:18:08 2021] POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action => generated 28190 bytes in 2141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:18:10.995913 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-84a08970-fa71-4ab0-bd48-ed3953e5a5ac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:10.996525 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-84a08970-fa71-4ab0-bd48-ed3953e5a5ac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:11.002816 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-84a08970-fa71-4ab0-bd48-ed3953e5a5ac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:11.003270 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-84a08970-fa71-4ab0-bd48-ed3953e5a5ac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:11.004041 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-84a08970-fa71-4ab0-bd48-ed3953e5a5ac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:11.004476 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-84a08970-fa71-4ab0-bd48-ed3953e5a5ac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:11.140961 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-84a08970-fa71-4ab0-bd48-ed3953e5a5ac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:11.149635 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-84a08970-fa71-4ab0-bd48-ed3953e5a5ac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.157315 Oct 29 01:18:11.150238 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 422/858] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:10 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:11.688293 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2b967bac-d32b-4942-93b8-827f99d9f007 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:11.689290 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2b967bac-d32b-4942-93b8-827f99d9f007 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:11.697340 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2b967bac-d32b-4942-93b8-827f99d9f007 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:11.697784 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2b967bac-d32b-4942-93b8-827f99d9f007 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:11.698664 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2b967bac-d32b-4942-93b8-827f99d9f007 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:11.699112 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2b967bac-d32b-4942-93b8-827f99d9f007 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:11.719168 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-02419091-8603-49db-8e32-67753c35ca97 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:18:11.720657 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-02419091-8603-49db-8e32-67753c35ca97 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:11.730354 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-02419091-8603-49db-8e32-67753c35ca97 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:11.731322 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-02419091-8603-49db-8e32-67753c35ca97 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:11.732182 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-02419091-8603-49db-8e32-67753c35ca97 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:11.732735 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-02419091-8603-49db-8e32-67753c35ca97 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:11.746418 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2b967bac-d32b-4942-93b8-827f99d9f007 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062647 Oct 29 01:18:11.747265 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 437/859] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:11 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:11.838234 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-02419091-8603-49db-8e32-67753c35ca97 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action" status: 200 len: 28190 microversion: 2.20 time: 0.125633 Oct 29 01:18:11.839270 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 423/860] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:18:11 2021] POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action => generated 28190 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:18:12.168034 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-5ae4a3f8-8b20-462d-bed7-21a66f50b5f6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:12.168747 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-5ae4a3f8-8b20-462d-bed7-21a66f50b5f6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:12.176118 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5ae4a3f8-8b20-462d-bed7-21a66f50b5f6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:12.176564 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5ae4a3f8-8b20-462d-bed7-21a66f50b5f6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:12.177347 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5ae4a3f8-8b20-462d-bed7-21a66f50b5f6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:12.177791 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5ae4a3f8-8b20-462d-bed7-21a66f50b5f6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:12.319724 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-5ae4a3f8-8b20-462d-bed7-21a66f50b5f6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:12.327180 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-5ae4a3f8-8b20-462d-bed7-21a66f50b5f6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.162811 Oct 29 01:18:12.327716 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 438/861] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:12 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:12.760259 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c09ad3bc-3561-4780-a7ca-3f4b2f9c490f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:12.761413 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c09ad3bc-3561-4780-a7ca-3f4b2f9c490f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:12.769973 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c09ad3bc-3561-4780-a7ca-3f4b2f9c490f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:12.770615 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c09ad3bc-3561-4780-a7ca-3f4b2f9c490f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:12.771546 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c09ad3bc-3561-4780-a7ca-3f4b2f9c490f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:12.772059 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c09ad3bc-3561-4780-a7ca-3f4b2f9c490f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:12.805627 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c09ad3bc-3561-4780-a7ca-3f4b2f9c490f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049731 Oct 29 01:18:12.806237 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 424/862] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:12 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:12.851625 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-dc96b3b6-dd2d-4696-b880-54d6ef7b9684 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:18:12.852537 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-dc96b3b6-dd2d-4696-b880-54d6ef7b9684 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:12.858970 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dc96b3b6-dd2d-4696-b880-54d6ef7b9684 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:12.859422 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dc96b3b6-dd2d-4696-b880-54d6ef7b9684 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:12.860184 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dc96b3b6-dd2d-4696-b880-54d6ef7b9684 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:12.860636 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dc96b3b6-dd2d-4696-b880-54d6ef7b9684 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:12.974588 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-dc96b3b6-dd2d-4696-b880-54d6ef7b9684 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action" status: 200 len: 28317 microversion: 2.20 time: 0.127416 Oct 29 01:18:12.975245 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 439/863] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:18:12 2021] POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action => generated 28317 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:18:13.345654 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b644d818-090e-4c31-8e32-9e187ea36e53 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:13.345654 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b644d818-090e-4c31-8e32-9e187ea36e53 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:13.353001 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b644d818-090e-4c31-8e32-9e187ea36e53 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:13.353451 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b644d818-090e-4c31-8e32-9e187ea36e53 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:13.354225 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b644d818-090e-4c31-8e32-9e187ea36e53 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:13.354688 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b644d818-090e-4c31-8e32-9e187ea36e53 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:13.490274 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-b644d818-090e-4c31-8e32-9e187ea36e53 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:13.498017 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b644d818-090e-4c31-8e32-9e187ea36e53 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.156724 Oct 29 01:18:13.498614 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 425/864] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:13 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:13.821864 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-4a171860-2c80-4f19-a73e-74686126090e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:13.822920 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-4a171860-2c80-4f19-a73e-74686126090e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:13.829933 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4a171860-2c80-4f19-a73e-74686126090e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:13.830971 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4a171860-2c80-4f19-a73e-74686126090e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:13.832092 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4a171860-2c80-4f19-a73e-74686126090e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:13.832579 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4a171860-2c80-4f19-a73e-74686126090e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:13.865339 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-4a171860-2c80-4f19-a73e-74686126090e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051094 Oct 29 01:18:13.866043 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 440/865] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:13 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:13.986572 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-78595f18-a9f6-45dd-a3da-04b6e81543bd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:18:13.987594 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-78595f18-a9f6-45dd-a3da-04b6e81543bd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:13.993977 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-78595f18-a9f6-45dd-a3da-04b6e81543bd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:13.994471 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-78595f18-a9f6-45dd-a3da-04b6e81543bd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:13.995353 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-78595f18-a9f6-45dd-a3da-04b6e81543bd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:13.995787 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-78595f18-a9f6-45dd-a3da-04b6e81543bd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:14.130174 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-78595f18-a9f6-45dd-a3da-04b6e81543bd tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action" status: 200 len: 28481 microversion: 2.20 time: 0.147316 Oct 29 01:18:14.130863 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 426/866] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:18:13 2021] POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action => generated 28481 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:18:14.514143 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-4c6aee75-8375-442e-9c08-49c6b52bba6b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:14.514725 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-4c6aee75-8375-442e-9c08-49c6b52bba6b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:14.521547 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4c6aee75-8375-442e-9c08-49c6b52bba6b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:14.521990 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4c6aee75-8375-442e-9c08-49c6b52bba6b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:14.522794 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4c6aee75-8375-442e-9c08-49c6b52bba6b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:14.523229 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4c6aee75-8375-442e-9c08-49c6b52bba6b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:14.652238 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-4c6aee75-8375-442e-9c08-49c6b52bba6b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:14.659874 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-4c6aee75-8375-442e-9c08-49c6b52bba6b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.149351 Oct 29 01:18:14.660497 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 441/867] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:14 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:14.878156 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9bfa82b7-92e1-41ab-9c92-64a40c59c1e8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:14.879176 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9bfa82b7-92e1-41ab-9c92-64a40c59c1e8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:14.886047 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9bfa82b7-92e1-41ab-9c92-64a40c59c1e8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:14.886541 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9bfa82b7-92e1-41ab-9c92-64a40c59c1e8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:14.887291 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9bfa82b7-92e1-41ab-9c92-64a40c59c1e8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:14.887715 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9bfa82b7-92e1-41ab-9c92-64a40c59c1e8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:14.932577 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9bfa82b7-92e1-41ab-9c92-64a40c59c1e8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059085 Oct 29 01:18:14.933175 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 427/868] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:14 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:15.142742 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-7c4b7feb-f7a3-400f-a30f-82e1d7c96d60 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:18:15.144169 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-7c4b7feb-f7a3-400f-a30f-82e1d7c96d60 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:15.150628 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7c4b7feb-f7a3-400f-a30f-82e1d7c96d60 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:15.151072 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7c4b7feb-f7a3-400f-a30f-82e1d7c96d60 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:15.151840 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7c4b7feb-f7a3-400f-a30f-82e1d7c96d60 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:15.152270 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7c4b7feb-f7a3-400f-a30f-82e1d7c96d60 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:15.264783 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-7c4b7feb-f7a3-400f-a30f-82e1d7c96d60 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action" status: 200 len: 28649 microversion: 2.20 time: 0.126077 Oct 29 01:18:15.265441 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 442/869] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:18:15 2021] POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action => generated 28649 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:18:15.677791 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-bc618e5e-7a83-4771-8391-66763f6c2db2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:15.678419 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-bc618e5e-7a83-4771-8391-66763f6c2db2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:15.684704 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bc618e5e-7a83-4771-8391-66763f6c2db2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:15.685152 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bc618e5e-7a83-4771-8391-66763f6c2db2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:15.685920 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bc618e5e-7a83-4771-8391-66763f6c2db2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:15.686356 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bc618e5e-7a83-4771-8391-66763f6c2db2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:15.812074 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-bc618e5e-7a83-4771-8391-66763f6c2db2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:15.818864 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-bc618e5e-7a83-4771-8391-66763f6c2db2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.145370 Oct 29 01:18:15.819430 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 428/870] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:15 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:15.943794 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-9385880b-7b83-48b4-b75c-126344606d31 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:15.944700 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-9385880b-7b83-48b4-b75c-126344606d31 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:15.951749 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9385880b-7b83-48b4-b75c-126344606d31 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:15.952195 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9385880b-7b83-48b4-b75c-126344606d31 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:15.952976 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9385880b-7b83-48b4-b75c-126344606d31 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:15.953411 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9385880b-7b83-48b4-b75c-126344606d31 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:15.986484 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-9385880b-7b83-48b4-b75c-126344606d31 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046859 Oct 29 01:18:15.987085 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 443/871] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:15 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:16.275835 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f87c2a3a-1f30-4402-8135-2457650fa746 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:18:16.276622 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f87c2a3a-1f30-4402-8135-2457650fa746 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:16.288786 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f87c2a3a-1f30-4402-8135-2457650fa746 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:16.289226 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f87c2a3a-1f30-4402-8135-2457650fa746 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:16.289990 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f87c2a3a-1f30-4402-8135-2457650fa746 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:16.290469 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f87c2a3a-1f30-4402-8135-2457650fa746 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:16.394479 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f87c2a3a-1f30-4402-8135-2457650fa746 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action" status: 200 len: 28649 microversion: 2.20 time: 0.122201 Oct 29 01:18:16.395211 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 429/872] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:18:16 2021] POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action => generated 28649 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:18:16.836495 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-7c4bfb3e-431a-4ce9-bb03-195f4eb418e6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:16.837170 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-7c4bfb3e-431a-4ce9-bb03-195f4eb418e6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:16.843748 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7c4bfb3e-431a-4ce9-bb03-195f4eb418e6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:16.844196 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7c4bfb3e-431a-4ce9-bb03-195f4eb418e6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:16.844972 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7c4bfb3e-431a-4ce9-bb03-195f4eb418e6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:16.845405 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7c4bfb3e-431a-4ce9-bb03-195f4eb418e6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:16.971174 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-7c4bfb3e-431a-4ce9-bb03-195f4eb418e6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:16.978586 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-7c4bfb3e-431a-4ce9-bb03-195f4eb418e6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.146096 Oct 29 01:18:16.979175 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 444/873] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:16 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:18:16.998255 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-79eeadb7-b7a1-4e8c-865d-0bc0d0496db7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:16.999294 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-79eeadb7-b7a1-4e8c-865d-0bc0d0496db7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:17.006568 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-79eeadb7-b7a1-4e8c-865d-0bc0d0496db7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:17.007068 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-79eeadb7-b7a1-4e8c-865d-0bc0d0496db7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:17.007855 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-79eeadb7-b7a1-4e8c-865d-0bc0d0496db7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:17.008275 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-79eeadb7-b7a1-4e8c-865d-0bc0d0496db7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:17.038573 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-79eeadb7-b7a1-4e8c-865d-0bc0d0496db7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044456 Oct 29 01:18:17.039148 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 430/874] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:16 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:17.407594 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-ac74ac5b-0147-4cd9-9497-4cef6d61685d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:18:17.409159 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-ac74ac5b-0147-4cd9-9497-4cef6d61685d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:17.415972 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ac74ac5b-0147-4cd9-9497-4cef6d61685d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:17.416605 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ac74ac5b-0147-4cd9-9497-4cef6d61685d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:17.417388 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ac74ac5b-0147-4cd9-9497-4cef6d61685d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:17.417852 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ac74ac5b-0147-4cd9-9497-4cef6d61685d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:17.534528 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-ac74ac5b-0147-4cd9-9497-4cef6d61685d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action" status: 200 len: 28649 microversion: 2.20 time: 0.130513 Oct 29 01:18:17.535218 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 445/875] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:18:17 2021] POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action => generated 28649 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:18:17.996019 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ea0f10cb-fa21-4dfd-adcd-dcdebc84850f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:17.996656 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ea0f10cb-fa21-4dfd-adcd-dcdebc84850f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:18.003555 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ea0f10cb-fa21-4dfd-adcd-dcdebc84850f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:18.006859 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ea0f10cb-fa21-4dfd-adcd-dcdebc84850f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:18.006859 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ea0f10cb-fa21-4dfd-adcd-dcdebc84850f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:18.006859 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ea0f10cb-fa21-4dfd-adcd-dcdebc84850f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:18.049905 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-1c0a020a-c4a9-430d-bbdf-3372480e75a7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:18.050967 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-1c0a020a-c4a9-430d-bbdf-3372480e75a7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:18.058039 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1c0a020a-c4a9-430d-bbdf-3372480e75a7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:18.058652 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1c0a020a-c4a9-430d-bbdf-3372480e75a7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:18.059664 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1c0a020a-c4a9-430d-bbdf-3372480e75a7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:18.060099 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1c0a020a-c4a9-430d-bbdf-3372480e75a7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:18.093949 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-1c0a020a-c4a9-430d-bbdf-3372480e75a7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048203 Oct 29 01:18:18.094591 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 446/876] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:18 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:18:18.138031 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-ea0f10cb-fa21-4dfd-adcd-dcdebc84850f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:18.146250 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ea0f10cb-fa21-4dfd-adcd-dcdebc84850f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.153838 Oct 29 01:18:18.146855 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 431/877] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:17 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:18.547088 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-dc5c1039-5c56-486c-8017-60bcefad645e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:18:18.548026 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-dc5c1039-5c56-486c-8017-60bcefad645e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:18.555715 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dc5c1039-5c56-486c-8017-60bcefad645e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:18.556219 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dc5c1039-5c56-486c-8017-60bcefad645e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:18.565785 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dc5c1039-5c56-486c-8017-60bcefad645e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:18.565785 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dc5c1039-5c56-486c-8017-60bcefad645e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:18.676024 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-dc5c1039-5c56-486c-8017-60bcefad645e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action" status: 200 len: 28649 microversion: 2.20 time: 0.132750 Oct 29 01:18:18.676702 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 447/878] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:18:18 2021] POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action => generated 28649 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:18:19.105220 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-820efefb-ddbc-4f50-a523-f9d7041dda33 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:19.106153 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-820efefb-ddbc-4f50-a523-f9d7041dda33 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:19.113106 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-820efefb-ddbc-4f50-a523-f9d7041dda33 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:19.113595 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-820efefb-ddbc-4f50-a523-f9d7041dda33 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:19.114427 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-820efefb-ddbc-4f50-a523-f9d7041dda33 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:19.114855 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-820efefb-ddbc-4f50-a523-f9d7041dda33 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:19.148775 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-820efefb-ddbc-4f50-a523-f9d7041dda33 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047061 Oct 29 01:18:19.149566 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 432/879] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:19 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:19.164477 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d7443d3b-c15b-47ca-872e-2db6d7780cbd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:19.165185 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d7443d3b-c15b-47ca-872e-2db6d7780cbd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:19.172245 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d7443d3b-c15b-47ca-872e-2db6d7780cbd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:19.172918 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d7443d3b-c15b-47ca-872e-2db6d7780cbd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:19.173820 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d7443d3b-c15b-47ca-872e-2db6d7780cbd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:19.174269 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d7443d3b-c15b-47ca-872e-2db6d7780cbd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:19.315443 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-d7443d3b-c15b-47ca-872e-2db6d7780cbd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:19.323098 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d7443d3b-c15b-47ca-872e-2db6d7780cbd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.162634 Oct 29 01:18:19.323682 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 448/880] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:19 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:19.688868 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-1dce8cab-97db-49ec-bbaa-016f0add2b62 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:18:19.690361 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-1dce8cab-97db-49ec-bbaa-016f0add2b62 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:19.697043 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1dce8cab-97db-49ec-bbaa-016f0add2b62 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:19.697492 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1dce8cab-97db-49ec-bbaa-016f0add2b62 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:19.698296 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1dce8cab-97db-49ec-bbaa-016f0add2b62 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:19.698745 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1dce8cab-97db-49ec-bbaa-016f0add2b62 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:19.801296 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-1dce8cab-97db-49ec-bbaa-016f0add2b62 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action" status: 200 len: 29297 microversion: 2.20 time: 0.116987 Oct 29 01:18:19.802171 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 433/881] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:18:19 2021] POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action => generated 29297 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:18:20.161262 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-95ea6907-39e9-4bc5-9a53-782c6095a1e5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:20.162247 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-95ea6907-39e9-4bc5-9a53-782c6095a1e5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:20.168890 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-95ea6907-39e9-4bc5-9a53-782c6095a1e5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:20.169572 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-95ea6907-39e9-4bc5-9a53-782c6095a1e5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:20.170096 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-95ea6907-39e9-4bc5-9a53-782c6095a1e5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:20.170563 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-95ea6907-39e9-4bc5-9a53-782c6095a1e5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:20.202095 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-95ea6907-39e9-4bc5-9a53-782c6095a1e5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045034 Oct 29 01:18:20.202809 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 449/882] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:20 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:20.340743 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-e6be087e-d6b7-4bfb-9ff2-aa7c2d23ae73 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:20.341396 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-e6be087e-d6b7-4bfb-9ff2-aa7c2d23ae73 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:20.350780 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e6be087e-d6b7-4bfb-9ff2-aa7c2d23ae73 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:20.351224 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e6be087e-d6b7-4bfb-9ff2-aa7c2d23ae73 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:20.352038 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e6be087e-d6b7-4bfb-9ff2-aa7c2d23ae73 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:20.352467 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e6be087e-d6b7-4bfb-9ff2-aa7c2d23ae73 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:20.481801 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-e6be087e-d6b7-4bfb-9ff2-aa7c2d23ae73 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:20.489573 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-e6be087e-d6b7-4bfb-9ff2-aa7c2d23ae73 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.153027 Oct 29 01:18:20.490130 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 434/883] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:20 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:20.812693 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-47f517f1-0b7d-4dce-ba28-dda0ac86626e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:18:20.813609 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-47f517f1-0b7d-4dce-ba28-dda0ac86626e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:20.820436 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-47f517f1-0b7d-4dce-ba28-dda0ac86626e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:20.820889 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-47f517f1-0b7d-4dce-ba28-dda0ac86626e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:20.821666 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-47f517f1-0b7d-4dce-ba28-dda0ac86626e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:20.822100 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-47f517f1-0b7d-4dce-ba28-dda0ac86626e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:20.924229 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-47f517f1-0b7d-4dce-ba28-dda0ac86626e tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action" status: 200 len: 31107 microversion: 2.20 time: 0.115051 Oct 29 01:18:20.924878 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 450/884] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:18:20 2021] POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action => generated 31107 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:18:21.213650 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-bf860ceb-b108-4e0d-9142-75fe8411fd94 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:21.214591 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-bf860ceb-b108-4e0d-9142-75fe8411fd94 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:21.223071 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bf860ceb-b108-4e0d-9142-75fe8411fd94 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:21.223690 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bf860ceb-b108-4e0d-9142-75fe8411fd94 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:21.224461 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bf860ceb-b108-4e0d-9142-75fe8411fd94 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:21.224920 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bf860ceb-b108-4e0d-9142-75fe8411fd94 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:21.257800 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-bf860ceb-b108-4e0d-9142-75fe8411fd94 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047815 Oct 29 01:18:21.258348 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 435/885] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:21 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:21.507606 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-bdf36855-51b0-4213-8d30-9fb7f9c21e8a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:21.508225 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-bdf36855-51b0-4213-8d30-9fb7f9c21e8a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:21.515830 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bdf36855-51b0-4213-8d30-9fb7f9c21e8a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:21.516302 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bdf36855-51b0-4213-8d30-9fb7f9c21e8a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:21.517085 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bdf36855-51b0-4213-8d30-9fb7f9c21e8a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:21.517519 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bdf36855-51b0-4213-8d30-9fb7f9c21e8a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:21.645472 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-bdf36855-51b0-4213-8d30-9fb7f9c21e8a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:21.653837 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-bdf36855-51b0-4213-8d30-9fb7f9c21e8a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.150809 Oct 29 01:18:21.654445 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 451/886] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:21 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:21.935673 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-7cc6c187-de12-42fa-b5af-310139fc25a1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:18:21.936640 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-7cc6c187-de12-42fa-b5af-310139fc25a1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:21.942981 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7cc6c187-de12-42fa-b5af-310139fc25a1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:21.943432 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7cc6c187-de12-42fa-b5af-310139fc25a1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:21.944198 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7cc6c187-de12-42fa-b5af-310139fc25a1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:21.944626 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7cc6c187-de12-42fa-b5af-310139fc25a1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:22.050977 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-7cc6c187-de12-42fa-b5af-310139fc25a1 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action" status: 200 len: 32928 microversion: 2.20 time: 0.118622 Oct 29 01:18:22.051524 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 436/887] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:18:21 2021] POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action => generated 32928 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:18:22.269149 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-287f046b-c32e-4b1c-86c9-292eb257e180 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:22.270071 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-287f046b-c32e-4b1c-86c9-292eb257e180 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:22.277592 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-287f046b-c32e-4b1c-86c9-292eb257e180 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:22.278162 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-287f046b-c32e-4b1c-86c9-292eb257e180 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:22.279123 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-287f046b-c32e-4b1c-86c9-292eb257e180 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:22.279658 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-287f046b-c32e-4b1c-86c9-292eb257e180 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:22.313953 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-287f046b-c32e-4b1c-86c9-292eb257e180 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048543 Oct 29 01:18:22.314461 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 452/888] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:22 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:18:22.671931 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-67574fbd-a033-48dc-a349-ad6416f9f30a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:22.672613 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-67574fbd-a033-48dc-a349-ad6416f9f30a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:22.679485 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-67574fbd-a033-48dc-a349-ad6416f9f30a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:22.679918 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-67574fbd-a033-48dc-a349-ad6416f9f30a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:22.680679 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-67574fbd-a033-48dc-a349-ad6416f9f30a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:22.681101 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-67574fbd-a033-48dc-a349-ad6416f9f30a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:22.818490 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-67574fbd-a033-48dc-a349-ad6416f9f30a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:22.830094 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-67574fbd-a033-48dc-a349-ad6416f9f30a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.161851 Oct 29 01:18:22.830955 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 437/889] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:22 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:23.063154 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-5b0d2f63-27c4-4963-8bdf-3290126a9021 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:18:23.064136 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-5b0d2f63-27c4-4963-8bdf-3290126a9021 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:23.071585 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5b0d2f63-27c4-4963-8bdf-3290126a9021 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:23.072029 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5b0d2f63-27c4-4963-8bdf-3290126a9021 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:23.072801 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5b0d2f63-27c4-4963-8bdf-3290126a9021 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:23.073232 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5b0d2f63-27c4-4963-8bdf-3290126a9021 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:23.176561 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-5b0d2f63-27c4-4963-8bdf-3290126a9021 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action" status: 200 len: 33718 microversion: 2.20 time: 0.117182 Oct 29 01:18:23.177212 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 453/890] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:18:23 2021] POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action => generated 33718 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:18:23.326820 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-eaba35bf-4e75-4bae-bb02-6f5d303d062f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:23.327643 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-eaba35bf-4e75-4bae-bb02-6f5d303d062f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:23.334265 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-eaba35bf-4e75-4bae-bb02-6f5d303d062f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:23.334738 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-eaba35bf-4e75-4bae-bb02-6f5d303d062f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:23.335491 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-eaba35bf-4e75-4bae-bb02-6f5d303d062f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:23.335918 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-eaba35bf-4e75-4bae-bb02-6f5d303d062f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:23.366035 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-eaba35bf-4e75-4bae-bb02-6f5d303d062f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043174 Oct 29 01:18:23.366611 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 438/891] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:23 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:23.851031 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-729a07c5-e41e-4adb-bb21-2c30f3a6e15e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:23.851728 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-729a07c5-e41e-4adb-bb21-2c30f3a6e15e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:23.859055 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-729a07c5-e41e-4adb-bb21-2c30f3a6e15e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:23.859504 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-729a07c5-e41e-4adb-bb21-2c30f3a6e15e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:23.860261 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-729a07c5-e41e-4adb-bb21-2c30f3a6e15e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:23.860693 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-729a07c5-e41e-4adb-bb21-2c30f3a6e15e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:23.993817 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-729a07c5-e41e-4adb-bb21-2c30f3a6e15e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:24.005848 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-729a07c5-e41e-4adb-bb21-2c30f3a6e15e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.158773 Oct 29 01:18:24.006619 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 454/892] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:23 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:24.189048 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-acf1d393-55ed-40ae-9435-2248d89daa5f tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:18:24.190716 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-acf1d393-55ed-40ae-9435-2248d89daa5f tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:24.197411 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-acf1d393-55ed-40ae-9435-2248d89daa5f tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:24.197879 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-acf1d393-55ed-40ae-9435-2248d89daa5f tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:24.198711 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-acf1d393-55ed-40ae-9435-2248d89daa5f tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:24.199165 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-acf1d393-55ed-40ae-9435-2248d89daa5f tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:24.327356 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-acf1d393-55ed-40ae-9435-2248d89daa5f tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action" status: 200 len: 34848 microversion: 2.20 time: 0.142156 Oct 29 01:18:24.328054 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 439/893] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:18:24 2021] POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action => generated 34848 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:18:24.378188 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-66ac16f9-18be-4a21-a34d-a49a98fe56a4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:24.379167 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-66ac16f9-18be-4a21-a34d-a49a98fe56a4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:24.385708 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-66ac16f9-18be-4a21-a34d-a49a98fe56a4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:24.386153 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-66ac16f9-18be-4a21-a34d-a49a98fe56a4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:24.386970 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-66ac16f9-18be-4a21-a34d-a49a98fe56a4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:24.387398 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-66ac16f9-18be-4a21-a34d-a49a98fe56a4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:24.420300 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-66ac16f9-18be-4a21-a34d-a49a98fe56a4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046524 Oct 29 01:18:24.420889 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 455/894] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:24 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:25.024088 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a0b5728b-515f-4dd4-9d47-2ea47ac462e0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:25.024785 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a0b5728b-515f-4dd4-9d47-2ea47ac462e0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:25.032013 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a0b5728b-515f-4dd4-9d47-2ea47ac462e0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:25.032462 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a0b5728b-515f-4dd4-9d47-2ea47ac462e0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:25.033230 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a0b5728b-515f-4dd4-9d47-2ea47ac462e0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:25.033662 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a0b5728b-515f-4dd4-9d47-2ea47ac462e0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:25.160942 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-a0b5728b-515f-4dd4-9d47-2ea47ac462e0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:25.168824 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a0b5728b-515f-4dd4-9d47-2ea47ac462e0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.148744 Oct 29 01:18:25.169386 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 440/895] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:25 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:25.339333 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-16a34802-9ef8-40b3-975d-240775a6b3db tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:18:25.340130 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-16a34802-9ef8-40b3-975d-240775a6b3db tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:25.347004 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-16a34802-9ef8-40b3-975d-240775a6b3db tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:25.347464 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-16a34802-9ef8-40b3-975d-240775a6b3db tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:25.348229 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-16a34802-9ef8-40b3-975d-240775a6b3db tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:25.348662 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-16a34802-9ef8-40b3-975d-240775a6b3db tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:25.433256 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-1e7c38d6-70e3-433d-a65d-47ad8b2ea031 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:25.434204 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-1e7c38d6-70e3-433d-a65d-47ad8b2ea031 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:25.440488 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1e7c38d6-70e3-433d-a65d-47ad8b2ea031 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:25.440935 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1e7c38d6-70e3-433d-a65d-47ad8b2ea031 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:25.441695 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1e7c38d6-70e3-433d-a65d-47ad8b2ea031 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:25.442126 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1e7c38d6-70e3-433d-a65d-47ad8b2ea031 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:25.447342 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-16a34802-9ef8-40b3-975d-240775a6b3db tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action" status: 200 len: 35891 microversion: 2.20 time: 0.111711 Oct 29 01:18:25.448380 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 456/896] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:18:25 2021] POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action => generated 35891 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:18:25.474301 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-1e7c38d6-70e3-433d-a65d-47ad8b2ea031 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045342 Oct 29 01:18:25.474847 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 441/897] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:25 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:26.188094 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-5141faaa-d035-4b6c-ada6-b8e9c150ddd8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:26.188792 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-5141faaa-d035-4b6c-ada6-b8e9c150ddd8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:26.197023 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5141faaa-d035-4b6c-ada6-b8e9c150ddd8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:26.197476 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5141faaa-d035-4b6c-ada6-b8e9c150ddd8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:26.198236 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5141faaa-d035-4b6c-ada6-b8e9c150ddd8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:26.198694 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5141faaa-d035-4b6c-ada6-b8e9c150ddd8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:26.324187 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-5141faaa-d035-4b6c-ada6-b8e9c150ddd8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:26.332929 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-5141faaa-d035-4b6c-ada6-b8e9c150ddd8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.149797 Oct 29 01:18:26.333495 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 457/898] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:26 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:26.462498 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-3736d459-1194-457d-a74e-6e67ed896665 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:18:26.463377 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-3736d459-1194-457d-a74e-6e67ed896665 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:26.469970 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3736d459-1194-457d-a74e-6e67ed896665 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:26.470440 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3736d459-1194-457d-a74e-6e67ed896665 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:26.471212 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3736d459-1194-457d-a74e-6e67ed896665 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:26.471643 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3736d459-1194-457d-a74e-6e67ed896665 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:26.485134 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-cb240a55-8acb-4052-bfb9-a163a4ff1563 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:26.486051 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-cb240a55-8acb-4052-bfb9-a163a4ff1563 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:26.494978 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cb240a55-8acb-4052-bfb9-a163a4ff1563 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:26.495435 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cb240a55-8acb-4052-bfb9-a163a4ff1563 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:26.496240 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cb240a55-8acb-4052-bfb9-a163a4ff1563 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:26.496950 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cb240a55-8acb-4052-bfb9-a163a4ff1563 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:26.530283 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-cb240a55-8acb-4052-bfb9-a163a4ff1563 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048992 Oct 29 01:18:26.530886 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 458/899] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:26 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:18:26.571298 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-3736d459-1194-457d-a74e-6e67ed896665 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action" status: 200 len: 37251 microversion: 2.20 time: 0.112863 Oct 29 01:18:26.571958 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 442/900] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:18:26 2021] POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action => generated 37251 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:18:27.354025 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-204dfa36-000c-4487-8d3d-ef809fa6ff40 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:27.355136 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-204dfa36-000c-4487-8d3d-ef809fa6ff40 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:27.362841 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-204dfa36-000c-4487-8d3d-ef809fa6ff40 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:27.363350 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-204dfa36-000c-4487-8d3d-ef809fa6ff40 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:27.364103 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-204dfa36-000c-4487-8d3d-ef809fa6ff40 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:27.364529 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-204dfa36-000c-4487-8d3d-ef809fa6ff40 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:27.505323 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-204dfa36-000c-4487-8d3d-ef809fa6ff40 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:27.513615 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-204dfa36-000c-4487-8d3d-ef809fa6ff40 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.165061 Oct 29 01:18:27.514260 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 459/901] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:27 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:27.547930 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-1aae19ff-f3aa-4317-b7df-2a9cd0fee5fc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:27.549300 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-1aae19ff-f3aa-4317-b7df-2a9cd0fee5fc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:27.557098 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1aae19ff-f3aa-4317-b7df-2a9cd0fee5fc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:27.557864 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1aae19ff-f3aa-4317-b7df-2a9cd0fee5fc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:27.559040 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1aae19ff-f3aa-4317-b7df-2a9cd0fee5fc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:27.559476 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1aae19ff-f3aa-4317-b7df-2a9cd0fee5fc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:27.584086 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-ef5b9643-85d5-446e-b21e-cd1030467878 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:18:27.585091 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-ef5b9643-85d5-446e-b21e-cd1030467878 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:27.590920 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ef5b9643-85d5-446e-b21e-cd1030467878 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:27.591375 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ef5b9643-85d5-446e-b21e-cd1030467878 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:27.592169 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ef5b9643-85d5-446e-b21e-cd1030467878 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:27.592603 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ef5b9643-85d5-446e-b21e-cd1030467878 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:27.596663 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-1aae19ff-f3aa-4317-b7df-2a9cd0fee5fc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059027 Oct 29 01:18:27.597235 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 443/902] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:27 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:27.693838 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-ef5b9643-85d5-446e-b21e-cd1030467878 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action" status: 200 len: 38200 microversion: 2.20 time: 0.113720 Oct 29 01:18:27.694575 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 460/903] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:18:27 2021] POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action => generated 38200 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:18:28.532594 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9e54da96-4d84-4fc3-9b3e-0f73e2ad7a47 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:28.533316 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9e54da96-4d84-4fc3-9b3e-0f73e2ad7a47 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:28.540283 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9e54da96-4d84-4fc3-9b3e-0f73e2ad7a47 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:28.540729 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9e54da96-4d84-4fc3-9b3e-0f73e2ad7a47 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:28.541493 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9e54da96-4d84-4fc3-9b3e-0f73e2ad7a47 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:28.541927 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9e54da96-4d84-4fc3-9b3e-0f73e2ad7a47 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:28.614050 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-80dd2e01-4450-42fd-a51b-e24fbc770f44 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:28.615610 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-80dd2e01-4450-42fd-a51b-e24fbc770f44 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:28.625304 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-80dd2e01-4450-42fd-a51b-e24fbc770f44 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:28.626055 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-80dd2e01-4450-42fd-a51b-e24fbc770f44 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:28.627400 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-80dd2e01-4450-42fd-a51b-e24fbc770f44 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:28.628081 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-80dd2e01-4450-42fd-a51b-e24fbc770f44 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:28.661193 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-80dd2e01-4450-42fd-a51b-e24fbc770f44 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055581 Oct 29 01:18:28.661763 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 461/904] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:28 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:18:28.678047 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-9e54da96-4d84-4fc3-9b3e-0f73e2ad7a47 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:28.686330 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9e54da96-4d84-4fc3-9b3e-0f73e2ad7a47 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.157938 Oct 29 01:18:28.686909 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 444/905] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:28 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:28.705302 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-70f1e812-d29d-4706-96de-84c19b9efc51 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:18:28.706769 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-70f1e812-d29d-4706-96de-84c19b9efc51 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:28.713163 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-70f1e812-d29d-4706-96de-84c19b9efc51 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:28.713610 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-70f1e812-d29d-4706-96de-84c19b9efc51 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:28.714443 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-70f1e812-d29d-4706-96de-84c19b9efc51 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:28.714835 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-70f1e812-d29d-4706-96de-84c19b9efc51 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:28.820322 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-70f1e812-d29d-4706-96de-84c19b9efc51 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action" status: 200 len: 38200 microversion: 2.20 time: 0.118410 Oct 29 01:18:28.820883 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 462/906] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:18:28 2021] POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action => generated 38200 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:18:29.676483 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b75b4497-0aa0-4b59-9cd2-0e220c624b3b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:29.678954 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b75b4497-0aa0-4b59-9cd2-0e220c624b3b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:29.688713 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b75b4497-0aa0-4b59-9cd2-0e220c624b3b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:29.689425 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b75b4497-0aa0-4b59-9cd2-0e220c624b3b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:29.691284 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b75b4497-0aa0-4b59-9cd2-0e220c624b3b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:29.692006 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b75b4497-0aa0-4b59-9cd2-0e220c624b3b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:29.704074 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-07feb6a3-bcb7-4343-a8ed-9116428ce490 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:29.704757 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-07feb6a3-bcb7-4343-a8ed-9116428ce490 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:29.712132 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-07feb6a3-bcb7-4343-a8ed-9116428ce490 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:29.712605 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-07feb6a3-bcb7-4343-a8ed-9116428ce490 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:29.713378 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-07feb6a3-bcb7-4343-a8ed-9116428ce490 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:29.713811 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-07feb6a3-bcb7-4343-a8ed-9116428ce490 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:29.730370 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b75b4497-0aa0-4b59-9cd2-0e220c624b3b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060899 Oct 29 01:18:29.730956 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 445/907] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:29 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:29.832126 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-fbfcbb1b-1fe4-45fe-9444-6924704d75fe tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:18:29.833291 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-fbfcbb1b-1fe4-45fe-9444-6924704d75fe tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:29.839174 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fbfcbb1b-1fe4-45fe-9444-6924704d75fe tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:29.839631 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fbfcbb1b-1fe4-45fe-9444-6924704d75fe tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:29.840402 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fbfcbb1b-1fe4-45fe-9444-6924704d75fe tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:29.840882 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fbfcbb1b-1fe4-45fe-9444-6924704d75fe tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:29.851526 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-07feb6a3-bcb7-4343-a8ed-9116428ce490 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:29.859800 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-07feb6a3-bcb7-4343-a8ed-9116428ce490 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.159686 Oct 29 01:18:29.860337 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 463/908] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:29 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:18:29.935041 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-fbfcbb1b-1fe4-45fe-9444-6924704d75fe tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action" status: 200 len: 38200 microversion: 2.20 time: 0.106221 Oct 29 01:18:29.935622 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 446/909] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:18:29 2021] POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action => generated 38200 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:18:30.742151 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e51e1960-5ff6-4f67-84ca-c607975350a3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:30.743276 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-e51e1960-5ff6-4f67-84ca-c607975350a3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:30.750343 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e51e1960-5ff6-4f67-84ca-c607975350a3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:30.750837 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e51e1960-5ff6-4f67-84ca-c607975350a3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:30.751658 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e51e1960-5ff6-4f67-84ca-c607975350a3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:30.752107 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e51e1960-5ff6-4f67-84ca-c607975350a3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:30.783667 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-e51e1960-5ff6-4f67-84ca-c607975350a3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045434 Oct 29 01:18:30.784257 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 464/910] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:30 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:30.879463 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-45c84dbd-555d-4289-818e-6094fbd90d7d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:30.880159 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-45c84dbd-555d-4289-818e-6094fbd90d7d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:30.887023 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-45c84dbd-555d-4289-818e-6094fbd90d7d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:30.887469 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-45c84dbd-555d-4289-818e-6094fbd90d7d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:30.888229 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-45c84dbd-555d-4289-818e-6094fbd90d7d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:30.888660 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-45c84dbd-555d-4289-818e-6094fbd90d7d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:30.948073 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-13ee9b59-1af5-45fb-83cc-4a7154f0c6ed tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:18:30.949151 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-13ee9b59-1af5-45fb-83cc-4a7154f0c6ed tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:30.962191 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-13ee9b59-1af5-45fb-83cc-4a7154f0c6ed tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:30.962191 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-13ee9b59-1af5-45fb-83cc-4a7154f0c6ed tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:30.962191 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-13ee9b59-1af5-45fb-83cc-4a7154f0c6ed tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:30.962191 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-13ee9b59-1af5-45fb-83cc-4a7154f0c6ed tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:31.027604 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-45c84dbd-555d-4289-818e-6094fbd90d7d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:31.035167 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-45c84dbd-555d-4289-818e-6094fbd90d7d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.160250 Oct 29 01:18:31.035727 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 447/911] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:30 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:31.060902 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-13ee9b59-1af5-45fb-83cc-4a7154f0c6ed tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action" status: 200 len: 38203 microversion: 2.20 time: 0.116824 Oct 29 01:18:31.061541 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 465/912] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:18:30 2021] POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action => generated 38203 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:18:31.795213 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-2fde6d20-10c6-4cd0-bdff-4550f485445c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:31.796347 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-2fde6d20-10c6-4cd0-bdff-4550f485445c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:31.803371 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2fde6d20-10c6-4cd0-bdff-4550f485445c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:31.803861 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2fde6d20-10c6-4cd0-bdff-4550f485445c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:31.804593 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2fde6d20-10c6-4cd0-bdff-4550f485445c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:31.805042 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2fde6d20-10c6-4cd0-bdff-4550f485445c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:31.835962 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-2fde6d20-10c6-4cd0-bdff-4550f485445c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044492 Oct 29 01:18:31.836518 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 448/913] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:31 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:18:32.053061 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-ea6cdb58-cc5b-4a04-8d7a-aba382616b2b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:32.053648 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-ea6cdb58-cc5b-4a04-8d7a-aba382616b2b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:32.061998 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ea6cdb58-cc5b-4a04-8d7a-aba382616b2b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:32.062691 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ea6cdb58-cc5b-4a04-8d7a-aba382616b2b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:32.063914 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ea6cdb58-cc5b-4a04-8d7a-aba382616b2b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:32.064596 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ea6cdb58-cc5b-4a04-8d7a-aba382616b2b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:32.074522 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-bb32c884-af75-45ab-a1c6-68075f6ddbd4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:18:32.075444 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-bb32c884-af75-45ab-a1c6-68075f6ddbd4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:32.081615 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bb32c884-af75-45ab-a1c6-68075f6ddbd4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:32.082067 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bb32c884-af75-45ab-a1c6-68075f6ddbd4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:32.083128 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bb32c884-af75-45ab-a1c6-68075f6ddbd4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:32.083561 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bb32c884-af75-45ab-a1c6-68075f6ddbd4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:32.184901 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-bb32c884-af75-45ab-a1c6-68075f6ddbd4 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action" status: 200 len: 38343 microversion: 2.20 time: 0.114510 Oct 29 01:18:32.185558 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 449/914] 10.222.0.90 () {62 vars in 1318 bytes} [Fri Oct 29 01:18:32 2021] POST /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/action => generated 38343 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:18:32.195596 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-7248b2d9-c6ba-452e-93bf-c9ec3d62236c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:32.196183 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-7248b2d9-c6ba-452e-93bf-c9ec3d62236c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:32.203480 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7248b2d9-c6ba-452e-93bf-c9ec3d62236c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:32.203931 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7248b2d9-c6ba-452e-93bf-c9ec3d62236c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:32.204706 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7248b2d9-c6ba-452e-93bf-c9ec3d62236c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:32.205140 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7248b2d9-c6ba-452e-93bf-c9ec3d62236c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:32.205688 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-ea6cdb58-cc5b-4a04-8d7a-aba382616b2b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:32.213825 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-ea6cdb58-cc5b-4a04-8d7a-aba382616b2b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.165552 Oct 29 01:18:32.214412 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 466/915] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:32 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:32.231299 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-7248b2d9-c6ba-452e-93bf-c9ec3d62236c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/ips" status: 200 len: 152 microversion: 2.20 time: 0.039467 Oct 29 01:18:32.231887 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 450/916] 10.222.0.90 () {60 vars in 1288 bytes} [Fri Oct 29 01:18:32 2021] GET /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:18:32.847510 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-85045c78-5b95-4130-a8bc-878678fea658 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:32.848433 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-85045c78-5b95-4130-a8bc-878678fea658 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:32.854776 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-85045c78-5b95-4130-a8bc-878678fea658 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:32.855224 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-85045c78-5b95-4130-a8bc-878678fea658 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:32.855990 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-85045c78-5b95-4130-a8bc-878678fea658 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:32.856427 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-85045c78-5b95-4130-a8bc-878678fea658 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:32.887713 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-85045c78-5b95-4130-a8bc-878678fea658 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043896 Oct 29 01:18:32.888289 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 467/917] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:32 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:33.235355 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-0be922a7-3024-41a3-8c09-f3311577e110 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:33.235904 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-0be922a7-3024-41a3-8c09-f3311577e110 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:33.242727 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0be922a7-3024-41a3-8c09-f3311577e110 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:33.243184 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0be922a7-3024-41a3-8c09-f3311577e110 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:33.243938 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0be922a7-3024-41a3-8c09-f3311577e110 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:33.244364 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0be922a7-3024-41a3-8c09-f3311577e110 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:33.384959 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-0be922a7-3024-41a3-8c09-f3311577e110 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:33.396076 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-0be922a7-3024-41a3-8c09-f3311577e110 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.164530 Oct 29 01:18:33.396637 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 451/918] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:33 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:18:33.899294 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-a8083744-bb82-4439-8d86-060d9b9324a0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:33.900234 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-a8083744-bb82-4439-8d86-060d9b9324a0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:33.906797 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a8083744-bb82-4439-8d86-060d9b9324a0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:33.907274 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a8083744-bb82-4439-8d86-060d9b9324a0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:33.908049 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a8083744-bb82-4439-8d86-060d9b9324a0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:33.908486 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a8083744-bb82-4439-8d86-060d9b9324a0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:33.940638 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-a8083744-bb82-4439-8d86-060d9b9324a0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044950 Oct 29 01:18:33.941981 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 468/919] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:33 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:34.415065 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c2826aa9-b693-4679-80f8-e250f30824fe tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:34.416219 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c2826aa9-b693-4679-80f8-e250f30824fe tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:34.424243 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c2826aa9-b693-4679-80f8-e250f30824fe tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:34.424717 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c2826aa9-b693-4679-80f8-e250f30824fe tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:34.426187 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c2826aa9-b693-4679-80f8-e250f30824fe tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:34.426678 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c2826aa9-b693-4679-80f8-e250f30824fe tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:34.561136 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c2826aa9-b693-4679-80f8-e250f30824fe tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:34.569020 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c2826aa9-b693-4679-80f8-e250f30824fe tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.159611 Oct 29 01:18:34.569601 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 452/920] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:34 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:18:34.953188 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-3df96631-c323-4147-8f63-a6538460dfbf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:34.954097 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-3df96631-c323-4147-8f63-a6538460dfbf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:34.961024 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3df96631-c323-4147-8f63-a6538460dfbf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:34.961467 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3df96631-c323-4147-8f63-a6538460dfbf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:34.962245 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3df96631-c323-4147-8f63-a6538460dfbf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:34.962719 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3df96631-c323-4147-8f63-a6538460dfbf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:34.992942 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-3df96631-c323-4147-8f63-a6538460dfbf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043607 Oct 29 01:18:34.993491 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 469/921] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:34 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:35.586762 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-8d103c4d-6b13-4b85-b3f3-be7691eed256 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:35.587367 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-8d103c4d-6b13-4b85-b3f3-be7691eed256 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:35.594185 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8d103c4d-6b13-4b85-b3f3-be7691eed256 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:35.594648 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8d103c4d-6b13-4b85-b3f3-be7691eed256 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:35.595519 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8d103c4d-6b13-4b85-b3f3-be7691eed256 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:35.595946 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8d103c4d-6b13-4b85-b3f3-be7691eed256 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:35.729638 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-8d103c4d-6b13-4b85-b3f3-be7691eed256 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:35.738419 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-8d103c4d-6b13-4b85-b3f3-be7691eed256 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.155046 Oct 29 01:18:35.739003 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 453/922] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:35 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:36.006099 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-edcb8eb7-f7a7-4aca-8a18-f8056100f0ff tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:36.007046 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-edcb8eb7-f7a7-4aca-8a18-f8056100f0ff tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:36.013632 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-edcb8eb7-f7a7-4aca-8a18-f8056100f0ff tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:36.014075 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-edcb8eb7-f7a7-4aca-8a18-f8056100f0ff tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:36.014889 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-edcb8eb7-f7a7-4aca-8a18-f8056100f0ff tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:36.015322 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-edcb8eb7-f7a7-4aca-8a18-f8056100f0ff tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:36.045231 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-edcb8eb7-f7a7-4aca-8a18-f8056100f0ff tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043431 Oct 29 01:18:36.045800 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 470/923] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:36 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:36.755883 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-2ab76bce-ca85-42d0-9b80-822f8f7d3e73 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:36.756506 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-2ab76bce-ca85-42d0-9b80-822f8f7d3e73 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:36.762817 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2ab76bce-ca85-42d0-9b80-822f8f7d3e73 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:36.763271 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2ab76bce-ca85-42d0-9b80-822f8f7d3e73 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:36.764051 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2ab76bce-ca85-42d0-9b80-822f8f7d3e73 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:36.764485 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2ab76bce-ca85-42d0-9b80-822f8f7d3e73 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:36.891241 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-2ab76bce-ca85-42d0-9b80-822f8f7d3e73 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:36.899664 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-2ab76bce-ca85-42d0-9b80-822f8f7d3e73 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.147949 Oct 29 01:18:36.900254 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 454/924] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:36 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:37.057945 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-0b6a9c94-860a-447f-b1a8-214e2e469f38 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:37.059105 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-0b6a9c94-860a-447f-b1a8-214e2e469f38 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:37.066784 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0b6a9c94-860a-447f-b1a8-214e2e469f38 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:37.067286 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0b6a9c94-860a-447f-b1a8-214e2e469f38 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:37.068167 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0b6a9c94-860a-447f-b1a8-214e2e469f38 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:37.068603 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0b6a9c94-860a-447f-b1a8-214e2e469f38 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:37.103552 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-0b6a9c94-860a-447f-b1a8-214e2e469f38 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049894 Oct 29 01:18:37.104198 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 471/925] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:37 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:37.920638 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-1ce8553a-4342-40dc-8819-b95a968da54e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:37.921248 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-1ce8553a-4342-40dc-8819-b95a968da54e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:37.927174 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1ce8553a-4342-40dc-8819-b95a968da54e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:37.927652 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1ce8553a-4342-40dc-8819-b95a968da54e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:37.928418 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1ce8553a-4342-40dc-8819-b95a968da54e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:37.928852 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1ce8553a-4342-40dc-8819-b95a968da54e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:38.057932 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-1ce8553a-4342-40dc-8819-b95a968da54e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:38.067541 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-1ce8553a-4342-40dc-8819-b95a968da54e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.150956 Oct 29 01:18:38.068127 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 455/926] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:37 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:38.114622 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e738d846-daca-4ccf-81d1-1df8b1e05ed6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:38.115537 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-e738d846-daca-4ccf-81d1-1df8b1e05ed6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:38.122062 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e738d846-daca-4ccf-81d1-1df8b1e05ed6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:38.122530 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e738d846-daca-4ccf-81d1-1df8b1e05ed6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:38.123303 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e738d846-daca-4ccf-81d1-1df8b1e05ed6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:38.123730 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e738d846-daca-4ccf-81d1-1df8b1e05ed6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:38.159560 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-e738d846-daca-4ccf-81d1-1df8b1e05ed6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048285 Oct 29 01:18:38.160222 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 472/927] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:38 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:39.085210 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-0a48b060-20b2-459b-b3f3-208356a5e79d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:39.085806 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-0a48b060-20b2-459b-b3f3-208356a5e79d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:39.092816 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0a48b060-20b2-459b-b3f3-208356a5e79d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:39.093264 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0a48b060-20b2-459b-b3f3-208356a5e79d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:39.094077 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0a48b060-20b2-459b-b3f3-208356a5e79d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:39.094558 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0a48b060-20b2-459b-b3f3-208356a5e79d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:39.171339 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-43a20005-2c9a-4eb6-a9f6-60a3c80d56aa tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:39.172318 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-43a20005-2c9a-4eb6-a9f6-60a3c80d56aa tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:39.179689 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-43a20005-2c9a-4eb6-a9f6-60a3c80d56aa tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:39.180147 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-43a20005-2c9a-4eb6-a9f6-60a3c80d56aa tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:39.180933 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-43a20005-2c9a-4eb6-a9f6-60a3c80d56aa tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:39.181368 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-43a20005-2c9a-4eb6-a9f6-60a3c80d56aa tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:39.221136 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-43a20005-2c9a-4eb6-a9f6-60a3c80d56aa tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053344 Oct 29 01:18:39.221829 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 473/928] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:39 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:18:39.236057 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-0a48b060-20b2-459b-b3f3-208356a5e79d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:39.243789 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-0a48b060-20b2-459b-b3f3-208356a5e79d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.162481 Oct 29 01:18:39.244366 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 456/929] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:39 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:40.233124 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-7ec8e70a-8cfc-414c-92e1-2fa23677128c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:40.234032 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-7ec8e70a-8cfc-414c-92e1-2fa23677128c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:40.240771 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7ec8e70a-8cfc-414c-92e1-2fa23677128c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:40.241217 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7ec8e70a-8cfc-414c-92e1-2fa23677128c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:40.241979 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7ec8e70a-8cfc-414c-92e1-2fa23677128c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:40.242432 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7ec8e70a-8cfc-414c-92e1-2fa23677128c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:40.261376 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-24b71576-5630-42a9-9b6e-624fd06d6144 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:40.262166 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-24b71576-5630-42a9-9b6e-624fd06d6144 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:40.269749 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-24b71576-5630-42a9-9b6e-624fd06d6144 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:40.270239 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-24b71576-5630-42a9-9b6e-624fd06d6144 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:40.271192 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-24b71576-5630-42a9-9b6e-624fd06d6144 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:40.271604 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-24b71576-5630-42a9-9b6e-624fd06d6144 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:40.273620 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-7ec8e70a-8cfc-414c-92e1-2fa23677128c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044232 Oct 29 01:18:40.274193 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 474/930] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:40 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:18:40.399109 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-24b71576-5630-42a9-9b6e-624fd06d6144 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:40.410953 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-24b71576-5630-42a9-9b6e-624fd06d6144 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.153034 Oct 29 01:18:40.411782 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 457/931] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:40 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:41.286003 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-bb178f40-8c8f-4e57-a25b-a51b012035c9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:41.286893 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-bb178f40-8c8f-4e57-a25b-a51b012035c9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:41.293196 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bb178f40-8c8f-4e57-a25b-a51b012035c9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:41.293643 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bb178f40-8c8f-4e57-a25b-a51b012035c9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:41.294512 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bb178f40-8c8f-4e57-a25b-a51b012035c9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:41.294951 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bb178f40-8c8f-4e57-a25b-a51b012035c9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:41.324854 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-bb178f40-8c8f-4e57-a25b-a51b012035c9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042750 Oct 29 01:18:41.325443 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 475/932] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:41 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:41.539134 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f9c3ea42-2fba-4abc-a381-eaa76040236e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:41.539717 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f9c3ea42-2fba-4abc-a381-eaa76040236e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:41.546143 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f9c3ea42-2fba-4abc-a381-eaa76040236e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:41.546633 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f9c3ea42-2fba-4abc-a381-eaa76040236e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:41.547424 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f9c3ea42-2fba-4abc-a381-eaa76040236e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:41.547863 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f9c3ea42-2fba-4abc-a381-eaa76040236e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:41.681661 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-f9c3ea42-2fba-4abc-a381-eaa76040236e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:41.689216 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f9c3ea42-2fba-4abc-a381-eaa76040236e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.264863 Oct 29 01:18:41.689813 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 458/933] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:41 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:42.338739 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-38d1e1b5-0405-4ce0-a742-36b8d7c2e991 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:42.339672 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-38d1e1b5-0405-4ce0-a742-36b8d7c2e991 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:42.346088 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-38d1e1b5-0405-4ce0-a742-36b8d7c2e991 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:42.346568 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-38d1e1b5-0405-4ce0-a742-36b8d7c2e991 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:42.347345 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-38d1e1b5-0405-4ce0-a742-36b8d7c2e991 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:42.347955 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-38d1e1b5-0405-4ce0-a742-36b8d7c2e991 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:42.377966 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-38d1e1b5-0405-4ce0-a742-36b8d7c2e991 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045260 Oct 29 01:18:42.378561 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 476/934] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:42 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:42.706780 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-1471fbf6-1837-4bdf-a489-a6a766ea64bd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:42.707372 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-1471fbf6-1837-4bdf-a489-a6a766ea64bd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:42.714648 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1471fbf6-1837-4bdf-a489-a6a766ea64bd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:42.715591 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1471fbf6-1837-4bdf-a489-a6a766ea64bd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:42.715591 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1471fbf6-1837-4bdf-a489-a6a766ea64bd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:42.715591 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1471fbf6-1837-4bdf-a489-a6a766ea64bd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:42.845271 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-1471fbf6-1837-4bdf-a489-a6a766ea64bd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:42.852855 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-1471fbf6-1837-4bdf-a489-a6a766ea64bd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.149675 Oct 29 01:18:42.853430 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 459/935] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:42 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:43.389287 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2b11bbc2-758a-4777-b4df-bba5f30d4d44 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:43.390212 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2b11bbc2-758a-4777-b4df-bba5f30d4d44 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:43.396516 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2b11bbc2-758a-4777-b4df-bba5f30d4d44 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:43.396968 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2b11bbc2-758a-4777-b4df-bba5f30d4d44 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:43.397742 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2b11bbc2-758a-4777-b4df-bba5f30d4d44 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:43.398180 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2b11bbc2-758a-4777-b4df-bba5f30d4d44 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:43.427971 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2b11bbc2-758a-4777-b4df-bba5f30d4d44 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042425 Oct 29 01:18:43.428556 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 477/936] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:43 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:43.869808 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-91d9133b-ccb5-4171-8336-2243e7908660 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:43.870427 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-91d9133b-ccb5-4171-8336-2243e7908660 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:43.879265 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-91d9133b-ccb5-4171-8336-2243e7908660 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:43.879950 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-91d9133b-ccb5-4171-8336-2243e7908660 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:43.881136 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-91d9133b-ccb5-4171-8336-2243e7908660 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:43.881833 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-91d9133b-ccb5-4171-8336-2243e7908660 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:44.042208 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-91d9133b-ccb5-4171-8336-2243e7908660 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:44.049724 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-91d9133b-ccb5-4171-8336-2243e7908660 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.184121 Oct 29 01:18:44.050279 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 460/937] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:43 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:44.440136 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-1f8a663e-7ba9-44fa-ad8d-2cad0645e6a9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:44.441057 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-1f8a663e-7ba9-44fa-ad8d-2cad0645e6a9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:44.448221 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1f8a663e-7ba9-44fa-ad8d-2cad0645e6a9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:44.448668 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1f8a663e-7ba9-44fa-ad8d-2cad0645e6a9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:44.449456 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1f8a663e-7ba9-44fa-ad8d-2cad0645e6a9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:44.449886 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1f8a663e-7ba9-44fa-ad8d-2cad0645e6a9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:44.480755 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-1f8a663e-7ba9-44fa-ad8d-2cad0645e6a9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045256 Oct 29 01:18:44.481348 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 478/938] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:44 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:45.066499 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-89bf1de2-4ff2-414a-8a1e-ccab0caa5a1c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:45.067091 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-89bf1de2-4ff2-414a-8a1e-ccab0caa5a1c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:45.074060 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-89bf1de2-4ff2-414a-8a1e-ccab0caa5a1c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:45.074602 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-89bf1de2-4ff2-414a-8a1e-ccab0caa5a1c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:45.075360 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-89bf1de2-4ff2-414a-8a1e-ccab0caa5a1c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:45.075799 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-89bf1de2-4ff2-414a-8a1e-ccab0caa5a1c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:45.202548 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-89bf1de2-4ff2-414a-8a1e-ccab0caa5a1c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:45.210276 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-89bf1de2-4ff2-414a-8a1e-ccab0caa5a1c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.147323 Oct 29 01:18:45.210862 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 461/939] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:45 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:45.493028 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-549dbd5f-a85f-4a8f-81b7-903003fcaf0d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:45.493891 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-549dbd5f-a85f-4a8f-81b7-903003fcaf0d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:45.500412 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-549dbd5f-a85f-4a8f-81b7-903003fcaf0d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:45.500860 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-549dbd5f-a85f-4a8f-81b7-903003fcaf0d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:45.501645 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-549dbd5f-a85f-4a8f-81b7-903003fcaf0d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:45.502077 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-549dbd5f-a85f-4a8f-81b7-903003fcaf0d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:45.533275 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-549dbd5f-a85f-4a8f-81b7-903003fcaf0d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044754 Oct 29 01:18:45.533840 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 479/940] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:45 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:46.227740 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ed051349-0d31-49dc-aaa6-cf66ec456d43 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:46.228344 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ed051349-0d31-49dc-aaa6-cf66ec456d43 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:46.234933 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ed051349-0d31-49dc-aaa6-cf66ec456d43 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:46.235380 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ed051349-0d31-49dc-aaa6-cf66ec456d43 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:46.236150 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ed051349-0d31-49dc-aaa6-cf66ec456d43 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:46.236585 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ed051349-0d31-49dc-aaa6-cf66ec456d43 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:46.368776 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-ed051349-0d31-49dc-aaa6-cf66ec456d43 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:46.376570 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ed051349-0d31-49dc-aaa6-cf66ec456d43 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.152984 Oct 29 01:18:46.377157 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 462/941] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:46 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:46.544786 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-49f8f352-eb35-41be-84a7-b94fe94116db tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:46.545602 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-49f8f352-eb35-41be-84a7-b94fe94116db tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:46.552707 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-49f8f352-eb35-41be-84a7-b94fe94116db tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:46.553150 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-49f8f352-eb35-41be-84a7-b94fe94116db tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:46.554461 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-49f8f352-eb35-41be-84a7-b94fe94116db tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:46.554940 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-49f8f352-eb35-41be-84a7-b94fe94116db tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:46.586493 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-49f8f352-eb35-41be-84a7-b94fe94116db tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045439 Oct 29 01:18:46.587078 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 480/942] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:46 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:47.393039 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b9bae8a9-7190-4e86-808d-83eaa9161e94 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:47.393625 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b9bae8a9-7190-4e86-808d-83eaa9161e94 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:47.400898 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b9bae8a9-7190-4e86-808d-83eaa9161e94 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:47.401339 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b9bae8a9-7190-4e86-808d-83eaa9161e94 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:47.402121 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b9bae8a9-7190-4e86-808d-83eaa9161e94 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:47.402577 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b9bae8a9-7190-4e86-808d-83eaa9161e94 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:47.530955 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-b9bae8a9-7190-4e86-808d-83eaa9161e94 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:47.538409 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b9bae8a9-7190-4e86-808d-83eaa9161e94 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.149161 Oct 29 01:18:47.539167 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 463/943] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:47 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:47.600331 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-17dc3184-3d09-4190-997c-35726facbac4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:47.601877 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-17dc3184-3d09-4190-997c-35726facbac4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:47.609071 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-17dc3184-3d09-4190-997c-35726facbac4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:47.609520 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-17dc3184-3d09-4190-997c-35726facbac4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:47.610300 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-17dc3184-3d09-4190-997c-35726facbac4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:47.610764 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-17dc3184-3d09-4190-997c-35726facbac4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:47.644690 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-17dc3184-3d09-4190-997c-35726facbac4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049996 Oct 29 01:18:47.645178 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 481/944] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:47 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:48.555432 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-712c23d1-86ad-4a1b-846c-2e0a04484746 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:48.556034 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-712c23d1-86ad-4a1b-846c-2e0a04484746 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:48.562747 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-712c23d1-86ad-4a1b-846c-2e0a04484746 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:48.563189 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-712c23d1-86ad-4a1b-846c-2e0a04484746 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:48.563951 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-712c23d1-86ad-4a1b-846c-2e0a04484746 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:48.564376 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-712c23d1-86ad-4a1b-846c-2e0a04484746 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:48.656589 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d8d6cc1a-7cda-4e62-b00f-a3999e0e0add tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:48.657599 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d8d6cc1a-7cda-4e62-b00f-a3999e0e0add tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:48.663894 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d8d6cc1a-7cda-4e62-b00f-a3999e0e0add tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:48.664343 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d8d6cc1a-7cda-4e62-b00f-a3999e0e0add tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:48.665131 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d8d6cc1a-7cda-4e62-b00f-a3999e0e0add tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:48.665571 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d8d6cc1a-7cda-4e62-b00f-a3999e0e0add tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:48.690369 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-712c23d1-86ad-4a1b-846c-2e0a04484746 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:48.699343 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-712c23d1-86ad-4a1b-846c-2e0a04484746 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.147457 Oct 29 01:18:48.699932 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 464/945] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:48 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:48.700051 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d8d6cc1a-7cda-4e62-b00f-a3999e0e0add tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047126 Oct 29 01:18:48.700529 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 482/946] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:48 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:18:49.712830 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d06153f2-6810-45c8-9cd9-f2c9262b6db7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:49.713942 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d06153f2-6810-45c8-9cd9-f2c9262b6db7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:49.717776 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-23b56f05-f32d-429d-8de4-55dad1c7a42a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:49.718645 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-23b56f05-f32d-429d-8de4-55dad1c7a42a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:49.722463 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d06153f2-6810-45c8-9cd9-f2c9262b6db7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:49.722910 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d06153f2-6810-45c8-9cd9-f2c9262b6db7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:49.723787 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d06153f2-6810-45c8-9cd9-f2c9262b6db7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:49.724258 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d06153f2-6810-45c8-9cd9-f2c9262b6db7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:49.725540 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-23b56f05-f32d-429d-8de4-55dad1c7a42a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:49.726594 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-23b56f05-f32d-429d-8de4-55dad1c7a42a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:49.727369 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-23b56f05-f32d-429d-8de4-55dad1c7a42a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:49.727797 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-23b56f05-f32d-429d-8de4-55dad1c7a42a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:49.760867 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d06153f2-6810-45c8-9cd9-f2c9262b6db7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052964 Oct 29 01:18:49.763213 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 465/947] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:49 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:49.866830 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-23b56f05-f32d-429d-8de4-55dad1c7a42a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:49.874847 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-23b56f05-f32d-429d-8de4-55dad1c7a42a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.161599 Oct 29 01:18:49.875574 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 483/948] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:49 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:50.777211 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-93a06df7-75bc-4bb0-bce9-8ab70933fbd0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:50.778148 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-93a06df7-75bc-4bb0-bce9-8ab70933fbd0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:50.785161 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-93a06df7-75bc-4bb0-bce9-8ab70933fbd0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:50.785607 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-93a06df7-75bc-4bb0-bce9-8ab70933fbd0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:50.786375 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-93a06df7-75bc-4bb0-bce9-8ab70933fbd0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:50.786842 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-93a06df7-75bc-4bb0-bce9-8ab70933fbd0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:50.819139 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-93a06df7-75bc-4bb0-bce9-8ab70933fbd0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046493 Oct 29 01:18:50.819789 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 466/949] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:50 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:18:50.891203 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c2ab64da-7eff-4469-85f4-cf2f8e59bde2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:50.891814 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c2ab64da-7eff-4469-85f4-cf2f8e59bde2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:50.898862 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c2ab64da-7eff-4469-85f4-cf2f8e59bde2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:50.899343 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c2ab64da-7eff-4469-85f4-cf2f8e59bde2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:50.900119 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c2ab64da-7eff-4469-85f4-cf2f8e59bde2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:50.900584 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c2ab64da-7eff-4469-85f4-cf2f8e59bde2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:51.024624 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-c2ab64da-7eff-4469-85f4-cf2f8e59bde2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:51.032195 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c2ab64da-7eff-4469-85f4-cf2f8e59bde2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.144789 Oct 29 01:18:51.032787 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 484/950] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:50 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:51.830979 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-0b30dd43-00ad-4bb6-b512-2424477aefef tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:51.831888 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-0b30dd43-00ad-4bb6-b512-2424477aefef tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:51.839121 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0b30dd43-00ad-4bb6-b512-2424477aefef tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:51.839574 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0b30dd43-00ad-4bb6-b512-2424477aefef tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:51.840342 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0b30dd43-00ad-4bb6-b512-2424477aefef tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:51.840781 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0b30dd43-00ad-4bb6-b512-2424477aefef tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:51.869434 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-0b30dd43-00ad-4bb6-b512-2424477aefef tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042202 Oct 29 01:18:51.870099 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 467/951] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:51 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:52.050150 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-6e35a1c2-4407-486e-a73a-1d192ede33a0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:52.050718 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-6e35a1c2-4407-486e-a73a-1d192ede33a0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:52.057429 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6e35a1c2-4407-486e-a73a-1d192ede33a0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:52.057874 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6e35a1c2-4407-486e-a73a-1d192ede33a0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:52.058679 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6e35a1c2-4407-486e-a73a-1d192ede33a0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:52.059142 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6e35a1c2-4407-486e-a73a-1d192ede33a0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:52.180398 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-6e35a1c2-4407-486e-a73a-1d192ede33a0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:52.187953 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-6e35a1c2-4407-486e-a73a-1d192ede33a0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.141571 Oct 29 01:18:52.188528 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 485/952] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:52 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:52.880997 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-8e80df81-4ec6-4d3e-8ef4-820ed43f281b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:52.881900 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-8e80df81-4ec6-4d3e-8ef4-820ed43f281b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:52.888203 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8e80df81-4ec6-4d3e-8ef4-820ed43f281b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:52.888647 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8e80df81-4ec6-4d3e-8ef4-820ed43f281b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:52.889405 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8e80df81-4ec6-4d3e-8ef4-820ed43f281b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:52.889835 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8e80df81-4ec6-4d3e-8ef4-820ed43f281b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:52.919526 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-8e80df81-4ec6-4d3e-8ef4-820ed43f281b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042273 Oct 29 01:18:52.920079 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 468/953] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:52 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:53.205261 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-0755d23e-6d58-4989-b15c-2c7a018166b0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:53.205811 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-0755d23e-6d58-4989-b15c-2c7a018166b0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:53.212816 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0755d23e-6d58-4989-b15c-2c7a018166b0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:53.213240 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0755d23e-6d58-4989-b15c-2c7a018166b0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:53.213992 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0755d23e-6d58-4989-b15c-2c7a018166b0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:53.214443 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0755d23e-6d58-4989-b15c-2c7a018166b0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:53.358676 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-0755d23e-6d58-4989-b15c-2c7a018166b0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:53.366073 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-0755d23e-6d58-4989-b15c-2c7a018166b0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.164598 Oct 29 01:18:53.367168 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 486/954] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:53 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:53.931436 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-66bf963c-bb63-42f8-a68e-b3a5fc609245 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:53.932405 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-66bf963c-bb63-42f8-a68e-b3a5fc609245 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:53.938557 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-66bf963c-bb63-42f8-a68e-b3a5fc609245 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:53.939001 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-66bf963c-bb63-42f8-a68e-b3a5fc609245 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:53.939755 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-66bf963c-bb63-42f8-a68e-b3a5fc609245 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:53.940183 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-66bf963c-bb63-42f8-a68e-b3a5fc609245 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:53.971014 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-66bf963c-bb63-42f8-a68e-b3a5fc609245 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043918 Oct 29 01:18:53.971585 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 469/955] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:53 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:54.383137 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-9d9f9513-56ea-49e5-ada1-98c0d6e64ed3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:54.383739 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-9d9f9513-56ea-49e5-ada1-98c0d6e64ed3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:54.389855 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9d9f9513-56ea-49e5-ada1-98c0d6e64ed3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:54.390294 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9d9f9513-56ea-49e5-ada1-98c0d6e64ed3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:54.391077 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9d9f9513-56ea-49e5-ada1-98c0d6e64ed3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:54.391502 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9d9f9513-56ea-49e5-ada1-98c0d6e64ed3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:54.510888 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-9d9f9513-56ea-49e5-ada1-98c0d6e64ed3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:54.518582 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-9d9f9513-56ea-49e5-ada1-98c0d6e64ed3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.139002 Oct 29 01:18:54.519143 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 487/956] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:54 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:54.982471 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f7214560-5994-4ba7-83f7-d1c450c3cabb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:54.983412 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f7214560-5994-4ba7-83f7-d1c450c3cabb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:54.989545 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f7214560-5994-4ba7-83f7-d1c450c3cabb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:54.989993 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f7214560-5994-4ba7-83f7-d1c450c3cabb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:54.990766 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f7214560-5994-4ba7-83f7-d1c450c3cabb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:54.991225 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f7214560-5994-4ba7-83f7-d1c450c3cabb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:55.021298 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f7214560-5994-4ba7-83f7-d1c450c3cabb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042628 Oct 29 01:18:55.021854 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 470/957] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:54 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:55.536390 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d57fd82e-e819-4356-836c-1ae2af79b89c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:55.537006 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d57fd82e-e819-4356-836c-1ae2af79b89c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:55.544715 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d57fd82e-e819-4356-836c-1ae2af79b89c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:55.545165 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d57fd82e-e819-4356-836c-1ae2af79b89c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:55.545950 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d57fd82e-e819-4356-836c-1ae2af79b89c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:55.546383 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d57fd82e-e819-4356-836c-1ae2af79b89c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:55.675447 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-d57fd82e-e819-4356-836c-1ae2af79b89c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:55.683246 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d57fd82e-e819-4356-836c-1ae2af79b89c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.150410 Oct 29 01:18:55.683838 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 488/958] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:55 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:56.031994 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9634bfcf-779a-4811-806f-6ee59b3983c8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:56.032899 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9634bfcf-779a-4811-806f-6ee59b3983c8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:56.040042 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9634bfcf-779a-4811-806f-6ee59b3983c8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:56.040486 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9634bfcf-779a-4811-806f-6ee59b3983c8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:56.041273 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9634bfcf-779a-4811-806f-6ee59b3983c8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:56.044358 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9634bfcf-779a-4811-806f-6ee59b3983c8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:56.071721 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9634bfcf-779a-4811-806f-6ee59b3983c8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043447 Oct 29 01:18:56.072290 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 471/959] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:56 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:56.700427 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-55a7eb7a-3293-4085-83a0-3a516953e300 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:56.701033 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-55a7eb7a-3293-4085-83a0-3a516953e300 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:56.707379 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-55a7eb7a-3293-4085-83a0-3a516953e300 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:56.707826 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-55a7eb7a-3293-4085-83a0-3a516953e300 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:56.708844 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-55a7eb7a-3293-4085-83a0-3a516953e300 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:56.709273 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-55a7eb7a-3293-4085-83a0-3a516953e300 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:56.836290 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-55a7eb7a-3293-4085-83a0-3a516953e300 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:56.843536 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-55a7eb7a-3293-4085-83a0-3a516953e300 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.146824 Oct 29 01:18:56.844096 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 489/960] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:56 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:57.083180 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-216c25be-590c-4e27-b1de-f6c5c84d249f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:57.084365 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-216c25be-590c-4e27-b1de-f6c5c84d249f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:57.091476 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-216c25be-590c-4e27-b1de-f6c5c84d249f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:57.091931 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-216c25be-590c-4e27-b1de-f6c5c84d249f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:57.092702 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-216c25be-590c-4e27-b1de-f6c5c84d249f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:57.093141 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-216c25be-590c-4e27-b1de-f6c5c84d249f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:57.130993 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-216c25be-590c-4e27-b1de-f6c5c84d249f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051496 Oct 29 01:18:57.131563 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 472/961] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:57 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:57.860866 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-0b3b46fb-7fbd-45ac-b509-7a10f2e612c7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:57.861477 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-0b3b46fb-7fbd-45ac-b509-7a10f2e612c7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:57.869735 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0b3b46fb-7fbd-45ac-b509-7a10f2e612c7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:57.870199 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0b3b46fb-7fbd-45ac-b509-7a10f2e612c7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:57.871012 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0b3b46fb-7fbd-45ac-b509-7a10f2e612c7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:57.871453 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0b3b46fb-7fbd-45ac-b509-7a10f2e612c7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:57.994548 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-0b3b46fb-7fbd-45ac-b509-7a10f2e612c7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:58.002252 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-0b3b46fb-7fbd-45ac-b509-7a10f2e612c7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.145075 Oct 29 01:18:58.002862 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 490/962] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:57 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:58.142331 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-3b467ebc-b08e-4c56-9ee3-e2ba2da516fc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:58.143274 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-3b467ebc-b08e-4c56-9ee3-e2ba2da516fc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:58.149752 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3b467ebc-b08e-4c56-9ee3-e2ba2da516fc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:58.150195 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3b467ebc-b08e-4c56-9ee3-e2ba2da516fc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:58.151002 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3b467ebc-b08e-4c56-9ee3-e2ba2da516fc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:58.151556 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3b467ebc-b08e-4c56-9ee3-e2ba2da516fc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:58.181248 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-3b467ebc-b08e-4c56-9ee3-e2ba2da516fc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042599 Oct 29 01:18:58.181811 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 473/963] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:58 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:59.020545 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-4a611b2e-4ebe-47bb-bc67-dd3e423f6028 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:59.021137 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-4a611b2e-4ebe-47bb-bc67-dd3e423f6028 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:59.027406 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4a611b2e-4ebe-47bb-bc67-dd3e423f6028 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:59.027844 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4a611b2e-4ebe-47bb-bc67-dd3e423f6028 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:59.028602 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4a611b2e-4ebe-47bb-bc67-dd3e423f6028 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:59.029028 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4a611b2e-4ebe-47bb-bc67-dd3e423f6028 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:59.151696 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-4a611b2e-4ebe-47bb-bc67-dd3e423f6028 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:59.159110 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-4a611b2e-4ebe-47bb-bc67-dd3e423f6028 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.142621 Oct 29 01:18:59.159671 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 491/964] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:18:59 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:59.192575 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9d8bfbd5-da92-44ca-8a47-ce7b2dabc8b1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:59.193514 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9d8bfbd5-da92-44ca-8a47-ce7b2dabc8b1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:18:59.200324 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9d8bfbd5-da92-44ca-8a47-ce7b2dabc8b1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:59.200767 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9d8bfbd5-da92-44ca-8a47-ce7b2dabc8b1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:59.201540 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9d8bfbd5-da92-44ca-8a47-ce7b2dabc8b1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:18:59.201970 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9d8bfbd5-da92-44ca-8a47-ce7b2dabc8b1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:18:59.231866 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9d8bfbd5-da92-44ca-8a47-ce7b2dabc8b1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042923 Oct 29 01:18:59.232338 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 474/965] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:18:59 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:00.176957 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-1bf818c2-160c-470a-9239-673109480e51 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:00.177599 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-1bf818c2-160c-470a-9239-673109480e51 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:00.183994 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1bf818c2-160c-470a-9239-673109480e51 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:00.184430 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1bf818c2-160c-470a-9239-673109480e51 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:00.185186 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1bf818c2-160c-470a-9239-673109480e51 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:00.185612 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1bf818c2-160c-470a-9239-673109480e51 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:00.243742 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f8a3b96c-f183-471e-8c6a-3c75d995e1db tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:00.244783 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f8a3b96c-f183-471e-8c6a-3c75d995e1db tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:00.251520 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f8a3b96c-f183-471e-8c6a-3c75d995e1db tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:00.251976 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f8a3b96c-f183-471e-8c6a-3c75d995e1db tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:00.252759 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f8a3b96c-f183-471e-8c6a-3c75d995e1db tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:00.253199 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f8a3b96c-f183-471e-8c6a-3c75d995e1db tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:00.284626 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f8a3b96c-f183-471e-8c6a-3c75d995e1db tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045139 Oct 29 01:19:00.285213 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 475/966] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:00 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:19:00.312759 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-1bf818c2-160c-470a-9239-673109480e51 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:00.321128 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-1bf818c2-160c-470a-9239-673109480e51 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.147816 Oct 29 01:19:00.321711 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 492/967] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:00 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:01.297005 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-dea2b5c7-8cd8-4d10-8129-81c2cdfc4137 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:01.297990 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-dea2b5c7-8cd8-4d10-8129-81c2cdfc4137 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:01.305528 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dea2b5c7-8cd8-4d10-8129-81c2cdfc4137 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:01.305971 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dea2b5c7-8cd8-4d10-8129-81c2cdfc4137 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:01.306940 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dea2b5c7-8cd8-4d10-8129-81c2cdfc4137 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:01.307369 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dea2b5c7-8cd8-4d10-8129-81c2cdfc4137 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:01.338799 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-edb66a54-5aa6-4c55-ae15-4453b74b8c29 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:01.339513 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-edb66a54-5aa6-4c55-ae15-4453b74b8c29 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:01.344407 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-dea2b5c7-8cd8-4d10-8129-81c2cdfc4137 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051017 Oct 29 01:19:01.344407 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 476/968] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:01 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:01.346478 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-edb66a54-5aa6-4c55-ae15-4453b74b8c29 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:01.346927 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-edb66a54-5aa6-4c55-ae15-4453b74b8c29 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:01.347796 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-edb66a54-5aa6-4c55-ae15-4453b74b8c29 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:01.348265 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-edb66a54-5aa6-4c55-ae15-4453b74b8c29 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:01.483466 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-edb66a54-5aa6-4c55-ae15-4453b74b8c29 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:01.491280 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-edb66a54-5aa6-4c55-ae15-4453b74b8c29 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.156461 Oct 29 01:19:01.492424 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 493/969] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:01 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:19:02.355609 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-db14d8d7-eff6-49ff-a611-c31164d8fa9c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:02.356535 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-db14d8d7-eff6-49ff-a611-c31164d8fa9c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:02.363587 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-db14d8d7-eff6-49ff-a611-c31164d8fa9c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:02.364040 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-db14d8d7-eff6-49ff-a611-c31164d8fa9c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:02.364820 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-db14d8d7-eff6-49ff-a611-c31164d8fa9c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:02.365252 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-db14d8d7-eff6-49ff-a611-c31164d8fa9c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:02.395202 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-db14d8d7-eff6-49ff-a611-c31164d8fa9c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043898 Oct 29 01:19:02.395783 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 477/970] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:02 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:02.508964 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-ff387fff-f056-4a23-9650-01cbe4417520 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:02.509672 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-ff387fff-f056-4a23-9650-01cbe4417520 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:02.516117 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ff387fff-f056-4a23-9650-01cbe4417520 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:02.516559 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ff387fff-f056-4a23-9650-01cbe4417520 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:02.517325 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ff387fff-f056-4a23-9650-01cbe4417520 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:02.517750 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ff387fff-f056-4a23-9650-01cbe4417520 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:02.646604 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-ff387fff-f056-4a23-9650-01cbe4417520 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:02.655106 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-ff387fff-f056-4a23-9650-01cbe4417520 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.149808 Oct 29 01:19:02.660132 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 494/971] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:02 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:03.407930 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-af53ced5-bfc7-49c8-9d51-2b38406bba5f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:03.408839 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-af53ced5-bfc7-49c8-9d51-2b38406bba5f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:03.414872 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-af53ced5-bfc7-49c8-9d51-2b38406bba5f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:03.415322 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-af53ced5-bfc7-49c8-9d51-2b38406bba5f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:03.416104 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-af53ced5-bfc7-49c8-9d51-2b38406bba5f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:03.416542 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-af53ced5-bfc7-49c8-9d51-2b38406bba5f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:03.450540 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-af53ced5-bfc7-49c8-9d51-2b38406bba5f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046498 Oct 29 01:19:03.451115 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 478/972] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:03 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:19:03.674825 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-a5db30ab-4955-4b5b-9059-1984decefb45 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:03.675748 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-a5db30ab-4955-4b5b-9059-1984decefb45 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:03.685318 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a5db30ab-4955-4b5b-9059-1984decefb45 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:03.686008 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a5db30ab-4955-4b5b-9059-1984decefb45 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:03.687111 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a5db30ab-4955-4b5b-9059-1984decefb45 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:03.688088 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a5db30ab-4955-4b5b-9059-1984decefb45 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:03.814180 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-a5db30ab-4955-4b5b-9059-1984decefb45 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:03.821493 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-a5db30ab-4955-4b5b-9059-1984decefb45 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.152484 Oct 29 01:19:03.822052 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 495/973] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:03 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:19:04.463188 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-da75e196-596a-4cf1-997d-c68a5750f7f5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:04.464107 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-da75e196-596a-4cf1-997d-c68a5750f7f5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:04.470987 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-da75e196-596a-4cf1-997d-c68a5750f7f5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:04.471446 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-da75e196-596a-4cf1-997d-c68a5750f7f5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:04.472277 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-da75e196-596a-4cf1-997d-c68a5750f7f5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:04.472718 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-da75e196-596a-4cf1-997d-c68a5750f7f5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:04.502700 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-da75e196-596a-4cf1-997d-c68a5750f7f5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044331 Oct 29 01:19:04.503272 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 479/974] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:04 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:04.838096 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-4933e5dc-aa30-4ea0-9fcb-a18c561b4249 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:04.838669 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-4933e5dc-aa30-4ea0-9fcb-a18c561b4249 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:04.844939 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4933e5dc-aa30-4ea0-9fcb-a18c561b4249 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:04.845391 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4933e5dc-aa30-4ea0-9fcb-a18c561b4249 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:04.846156 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4933e5dc-aa30-4ea0-9fcb-a18c561b4249 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:04.846628 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4933e5dc-aa30-4ea0-9fcb-a18c561b4249 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:04.972131 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-4933e5dc-aa30-4ea0-9fcb-a18c561b4249 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:04.980506 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-4933e5dc-aa30-4ea0-9fcb-a18c561b4249 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.146126 Oct 29 01:19:04.981094 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 496/975] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:04 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:05.514119 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-6e4247c6-cea7-413f-9995-b1cedf19e94f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:05.515066 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-6e4247c6-cea7-413f-9995-b1cedf19e94f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:05.521810 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6e4247c6-cea7-413f-9995-b1cedf19e94f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:05.522259 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6e4247c6-cea7-413f-9995-b1cedf19e94f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:05.523087 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6e4247c6-cea7-413f-9995-b1cedf19e94f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:05.523529 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6e4247c6-cea7-413f-9995-b1cedf19e94f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:05.554882 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-6e4247c6-cea7-413f-9995-b1cedf19e94f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044463 Oct 29 01:19:05.555458 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 480/976] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:05 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:05.998631 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-eaa4c9ff-8118-41db-8cb7-510245d94ddf tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:05.999243 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-eaa4c9ff-8118-41db-8cb7-510245d94ddf tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:06.005653 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-eaa4c9ff-8118-41db-8cb7-510245d94ddf tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:06.006094 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-eaa4c9ff-8118-41db-8cb7-510245d94ddf tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:06.006999 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-eaa4c9ff-8118-41db-8cb7-510245d94ddf tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:06.007319 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-eaa4c9ff-8118-41db-8cb7-510245d94ddf tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:06.136755 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-eaa4c9ff-8118-41db-8cb7-510245d94ddf tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:06.144266 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-eaa4c9ff-8118-41db-8cb7-510245d94ddf tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.149511 Oct 29 01:19:06.144833 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 497/977] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:05 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:06.566995 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-018ff91a-d454-4255-996a-cf537092377e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:06.568001 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-018ff91a-d454-4255-996a-cf537092377e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:06.575081 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-018ff91a-d454-4255-996a-cf537092377e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:06.575621 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-018ff91a-d454-4255-996a-cf537092377e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:06.576527 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-018ff91a-d454-4255-996a-cf537092377e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:06.576973 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-018ff91a-d454-4255-996a-cf537092377e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:06.611640 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-018ff91a-d454-4255-996a-cf537092377e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048488 Oct 29 01:19:06.612238 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 481/978] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:06 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:07.165294 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-a82702a6-793f-4173-851c-8d9705d75dfd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:07.166058 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-a82702a6-793f-4173-851c-8d9705d75dfd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:07.172872 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a82702a6-793f-4173-851c-8d9705d75dfd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:07.173322 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a82702a6-793f-4173-851c-8d9705d75dfd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:07.174095 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a82702a6-793f-4173-851c-8d9705d75dfd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:07.174566 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a82702a6-793f-4173-851c-8d9705d75dfd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:07.307489 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-a82702a6-793f-4173-851c-8d9705d75dfd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:07.318805 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-a82702a6-793f-4173-851c-8d9705d75dfd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.157346 Oct 29 01:19:07.319680 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 498/979] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:07 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:07.627765 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-8ddaff84-9701-4bf2-be20-c13fac2591b0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:07.629482 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-8ddaff84-9701-4bf2-be20-c13fac2591b0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:07.637862 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8ddaff84-9701-4bf2-be20-c13fac2591b0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:07.638322 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8ddaff84-9701-4bf2-be20-c13fac2591b0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:07.639145 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8ddaff84-9701-4bf2-be20-c13fac2591b0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:07.639587 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8ddaff84-9701-4bf2-be20-c13fac2591b0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:07.671089 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-8ddaff84-9701-4bf2-be20-c13fac2591b0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050182 Oct 29 01:19:07.671663 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 482/980] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:07 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:08.341017 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-5e9ba076-5820-49ad-adbc-f654aadd22e7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:08.341558 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-5e9ba076-5820-49ad-adbc-f654aadd22e7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:08.347846 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5e9ba076-5820-49ad-adbc-f654aadd22e7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:08.348310 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5e9ba076-5820-49ad-adbc-f654aadd22e7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:08.349072 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5e9ba076-5820-49ad-adbc-f654aadd22e7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:08.349499 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5e9ba076-5820-49ad-adbc-f654aadd22e7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:08.472360 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-5e9ba076-5820-49ad-adbc-f654aadd22e7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:08.479737 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-5e9ba076-5820-49ad-adbc-f654aadd22e7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.142615 Oct 29 01:19:08.480303 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 499/981] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:08 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:08.683033 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-1669ae7a-0ee2-4060-89f2-35dcea177a2c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:08.683950 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-1669ae7a-0ee2-4060-89f2-35dcea177a2c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:08.690143 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1669ae7a-0ee2-4060-89f2-35dcea177a2c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:08.690625 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1669ae7a-0ee2-4060-89f2-35dcea177a2c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:08.691402 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1669ae7a-0ee2-4060-89f2-35dcea177a2c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:08.691841 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1669ae7a-0ee2-4060-89f2-35dcea177a2c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:08.721490 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-1669ae7a-0ee2-4060-89f2-35dcea177a2c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042833 Oct 29 01:19:08.722087 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 483/982] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:08 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:09.497507 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d86203c8-a9ce-4562-8ea2-195413692d1d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:09.498109 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d86203c8-a9ce-4562-8ea2-195413692d1d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:09.504351 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d86203c8-a9ce-4562-8ea2-195413692d1d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:09.504790 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d86203c8-a9ce-4562-8ea2-195413692d1d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:09.505541 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d86203c8-a9ce-4562-8ea2-195413692d1d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:09.505963 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d86203c8-a9ce-4562-8ea2-195413692d1d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:09.631664 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-d86203c8-a9ce-4562-8ea2-195413692d1d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:09.639291 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d86203c8-a9ce-4562-8ea2-195413692d1d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.146386 Oct 29 01:19:09.639880 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 500/983] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:09 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:09.735159 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c882ea84-2499-4bbc-a35b-88b596fc9376 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:09.736260 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c882ea84-2499-4bbc-a35b-88b596fc9376 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:09.744056 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c882ea84-2499-4bbc-a35b-88b596fc9376 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:09.744558 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c882ea84-2499-4bbc-a35b-88b596fc9376 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:09.745421 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c882ea84-2499-4bbc-a35b-88b596fc9376 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:09.745881 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c882ea84-2499-4bbc-a35b-88b596fc9376 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:09.775434 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c882ea84-2499-4bbc-a35b-88b596fc9376 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045300 Oct 29 01:19:09.775911 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 484/984] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:09 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:10.655689 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-b9ada211-96b3-495f-ae46-eaff9bad3636 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:10.656372 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-b9ada211-96b3-495f-ae46-eaff9bad3636 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:10.662680 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b9ada211-96b3-495f-ae46-eaff9bad3636 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:10.663150 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b9ada211-96b3-495f-ae46-eaff9bad3636 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:10.663937 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b9ada211-96b3-495f-ae46-eaff9bad3636 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:10.664369 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b9ada211-96b3-495f-ae46-eaff9bad3636 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:10.787061 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-cc6251af-7155-4190-a0cd-e293c9fdc116 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:10.787979 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-cc6251af-7155-4190-a0cd-e293c9fdc116 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:10.790046 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-b9ada211-96b3-495f-ae46-eaff9bad3636 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:10.794954 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cc6251af-7155-4190-a0cd-e293c9fdc116 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:10.795404 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cc6251af-7155-4190-a0cd-e293c9fdc116 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:10.796200 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cc6251af-7155-4190-a0cd-e293c9fdc116 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:10.796692 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cc6251af-7155-4190-a0cd-e293c9fdc116 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:10.797737 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-b9ada211-96b3-495f-ae46-eaff9bad3636 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.145712 Oct 29 01:19:10.798300 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 501/985] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:10 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:10.829443 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-cc6251af-7155-4190-a0cd-e293c9fdc116 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046441 Oct 29 01:19:10.829986 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 485/986] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:10 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:19:11.814689 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-7fe10f9c-4895-49d9-bcab-5fc603f98128 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:11.815286 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-7fe10f9c-4895-49d9-bcab-5fc603f98128 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:11.821993 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7fe10f9c-4895-49d9-bcab-5fc603f98128 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:11.822629 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7fe10f9c-4895-49d9-bcab-5fc603f98128 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:11.823392 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7fe10f9c-4895-49d9-bcab-5fc603f98128 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:11.823825 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7fe10f9c-4895-49d9-bcab-5fc603f98128 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:11.841464 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-76644d41-2bbc-4ee3-8310-9a8cefde8ea1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:11.842562 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-76644d41-2bbc-4ee3-8310-9a8cefde8ea1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:11.848774 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-76644d41-2bbc-4ee3-8310-9a8cefde8ea1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:11.849232 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-76644d41-2bbc-4ee3-8310-9a8cefde8ea1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:11.850004 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-76644d41-2bbc-4ee3-8310-9a8cefde8ea1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:11.850465 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-76644d41-2bbc-4ee3-8310-9a8cefde8ea1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:11.879874 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-76644d41-2bbc-4ee3-8310-9a8cefde8ea1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042659 Oct 29 01:19:11.880447 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 486/987] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:11 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:19:11.949251 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-7fe10f9c-4895-49d9-bcab-5fc603f98128 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:11.956699 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-7fe10f9c-4895-49d9-bcab-5fc603f98128 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.145692 Oct 29 01:19:11.958900 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 502/988] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:11 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:12.892145 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-120494bc-c813-4991-8ae5-2c62d6ecb7bd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:12.893164 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-120494bc-c813-4991-8ae5-2c62d6ecb7bd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:12.899811 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-120494bc-c813-4991-8ae5-2c62d6ecb7bd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:12.900257 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-120494bc-c813-4991-8ae5-2c62d6ecb7bd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:12.901120 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-120494bc-c813-4991-8ae5-2c62d6ecb7bd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:12.901553 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-120494bc-c813-4991-8ae5-2c62d6ecb7bd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:12.933691 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-120494bc-c813-4991-8ae5-2c62d6ecb7bd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046040 Oct 29 01:19:12.934241 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 487/989] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:12 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:12.974812 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-bfa5be16-170e-4132-8667-a809a4554d90 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:12.975429 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-bfa5be16-170e-4132-8667-a809a4554d90 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:12.982156 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bfa5be16-170e-4132-8667-a809a4554d90 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:12.982625 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bfa5be16-170e-4132-8667-a809a4554d90 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:12.983384 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bfa5be16-170e-4132-8667-a809a4554d90 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:12.983815 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bfa5be16-170e-4132-8667-a809a4554d90 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:13.111306 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-bfa5be16-170e-4132-8667-a809a4554d90 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:13.118540 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-bfa5be16-170e-4132-8667-a809a4554d90 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.147372 Oct 29 01:19:13.119190 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 503/990] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:12 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:13.945370 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d18a1166-4c9c-420a-a41a-413855a6be85 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:13.946279 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d18a1166-4c9c-420a-a41a-413855a6be85 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:13.953058 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d18a1166-4c9c-420a-a41a-413855a6be85 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:13.953510 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d18a1166-4c9c-420a-a41a-413855a6be85 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:13.954267 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d18a1166-4c9c-420a-a41a-413855a6be85 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:13.954744 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d18a1166-4c9c-420a-a41a-413855a6be85 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:13.984048 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d18a1166-4c9c-420a-a41a-413855a6be85 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042413 Oct 29 01:19:13.984596 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 488/991] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:13 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:14.136434 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-8220d86d-1f5e-4e79-94f0-9bdcccf517e5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:14.137034 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-8220d86d-1f5e-4e79-94f0-9bdcccf517e5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:14.143176 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8220d86d-1f5e-4e79-94f0-9bdcccf517e5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:14.143618 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8220d86d-1f5e-4e79-94f0-9bdcccf517e5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:14.144368 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8220d86d-1f5e-4e79-94f0-9bdcccf517e5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:14.144795 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8220d86d-1f5e-4e79-94f0-9bdcccf517e5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:14.269554 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-8220d86d-1f5e-4e79-94f0-9bdcccf517e5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:14.276752 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-8220d86d-1f5e-4e79-94f0-9bdcccf517e5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.144531 Oct 29 01:19:14.277306 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 504/992] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:14 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:14.995853 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a5a5f3a0-8d40-4ecd-902f-d2a61be48dc4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:14.996755 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a5a5f3a0-8d40-4ecd-902f-d2a61be48dc4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:15.002985 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a5a5f3a0-8d40-4ecd-902f-d2a61be48dc4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:15.003422 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a5a5f3a0-8d40-4ecd-902f-d2a61be48dc4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:15.004209 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a5a5f3a0-8d40-4ecd-902f-d2a61be48dc4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:15.004635 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a5a5f3a0-8d40-4ecd-902f-d2a61be48dc4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:15.032268 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a5a5f3a0-8d40-4ecd-902f-d2a61be48dc4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040777 Oct 29 01:19:15.032804 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 489/993] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:14 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:15.293385 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-8fb8c4be-ca98-4fc2-a10e-96c3ae243363 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:15.293928 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-8fb8c4be-ca98-4fc2-a10e-96c3ae243363 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:15.300148 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8fb8c4be-ca98-4fc2-a10e-96c3ae243363 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:15.300586 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8fb8c4be-ca98-4fc2-a10e-96c3ae243363 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:15.301336 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8fb8c4be-ca98-4fc2-a10e-96c3ae243363 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:15.301762 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8fb8c4be-ca98-4fc2-a10e-96c3ae243363 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:15.422821 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-8fb8c4be-ca98-4fc2-a10e-96c3ae243363 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:15.433382 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-8fb8c4be-ca98-4fc2-a10e-96c3ae243363 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.143700 Oct 29 01:19:15.433993 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 505/994] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:15 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:16.047041 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9d453f5e-d17a-4ad4-b974-02cda8bffd75 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:16.048599 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9d453f5e-d17a-4ad4-b974-02cda8bffd75 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:16.059722 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9d453f5e-d17a-4ad4-b974-02cda8bffd75 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:16.060527 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9d453f5e-d17a-4ad4-b974-02cda8bffd75 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:16.061817 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9d453f5e-d17a-4ad4-b974-02cda8bffd75 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:16.062630 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9d453f5e-d17a-4ad4-b974-02cda8bffd75 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:16.117354 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9d453f5e-d17a-4ad4-b974-02cda8bffd75 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076568 Oct 29 01:19:16.118298 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 490/995] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:16 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:16.449964 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-1373bf08-1bf1-4b6d-8983-4cdf5fc74fd1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:16.450713 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-1373bf08-1bf1-4b6d-8983-4cdf5fc74fd1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:16.457134 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1373bf08-1bf1-4b6d-8983-4cdf5fc74fd1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:16.457587 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1373bf08-1bf1-4b6d-8983-4cdf5fc74fd1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:16.458358 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1373bf08-1bf1-4b6d-8983-4cdf5fc74fd1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:16.458823 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1373bf08-1bf1-4b6d-8983-4cdf5fc74fd1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:16.590910 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-1373bf08-1bf1-4b6d-8983-4cdf5fc74fd1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:16.598809 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-1373bf08-1bf1-4b6d-8983-4cdf5fc74fd1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.152498 Oct 29 01:19:16.599383 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 506/996] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:16 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:17.130230 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-fee3cf28-6288-4c00-9d59-2ba3173ba3cd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:17.131174 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-fee3cf28-6288-4c00-9d59-2ba3173ba3cd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:17.137982 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fee3cf28-6288-4c00-9d59-2ba3173ba3cd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:17.138453 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fee3cf28-6288-4c00-9d59-2ba3173ba3cd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:17.139219 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fee3cf28-6288-4c00-9d59-2ba3173ba3cd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:17.139652 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fee3cf28-6288-4c00-9d59-2ba3173ba3cd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:17.168566 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-fee3cf28-6288-4c00-9d59-2ba3173ba3cd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042067 Oct 29 01:19:17.169121 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 491/997] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:17 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:17.616706 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-137a0a78-5b8a-4b43-ac32-424a5b68b933 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:17.617338 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-137a0a78-5b8a-4b43-ac32-424a5b68b933 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:17.625492 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-137a0a78-5b8a-4b43-ac32-424a5b68b933 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:17.625937 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-137a0a78-5b8a-4b43-ac32-424a5b68b933 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:17.626771 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-137a0a78-5b8a-4b43-ac32-424a5b68b933 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:17.627211 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-137a0a78-5b8a-4b43-ac32-424a5b68b933 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:17.764267 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-137a0a78-5b8a-4b43-ac32-424a5b68b933 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:17.771663 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-137a0a78-5b8a-4b43-ac32-424a5b68b933 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.158665 Oct 29 01:19:17.772231 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 507/998] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:17 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:19:18.181924 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-e4491a22-965a-4cd3-ab3f-3a726a5263db tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:18.183925 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-e4491a22-965a-4cd3-ab3f-3a726a5263db tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:18.191279 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e4491a22-965a-4cd3-ab3f-3a726a5263db tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:18.191727 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e4491a22-965a-4cd3-ab3f-3a726a5263db tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:18.192502 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e4491a22-965a-4cd3-ab3f-3a726a5263db tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:18.192938 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e4491a22-965a-4cd3-ab3f-3a726a5263db tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:18.225599 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-e4491a22-965a-4cd3-ab3f-3a726a5263db tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048905 Oct 29 01:19:18.226167 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 492/999] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:18 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:19:18.788859 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-9ca0118e-eed3-4ba8-8ad8-28ced5459b3c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:18.789469 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-9ca0118e-eed3-4ba8-8ad8-28ced5459b3c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:18.796671 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9ca0118e-eed3-4ba8-8ad8-28ced5459b3c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:18.797124 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9ca0118e-eed3-4ba8-8ad8-28ced5459b3c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:18.797884 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9ca0118e-eed3-4ba8-8ad8-28ced5459b3c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:18.798321 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9ca0118e-eed3-4ba8-8ad8-28ced5459b3c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:18.920685 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-9ca0118e-eed3-4ba8-8ad8-28ced5459b3c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:18.927968 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-9ca0118e-eed3-4ba8-8ad8-28ced5459b3c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.142807 Oct 29 01:19:18.928535 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 508/1000] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:18 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:19.236340 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-5999a496-eb00-4e33-abed-408db4effc8e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:19.237284 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-5999a496-eb00-4e33-abed-408db4effc8e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:19.243545 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5999a496-eb00-4e33-abed-408db4effc8e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:19.243993 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5999a496-eb00-4e33-abed-408db4effc8e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:19.244753 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5999a496-eb00-4e33-abed-408db4effc8e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:19.245753 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5999a496-eb00-4e33-abed-408db4effc8e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:19.275781 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-5999a496-eb00-4e33-abed-408db4effc8e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043140 Oct 29 01:19:19.276431 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 493/1001] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:19 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:19.945458 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-4e38a6e3-897a-4f90-9534-26c04e67d746 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:19.946116 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-4e38a6e3-897a-4f90-9534-26c04e67d746 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:19.953521 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4e38a6e3-897a-4f90-9534-26c04e67d746 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:19.953970 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4e38a6e3-897a-4f90-9534-26c04e67d746 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:19.954935 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4e38a6e3-897a-4f90-9534-26c04e67d746 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:19.955373 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4e38a6e3-897a-4f90-9534-26c04e67d746 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:20.082019 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-4e38a6e3-897a-4f90-9534-26c04e67d746 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:20.089858 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-4e38a6e3-897a-4f90-9534-26c04e67d746 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.147971 Oct 29 01:19:20.090350 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 509/1002] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:19 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:20.287517 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f98d6452-8ae7-47b9-8e1f-62a56781e7d7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:20.288418 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f98d6452-8ae7-47b9-8e1f-62a56781e7d7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:20.295087 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f98d6452-8ae7-47b9-8e1f-62a56781e7d7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:20.295636 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f98d6452-8ae7-47b9-8e1f-62a56781e7d7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:20.296531 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f98d6452-8ae7-47b9-8e1f-62a56781e7d7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:20.296959 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f98d6452-8ae7-47b9-8e1f-62a56781e7d7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:20.331189 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f98d6452-8ae7-47b9-8e1f-62a56781e7d7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047217 Oct 29 01:19:20.331619 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 494/1003] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:20 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:21.107391 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-3be7ec6f-40e9-4f44-a35b-b32a9fd95d4f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:21.108067 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-3be7ec6f-40e9-4f44-a35b-b32a9fd95d4f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:21.114359 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3be7ec6f-40e9-4f44-a35b-b32a9fd95d4f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:21.114832 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3be7ec6f-40e9-4f44-a35b-b32a9fd95d4f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:21.115608 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3be7ec6f-40e9-4f44-a35b-b32a9fd95d4f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:21.116073 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3be7ec6f-40e9-4f44-a35b-b32a9fd95d4f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:21.243498 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-3be7ec6f-40e9-4f44-a35b-b32a9fd95d4f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:21.251884 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-3be7ec6f-40e9-4f44-a35b-b32a9fd95d4f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.148682 Oct 29 01:19:21.252459 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 510/1004] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:21 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:21.342150 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b3b86ae9-bc7b-4936-a144-b5ee805be141 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:21.343128 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b3b86ae9-bc7b-4936-a144-b5ee805be141 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:21.349319 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b3b86ae9-bc7b-4936-a144-b5ee805be141 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:21.349766 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b3b86ae9-bc7b-4936-a144-b5ee805be141 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:21.350562 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b3b86ae9-bc7b-4936-a144-b5ee805be141 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:21.350999 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b3b86ae9-bc7b-4936-a144-b5ee805be141 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:21.380586 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b3b86ae9-bc7b-4936-a144-b5ee805be141 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042240 Oct 29 01:19:21.381141 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 495/1005] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:21 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:22.270087 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-b986e684-b901-4825-ae62-a97d43582802 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:22.270716 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-b986e684-b901-4825-ae62-a97d43582802 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:22.277352 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b986e684-b901-4825-ae62-a97d43582802 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:22.277912 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b986e684-b901-4825-ae62-a97d43582802 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:22.278690 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b986e684-b901-4825-ae62-a97d43582802 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:22.279116 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b986e684-b901-4825-ae62-a97d43582802 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:22.403008 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-b986e684-b901-4825-ae62-a97d43582802 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:22.410460 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-b986e684-b901-4825-ae62-a97d43582802 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.145235 Oct 29 01:19:22.411865 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 511/1006] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:22 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:22.497802 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-83841072-d04f-472c-8af4-1fabfa952aaa tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:22.498999 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-83841072-d04f-472c-8af4-1fabfa952aaa tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:22.505632 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-83841072-d04f-472c-8af4-1fabfa952aaa tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:22.506077 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-83841072-d04f-472c-8af4-1fabfa952aaa tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:22.506872 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-83841072-d04f-472c-8af4-1fabfa952aaa tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:22.507328 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-83841072-d04f-472c-8af4-1fabfa952aaa tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:22.537841 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-83841072-d04f-472c-8af4-1fabfa952aaa tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148727 Oct 29 01:19:22.538561 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 496/1007] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:22 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:19:23.427703 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-9b7a8729-cf9f-41ab-bab3-71003437573c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:23.428359 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-9b7a8729-cf9f-41ab-bab3-71003437573c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:23.435247 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9b7a8729-cf9f-41ab-bab3-71003437573c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:23.435688 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9b7a8729-cf9f-41ab-bab3-71003437573c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:23.436452 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9b7a8729-cf9f-41ab-bab3-71003437573c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:23.436885 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9b7a8729-cf9f-41ab-bab3-71003437573c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:23.549112 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-76bb68ba-5659-45a7-a293-2cf3b30e46ad tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:23.550224 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-76bb68ba-5659-45a7-a293-2cf3b30e46ad tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:23.556883 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-76bb68ba-5659-45a7-a293-2cf3b30e46ad tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:23.557826 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-76bb68ba-5659-45a7-a293-2cf3b30e46ad tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:23.558638 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-76bb68ba-5659-45a7-a293-2cf3b30e46ad tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:23.559075 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-76bb68ba-5659-45a7-a293-2cf3b30e46ad tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:23.562857 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-9b7a8729-cf9f-41ab-bab3-71003437573c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:23.570064 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-9b7a8729-cf9f-41ab-bab3-71003437573c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.146113 Oct 29 01:19:23.573930 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 512/1008] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:23 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:23.590262 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-76bb68ba-5659-45a7-a293-2cf3b30e46ad tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044696 Oct 29 01:19:23.591091 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 497/1009] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:23 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:19:24.588400 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-3a012304-9492-4a35-9e33-2455247803d8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:24.589617 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-3a012304-9492-4a35-9e33-2455247803d8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:24.596318 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3a012304-9492-4a35-9e33-2455247803d8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:24.596763 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3a012304-9492-4a35-9e33-2455247803d8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:24.597530 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3a012304-9492-4a35-9e33-2455247803d8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:24.597961 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3a012304-9492-4a35-9e33-2455247803d8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:24.600793 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ba39e127-415a-4178-93f4-73784b685ae4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:24.601696 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ba39e127-415a-4178-93f4-73784b685ae4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:24.607763 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ba39e127-415a-4178-93f4-73784b685ae4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:24.608205 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ba39e127-415a-4178-93f4-73784b685ae4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:24.608968 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ba39e127-415a-4178-93f4-73784b685ae4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:24.609397 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ba39e127-415a-4178-93f4-73784b685ae4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:24.639225 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ba39e127-415a-4178-93f4-73784b685ae4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042077 Oct 29 01:19:24.639801 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 498/1010] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:24 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:19:24.725268 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-3a012304-9492-4a35-9e33-2455247803d8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:24.732522 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-3a012304-9492-4a35-9e33-2455247803d8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.148005 Oct 29 01:19:24.733090 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 513/1011] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:24 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:25.650850 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b3d512be-5795-42b6-b4bf-a4604148e7d6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:25.652497 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b3d512be-5795-42b6-b4bf-a4604148e7d6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:25.658571 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b3d512be-5795-42b6-b4bf-a4604148e7d6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:25.659022 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b3d512be-5795-42b6-b4bf-a4604148e7d6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:25.659786 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b3d512be-5795-42b6-b4bf-a4604148e7d6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:25.660217 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b3d512be-5795-42b6-b4bf-a4604148e7d6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:25.688834 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b3d512be-5795-42b6-b4bf-a4604148e7d6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041829 Oct 29 01:19:25.689381 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 499/1012] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:25 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:25.749266 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e79ef5cb-b4f6-48a5-82cf-1939e7fa2515 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:25.749864 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-e79ef5cb-b4f6-48a5-82cf-1939e7fa2515 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:25.756160 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e79ef5cb-b4f6-48a5-82cf-1939e7fa2515 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:25.756612 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e79ef5cb-b4f6-48a5-82cf-1939e7fa2515 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:25.757369 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e79ef5cb-b4f6-48a5-82cf-1939e7fa2515 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:25.757804 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e79ef5cb-b4f6-48a5-82cf-1939e7fa2515 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:25.877943 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-e79ef5cb-b4f6-48a5-82cf-1939e7fa2515 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:25.885206 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-e79ef5cb-b4f6-48a5-82cf-1939e7fa2515 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.139652 Oct 29 01:19:25.885846 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 514/1013] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:25 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:26.700964 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a7e629b0-e869-4636-9c3a-89a1ce6af006 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:26.701887 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a7e629b0-e869-4636-9c3a-89a1ce6af006 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:26.708509 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a7e629b0-e869-4636-9c3a-89a1ce6af006 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:26.708950 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a7e629b0-e869-4636-9c3a-89a1ce6af006 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:26.709717 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a7e629b0-e869-4636-9c3a-89a1ce6af006 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:26.710443 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a7e629b0-e869-4636-9c3a-89a1ce6af006 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:26.741328 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a7e629b0-e869-4636-9c3a-89a1ce6af006 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045224 Oct 29 01:19:26.741883 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 500/1014] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:26 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:26.905602 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-42136086-322b-4712-81a5-6aae86f375db tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:26.906260 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-42136086-322b-4712-81a5-6aae86f375db tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:26.912432 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-42136086-322b-4712-81a5-6aae86f375db tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:26.912881 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-42136086-322b-4712-81a5-6aae86f375db tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:26.913639 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-42136086-322b-4712-81a5-6aae86f375db tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:26.914070 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-42136086-322b-4712-81a5-6aae86f375db tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:27.036900 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-42136086-322b-4712-81a5-6aae86f375db tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:27.045027 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-42136086-322b-4712-81a5-6aae86f375db tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.143792 Oct 29 01:19:27.045590 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 515/1015] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:26 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:27.752761 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-7cdd5b9b-a12c-4b04-b382-44f3006522f4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:27.753708 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-7cdd5b9b-a12c-4b04-b382-44f3006522f4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:27.759893 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7cdd5b9b-a12c-4b04-b382-44f3006522f4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:27.760336 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7cdd5b9b-a12c-4b04-b382-44f3006522f4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:27.761688 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7cdd5b9b-a12c-4b04-b382-44f3006522f4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:27.762121 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7cdd5b9b-a12c-4b04-b382-44f3006522f4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:27.789973 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-7cdd5b9b-a12c-4b04-b382-44f3006522f4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040947 Oct 29 01:19:27.790541 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 501/1016] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:27 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:28.061616 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-3a184e09-cee4-43e0-a672-f1be9bb915b6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:28.062157 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-3a184e09-cee4-43e0-a672-f1be9bb915b6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:28.068276 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3a184e09-cee4-43e0-a672-f1be9bb915b6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:28.068717 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3a184e09-cee4-43e0-a672-f1be9bb915b6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:28.069472 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3a184e09-cee4-43e0-a672-f1be9bb915b6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:28.069898 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3a184e09-cee4-43e0-a672-f1be9bb915b6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:28.191096 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-3a184e09-cee4-43e0-a672-f1be9bb915b6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:28.198442 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-3a184e09-cee4-43e0-a672-f1be9bb915b6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.141094 Oct 29 01:19:28.199002 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 516/1017] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:28 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:28.801167 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-4c1153f7-9afc-4e3a-ac96-be2909aa9906 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:28.802749 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-4c1153f7-9afc-4e3a-ac96-be2909aa9906 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:28.810090 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4c1153f7-9afc-4e3a-ac96-be2909aa9906 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:28.810672 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4c1153f7-9afc-4e3a-ac96-be2909aa9906 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:28.811359 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4c1153f7-9afc-4e3a-ac96-be2909aa9906 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:28.811857 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4c1153f7-9afc-4e3a-ac96-be2909aa9906 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:28.841354 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-4c1153f7-9afc-4e3a-ac96-be2909aa9906 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043897 Oct 29 01:19:28.841913 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 502/1018] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:28 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:29.215884 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-eab28532-f638-451c-a583-3128f0038b6f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:29.216483 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-eab28532-f638-451c-a583-3128f0038b6f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:29.222808 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-eab28532-f638-451c-a583-3128f0038b6f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:29.223248 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-eab28532-f638-451c-a583-3128f0038b6f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:29.224000 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-eab28532-f638-451c-a583-3128f0038b6f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:29.224422 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-eab28532-f638-451c-a583-3128f0038b6f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:29.344159 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-eab28532-f638-451c-a583-3128f0038b6f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:29.351372 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-eab28532-f638-451c-a583-3128f0038b6f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.139185 Oct 29 01:19:29.351961 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 517/1019] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:29 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:29.852012 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ce40af28-a8b9-4596-96a2-a786f03ac8cd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:29.852918 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ce40af28-a8b9-4596-96a2-a786f03ac8cd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:29.859305 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ce40af28-a8b9-4596-96a2-a786f03ac8cd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:29.859748 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ce40af28-a8b9-4596-96a2-a786f03ac8cd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:29.860507 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ce40af28-a8b9-4596-96a2-a786f03ac8cd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:29.860939 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ce40af28-a8b9-4596-96a2-a786f03ac8cd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:29.889688 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ce40af28-a8b9-4596-96a2-a786f03ac8cd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041379 Oct 29 01:19:29.890236 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 503/1020] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:29 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:30.368417 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-49f335be-3964-45ce-b32c-b40f2b4fa8b6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:30.369064 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-49f335be-3964-45ce-b32c-b40f2b4fa8b6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:30.375699 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-49f335be-3964-45ce-b32c-b40f2b4fa8b6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:30.376138 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-49f335be-3964-45ce-b32c-b40f2b4fa8b6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:30.376890 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-49f335be-3964-45ce-b32c-b40f2b4fa8b6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:30.377314 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-49f335be-3964-45ce-b32c-b40f2b4fa8b6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:30.500120 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-49f335be-3964-45ce-b32c-b40f2b4fa8b6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:30.507468 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-49f335be-3964-45ce-b32c-b40f2b4fa8b6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.142699 Oct 29 01:19:30.508023 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 518/1021] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:30 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:30.901037 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-3eb5faeb-7459-4676-bf22-f1afb51104f9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:30.902097 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-3eb5faeb-7459-4676-bf22-f1afb51104f9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:30.908301 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3eb5faeb-7459-4676-bf22-f1afb51104f9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:30.908748 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3eb5faeb-7459-4676-bf22-f1afb51104f9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:30.909508 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3eb5faeb-7459-4676-bf22-f1afb51104f9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:30.909940 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3eb5faeb-7459-4676-bf22-f1afb51104f9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:30.939251 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-3eb5faeb-7459-4676-bf22-f1afb51104f9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041962 Oct 29 01:19:30.939809 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 504/1022] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:30 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:31.523862 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-39b4698d-1195-442b-8cfc-a003f94905b6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:31.524461 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-39b4698d-1195-442b-8cfc-a003f94905b6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:31.531496 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-39b4698d-1195-442b-8cfc-a003f94905b6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:31.531948 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-39b4698d-1195-442b-8cfc-a003f94905b6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:31.532726 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-39b4698d-1195-442b-8cfc-a003f94905b6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:31.533162 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-39b4698d-1195-442b-8cfc-a003f94905b6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:31.563539 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b3b1c5e5-7b74-4a70-8cd3-2b87e79ae52c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:31.564035 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b3b1c5e5-7b74-4a70-8cd3-2b87e79ae52c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:31.569891 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b3b1c5e5-7b74-4a70-8cd3-2b87e79ae52c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:31.570337 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b3b1c5e5-7b74-4a70-8cd3-2b87e79ae52c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:31.571133 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b3b1c5e5-7b74-4a70-8cd3-2b87e79ae52c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:31.571594 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b3b1c5e5-7b74-4a70-8cd3-2b87e79ae52c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:31.598081 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b3b1c5e5-7b74-4a70-8cd3-2b87e79ae52c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Going to try to terminate instance {{(pid=115747) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 01:19:31.677909 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b3b1c5e5-7b74-4a70-8cd3-2b87e79ae52c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "DELETE /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 204 len: 0 microversion: 2.1 time: 0.117713 Oct 29 01:19:31.678793 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 505/1023] 10.222.0.90 () {58 vars in 1238 bytes} [Fri Oct 29 01:19:31 2021] DELETE /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:19:31.687567 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-568deacf-5930-4a30-b647-ecf3d598b03e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:31.688278 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-568deacf-5930-4a30-b647-ecf3d598b03e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:31.695733 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-568deacf-5930-4a30-b647-ecf3d598b03e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:31.696188 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-568deacf-5930-4a30-b647-ecf3d598b03e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:31.696976 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-568deacf-5930-4a30-b647-ecf3d598b03e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:31.697410 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-568deacf-5930-4a30-b647-ecf3d598b03e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:31.913516 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-39b4698d-1195-442b-8cfc-a003f94905b6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:31.920854 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-39b4698d-1195-442b-8cfc-a003f94905b6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.400692 Oct 29 01:19:31.921421 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 519/1024] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:31 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:31.951638 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-0244bc76-13e6-40cd-9e12-525d5ea31cb8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:31.953308 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-0244bc76-13e6-40cd-9e12-525d5ea31cb8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:31.958879 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0244bc76-13e6-40cd-9e12-525d5ea31cb8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:31.958996 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0244bc76-13e6-40cd-9e12-525d5ea31cb8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:31.959766 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0244bc76-13e6-40cd-9e12-525d5ea31cb8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:31.960841 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0244bc76-13e6-40cd-9e12-525d5ea31cb8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:31.977946 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-568deacf-5930-4a30-b647-ecf3d598b03e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:31.986236 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-568deacf-5930-4a30-b647-ecf3d598b03e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1576 microversion: 2.1 time: 0.303150 Oct 29 01:19:31.986906 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 506/1025] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:31 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1576 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:31.993632 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-0244bc76-13e6-40cd-9e12-525d5ea31cb8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046659 Oct 29 01:19:31.994193 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 520/1026] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:31 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:19:32.317417 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-3dc9985a-1b0f-476b-97d8-c92ac0a0891c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:32.317906 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-3dc9985a-1b0f-476b-97d8-c92ac0a0891c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:32.324303 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3dc9985a-1b0f-476b-97d8-c92ac0a0891c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:32.324753 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3dc9985a-1b0f-476b-97d8-c92ac0a0891c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:32.325679 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3dc9985a-1b0f-476b-97d8-c92ac0a0891c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:32.326114 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3dc9985a-1b0f-476b-97d8-c92ac0a0891c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:32.351346 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-3dc9985a-1b0f-476b-97d8-c92ac0a0891c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Going to try to terminate instance {{(pid=115747) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 01:19:32.423081 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-3dc9985a-1b0f-476b-97d8-c92ac0a0891c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "DELETE /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e" status: 204 len: 0 microversion: 2.20 time: 0.109135 Oct 29 01:19:32.423744 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 507/1027] 10.222.0.90 () {60 vars in 1279 bytes} [Fri Oct 29 01:19:32 2021] DELETE /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 01:19:32.432794 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-623556a4-4154-4f5d-95df-c424218e6c39 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:32.433547 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-623556a4-4154-4f5d-95df-c424218e6c39 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:32.439479 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-623556a4-4154-4f5d-95df-c424218e6c39 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:32.439917 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-623556a4-4154-4f5d-95df-c424218e6c39 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:32.440677 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-623556a4-4154-4f5d-95df-c424218e6c39 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:32.441099 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-623556a4-4154-4f5d-95df-c424218e6c39 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:32.562791 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-623556a4-4154-4f5d-95df-c424218e6c39 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:32.571237 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-623556a4-4154-4f5d-95df-c424218e6c39 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:32.572648 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-623556a4-4154-4f5d-95df-c424218e6c39 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:32.574577 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-623556a4-4154-4f5d-95df-c424218e6c39 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e" status: 200 len: 1724 microversion: 2.20 time: 0.146302 Oct 29 01:19:32.575069 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 521/1028] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:19:32 2021] GET /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:32.939102 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9c5471da-cfac-4643-ad36-4146822e3867 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:32.939833 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9c5471da-cfac-4643-ad36-4146822e3867 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:32.946305 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9c5471da-cfac-4643-ad36-4146822e3867 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:32.946779 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9c5471da-cfac-4643-ad36-4146822e3867 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:32.947530 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9c5471da-cfac-4643-ad36-4146822e3867 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:32.947992 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9c5471da-cfac-4643-ad36-4146822e3867 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:33.005081 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-bc62390b-893a-4b84-8d9e-461f5509a116 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:33.006082 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-bc62390b-893a-4b84-8d9e-461f5509a116 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:33.012147 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bc62390b-893a-4b84-8d9e-461f5509a116 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:33.012514 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bc62390b-893a-4b84-8d9e-461f5509a116 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:33.013290 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bc62390b-893a-4b84-8d9e-461f5509a116 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:33.013727 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bc62390b-893a-4b84-8d9e-461f5509a116 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:33.043577 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-bc62390b-893a-4b84-8d9e-461f5509a116 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042152 Oct 29 01:19:33.044360 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 522/1029] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:33 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:19:33.051018 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-70d169c4-674e-4f9f-90a6-3f7c5784b8f7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:33.051633 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-70d169c4-674e-4f9f-90a6-3f7c5784b8f7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:33.057395 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-70d169c4-674e-4f9f-90a6-3f7c5784b8f7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:33.058417 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-70d169c4-674e-4f9f-90a6-3f7c5784b8f7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:33.059193 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-70d169c4-674e-4f9f-90a6-3f7c5784b8f7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:33.059635 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-70d169c4-674e-4f9f-90a6-3f7c5784b8f7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:33.076798 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-9c5471da-cfac-4643-ad36-4146822e3867 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:33.084404 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9c5471da-cfac-4643-ad36-4146822e3867 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.149629 Oct 29 01:19:33.085218 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 508/1030] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:32 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:33.185129 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-70d169c4-674e-4f9f-90a6-3f7c5784b8f7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:33.192492 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-70d169c4-674e-4f9f-90a6-3f7c5784b8f7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1576 microversion: 2.1 time: 0.145007 Oct 29 01:19:33.192987 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 523/1031] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:33 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1576 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:33.593683 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-1e7c1e16-bf9e-4c8e-8459-ce50e02a31ed tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:33.594281 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-1e7c1e16-bf9e-4c8e-8459-ce50e02a31ed tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:33.600160 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1e7c1e16-bf9e-4c8e-8459-ce50e02a31ed tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:33.600596 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1e7c1e16-bf9e-4c8e-8459-ce50e02a31ed tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:33.601379 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1e7c1e16-bf9e-4c8e-8459-ce50e02a31ed tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:33.601805 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1e7c1e16-bf9e-4c8e-8459-ce50e02a31ed tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:33.733317 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-1e7c1e16-bf9e-4c8e-8459-ce50e02a31ed tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:33.741011 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-1e7c1e16-bf9e-4c8e-8459-ce50e02a31ed tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:33.742532 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-1e7c1e16-bf9e-4c8e-8459-ce50e02a31ed tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:33.743673 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-1e7c1e16-bf9e-4c8e-8459-ce50e02a31ed tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e" status: 200 len: 1724 microversion: 2.20 time: 0.153834 Oct 29 01:19:33.744239 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 509/1032] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:19:33 2021] GET /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:19:34.055108 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-ca2c761b-6a1f-41e5-809c-9f1e3f978870 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:34.056021 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-ca2c761b-6a1f-41e5-809c-9f1e3f978870 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:34.063855 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ca2c761b-6a1f-41e5-809c-9f1e3f978870 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:34.064307 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ca2c761b-6a1f-41e5-809c-9f1e3f978870 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:34.065083 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ca2c761b-6a1f-41e5-809c-9f1e3f978870 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:34.065518 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ca2c761b-6a1f-41e5-809c-9f1e3f978870 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:34.102204 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-ca2c761b-6a1f-41e5-809c-9f1e3f978870 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050719 Oct 29 01:19:34.106429 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-de3a2e27-7082-472c-80fc-74842640eb4c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:34.107041 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 524/1033] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:34 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:34.107147 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-de3a2e27-7082-472c-80fc-74842640eb4c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:34.109872 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-de3a2e27-7082-472c-80fc-74842640eb4c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:34.110410 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-de3a2e27-7082-472c-80fc-74842640eb4c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:34.111209 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-de3a2e27-7082-472c-80fc-74842640eb4c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:34.111644 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-de3a2e27-7082-472c-80fc-74842640eb4c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:34.209939 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c87f013f-7233-4fa4-8261-444ef65c95c4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:34.210576 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c87f013f-7233-4fa4-8261-444ef65c95c4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:34.216638 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c87f013f-7233-4fa4-8261-444ef65c95c4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:34.217094 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c87f013f-7233-4fa4-8261-444ef65c95c4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:34.217877 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c87f013f-7233-4fa4-8261-444ef65c95c4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:34.219518 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c87f013f-7233-4fa4-8261-444ef65c95c4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:34.239268 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-de3a2e27-7082-472c-80fc-74842640eb4c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:34.247501 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-de3a2e27-7082-472c-80fc-74842640eb4c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.149951 Oct 29 01:19:34.248273 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 510/1034] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:34 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:19:34.354680 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-c87f013f-7233-4fa4-8261-444ef65c95c4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:34.361933 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c87f013f-7233-4fa4-8261-444ef65c95c4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1576 microversion: 2.1 time: 0.156860 Oct 29 01:19:34.362525 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 525/1035] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:34 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:19:34.762659 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-909d72e9-aa7e-44b2-9009-6886b8be14e7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:34.764238 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-909d72e9-aa7e-44b2-9009-6886b8be14e7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:34.772003 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-909d72e9-aa7e-44b2-9009-6886b8be14e7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:34.773001 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-909d72e9-aa7e-44b2-9009-6886b8be14e7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:34.774144 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-909d72e9-aa7e-44b2-9009-6886b8be14e7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:34.774821 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-909d72e9-aa7e-44b2-9009-6886b8be14e7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:34.948324 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-909d72e9-aa7e-44b2-9009-6886b8be14e7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:34.975052 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [req-c2cca5df-89b1-4a49-a41c-35a643037fd0 req-0898522b-4509-48c2-a2b6-b4ee820cf5f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11a30efc-58bb-4139-a2ca-1712680c7fde", "name": "network-vif-deleted", "tag": "a1c1c487-5f02-4bbf-96cd-d6b3e55b076a"}]} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:19:34.977369 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:19:34.977369 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: warnings.warn(msg) Oct 29 01:19:34.978178 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-909d72e9-aa7e-44b2-9009-6886b8be14e7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:34.980529 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-909d72e9-aa7e-44b2-9009-6886b8be14e7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:34.981798 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-909d72e9-aa7e-44b2-9009-6886b8be14e7 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e" status: 200 len: 1724 microversion: 2.20 time: 0.223373 Oct 29 01:19:34.982721 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 511/1036] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:19:34 2021] GET /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:34.984730 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-c2cca5df-89b1-4a49-a41c-35a643037fd0 req-0898522b-4509-48c2-a2b6-b4ee820cf5f4 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:34.985178 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-c2cca5df-89b1-4a49-a41c-35a643037fd0 req-0898522b-4509-48c2-a2b6-b4ee820cf5f4 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:34.996381 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.compute.server_external_events [req-c2cca5df-89b1-4a49-a41c-35a643037fd0 req-0898522b-4509-48c2-a2b6-b4ee820cf5f4 service nova] Creating event network-vif-deleted:a1c1c487-5f02-4bbf-96cd-d6b3e55b076a for instance 11a30efc-58bb-4139-a2ca-1712680c7fde on hv-cinder-81558 Oct 29 01:19:35.001601 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [req-c2cca5df-89b1-4a49-a41c-35a643037fd0 req-0898522b-4509-48c2-a2b6-b4ee820cf5f4 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122210 Oct 29 01:19:35.002425 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 526/1037] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:19:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:35.112975 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d4f28ad6-6c75-47e3-a7ba-45d42c1c56ae tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:35.113956 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d4f28ad6-6c75-47e3-a7ba-45d42c1c56ae tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:35.120192 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d4f28ad6-6c75-47e3-a7ba-45d42c1c56ae tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:35.120635 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d4f28ad6-6c75-47e3-a7ba-45d42c1c56ae tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:35.121409 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d4f28ad6-6c75-47e3-a7ba-45d42c1c56ae tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:35.121832 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d4f28ad6-6c75-47e3-a7ba-45d42c1c56ae tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:35.157754 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d4f28ad6-6c75-47e3-a7ba-45d42c1c56ae tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048411 Oct 29 01:19:35.159243 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 512/1038] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:35 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:35.266619 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-4773de58-e6b0-475d-ac9e-226513fab60e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:35.267553 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-4773de58-e6b0-475d-ac9e-226513fab60e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:35.274699 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4773de58-e6b0-475d-ac9e-226513fab60e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:35.275468 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4773de58-e6b0-475d-ac9e-226513fab60e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:35.277177 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4773de58-e6b0-475d-ac9e-226513fab60e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:35.277787 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4773de58-e6b0-475d-ac9e-226513fab60e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:35.380220 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-0c520401-0a91-42db-a4bf-82a339834fb3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:35.380846 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-0c520401-0a91-42db-a4bf-82a339834fb3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:35.387872 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0c520401-0a91-42db-a4bf-82a339834fb3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:35.388025 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0c520401-0a91-42db-a4bf-82a339834fb3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:35.388980 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0c520401-0a91-42db-a4bf-82a339834fb3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:35.389596 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0c520401-0a91-42db-a4bf-82a339834fb3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:35.466630 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-0c520401-0a91-42db-a4bf-82a339834fb3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:35.470123 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-4773de58-e6b0-475d-ac9e-226513fab60e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:35.477645 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-0c520401-0a91-42db-a4bf-82a339834fb3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.100896 Oct 29 01:19:35.479890 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 513/1039] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:35 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:19:35.481277 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-4773de58-e6b0-475d-ac9e-226513fab60e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.219077 Oct 29 01:19:35.481851 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 527/1040] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:35 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:36.001039 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-82a7633f-5bdb-48fb-8f99-ff90c2857f44 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:36.003110 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-82a7633f-5bdb-48fb-8f99-ff90c2857f44 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:36.015663 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-82a7633f-5bdb-48fb-8f99-ff90c2857f44 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:36.016459 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-82a7633f-5bdb-48fb-8f99-ff90c2857f44 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:36.018602 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-82a7633f-5bdb-48fb-8f99-ff90c2857f44 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:36.020205 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-82a7633f-5bdb-48fb-8f99-ff90c2857f44 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:36.080442 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-82a7633f-5bdb-48fb-8f99-ff90c2857f44 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:36.080802 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-82a7633f-5bdb-48fb-8f99-ff90c2857f44 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:36.081269 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.objects.instance [None req-82a7633f-5bdb-48fb-8f99-ff90c2857f44 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lazy-loading 'fault' on Instance uuid 88c93e0a-61e3-441e-966d-68099633969e {{(pid=115747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:19:36.140048 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-82a7633f-5bdb-48fb-8f99-ff90c2857f44 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:36.153324 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-82a7633f-5bdb-48fb-8f99-ff90c2857f44 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:36.155583 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-82a7633f-5bdb-48fb-8f99-ff90c2857f44 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bca27fde6ce471d900a7de497f487f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5b2a4f59a412d95c116ace173e394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:36.157663 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-82a7633f-5bdb-48fb-8f99-ff90c2857f44 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e" status: 200 len: 1371 microversion: 2.20 time: 0.160658 Oct 29 01:19:36.159076 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 514/1041] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:19:35 2021] GET /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:19:36.174524 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-30d2f39c-7992-44ce-83d6-e2e9db93d073 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:36.175606 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-30d2f39c-7992-44ce-83d6-e2e9db93d073 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:36.184152 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-30d2f39c-7992-44ce-83d6-e2e9db93d073 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:36.184663 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-30d2f39c-7992-44ce-83d6-e2e9db93d073 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:36.185574 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-30d2f39c-7992-44ce-83d6-e2e9db93d073 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:36.186013 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-30d2f39c-7992-44ce-83d6-e2e9db93d073 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:36.242663 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-30d2f39c-7992-44ce-83d6-e2e9db93d073 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074500 Oct 29 01:19:36.243582 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 528/1042] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:36 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:36.498895 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c1ec6a42-ba20-4331-96b4-c8aa39feaf95 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:36.499742 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c1ec6a42-ba20-4331-96b4-c8aa39feaf95 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:36.501644 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-9a53de11-9b81-416b-bb5c-a1e64b10ad65 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:36.502569 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-9a53de11-9b81-416b-bb5c-a1e64b10ad65 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:36.506324 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c1ec6a42-ba20-4331-96b4-c8aa39feaf95 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:36.506864 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c1ec6a42-ba20-4331-96b4-c8aa39feaf95 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:36.507630 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c1ec6a42-ba20-4331-96b4-c8aa39feaf95 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:36.508057 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c1ec6a42-ba20-4331-96b4-c8aa39feaf95 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:36.510974 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9a53de11-9b81-416b-bb5c-a1e64b10ad65 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:36.510974 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9a53de11-9b81-416b-bb5c-a1e64b10ad65 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:36.510974 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9a53de11-9b81-416b-bb5c-a1e64b10ad65 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:36.511678 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9a53de11-9b81-416b-bb5c-a1e64b10ad65 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:36.618216 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-9a53de11-9b81-416b-bb5c-a1e64b10ad65 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:36.627220 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-9a53de11-9b81-416b-bb5c-a1e64b10ad65 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.129531 Oct 29 01:19:36.629667 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 529/1043] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:36 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:36.725923 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c1ec6a42-ba20-4331-96b4-c8aa39feaf95 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:36.738689 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c1ec6a42-ba20-4331-96b4-c8aa39feaf95 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.243871 Oct 29 01:19:36.739685 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 515/1044] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:36 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:37.024353 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [req-4570e150-dda0-4865-bf5f-1a45c4b4152b req-642aaa2f-f4ed-4284-8116-65eb046f19c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88c93e0a-61e3-441e-966d-68099633969e", "name": "network-vif-deleted", "tag": "e9f39300-bc57-4560-8d70-a8ff52c182b0"}]} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:19:37.025867 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:19:37.025867 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: warnings.warn(msg) Oct 29 01:19:37.035632 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-4570e150-dda0-4865-bf5f-1a45c4b4152b req-642aaa2f-f4ed-4284-8116-65eb046f19c9 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:37.035632 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-4570e150-dda0-4865-bf5f-1a45c4b4152b req-642aaa2f-f4ed-4284-8116-65eb046f19c9 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:37.050232 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.compute.server_external_events [req-4570e150-dda0-4865-bf5f-1a45c4b4152b req-642aaa2f-f4ed-4284-8116-65eb046f19c9 service nova] Creating event network-vif-deleted:e9f39300-bc57-4560-8d70-a8ff52c182b0 for instance 88c93e0a-61e3-441e-966d-68099633969e on hv-cinder-81558 Oct 29 01:19:37.056095 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [req-4570e150-dda0-4865-bf5f-1a45c4b4152b req-642aaa2f-f4ed-4284-8116-65eb046f19c9 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035885 Oct 29 01:19:37.056705 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 530/1045] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:19:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:37.181129 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-62e03063-55a4-41e3-b9af-a889bc769276 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:37.181782 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-62e03063-55a4-41e3-b9af-a889bc769276 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:37.189721 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-62e03063-55a4-41e3-b9af-a889bc769276 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:37.190384 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-62e03063-55a4-41e3-b9af-a889bc769276 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:37.191733 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-62e03063-55a4-41e3-b9af-a889bc769276 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:37.192473 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-62e03063-55a4-41e3-b9af-a889bc769276 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:37.209305 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.wsgi [None req-62e03063-55a4-41e3-b9af-a889bc769276 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] HTTP exception thrown: Instance 88c93e0a-61e3-441e-966d-68099633969e could not be found. Oct 29 01:19:37.210052 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-62e03063-55a4-41e3-b9af-a889bc769276 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Returning 404 to user: Instance 88c93e0a-61e3-441e-966d-68099633969e could not be found. {{(pid=115747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:19:37.211167 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-62e03063-55a4-41e3-b9af-a889bc769276 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e" status: 404 len: 111 microversion: 2.20 time: 0.033944 Oct 29 01:19:37.211747 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 516/1046] 10.222.0.90 () {60 vars in 1276 bytes} [Fri Oct 29 01:19:37 2021] GET /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:19:37.221182 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-6cb93913-bcf4-4f94-b66d-eaeeee1d4a43 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '.version_select at 0x7f60292abca0>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:37.243560 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-6cb93913-bcf4-4f94-b66d-eaeeee1d4a43 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-910147812" status: 204 len: 0 microversion: 2.20 time: 0.026304 Oct 29 01:19:37.244218 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 531/1047] 10.222.0.90 () {60 vars in 1258 bytes} [Fri Oct 29 01:19:37 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-910147812 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 01:19:37.259867 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-58b5259d-eb4c-4d51-b23a-7332320afacc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:37.262308 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-58b5259d-eb4c-4d51-b23a-7332320afacc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:37.272518 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-58b5259d-eb4c-4d51-b23a-7332320afacc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:37.273244 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-58b5259d-eb4c-4d51-b23a-7332320afacc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:37.274142 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-58b5259d-eb4c-4d51-b23a-7332320afacc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:37.274722 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-58b5259d-eb4c-4d51-b23a-7332320afacc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:37.307596 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-58b5259d-eb4c-4d51-b23a-7332320afacc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054336 Oct 29 01:19:37.308337 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 517/1048] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:37 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:19:37.650434 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-3f15ef93-fec2-469e-9568-b902a1cf54fa tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:37.652356 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-3f15ef93-fec2-469e-9568-b902a1cf54fa tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:37.661401 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3f15ef93-fec2-469e-9568-b902a1cf54fa tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:37.661852 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3f15ef93-fec2-469e-9568-b902a1cf54fa tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:37.662723 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3f15ef93-fec2-469e-9568-b902a1cf54fa tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:37.663307 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3f15ef93-fec2-469e-9568-b902a1cf54fa tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:37.760528 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-3f15ef93-fec2-469e-9568-b902a1cf54fa tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:37.764829 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-28dd32f2-3e71-4092-a4ab-74064071fbca tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:37.765772 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-28dd32f2-3e71-4092-a4ab-74064071fbca tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:37.774589 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-28dd32f2-3e71-4092-a4ab-74064071fbca tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:37.775333 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-3f15ef93-fec2-469e-9568-b902a1cf54fa tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.130796 Oct 29 01:19:37.776271 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-28dd32f2-3e71-4092-a4ab-74064071fbca tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:37.777687 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 532/1049] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:37 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:37.786559 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-28dd32f2-3e71-4092-a4ab-74064071fbca tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:37.787095 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-28dd32f2-3e71-4092-a4ab-74064071fbca tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:37.971599 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-28dd32f2-3e71-4092-a4ab-74064071fbca tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:37.983907 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-28dd32f2-3e71-4092-a4ab-74064071fbca tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.226344 Oct 29 01:19:37.984493 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 518/1050] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:37 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:38.044367 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-66099352-864c-4dcf-a9d0-4767af3ddd27 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:38.045190 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-66099352-864c-4dcf-a9d0-4767af3ddd27 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:38.054278 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-66099352-864c-4dcf-a9d0-4767af3ddd27 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:38.054982 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-66099352-864c-4dcf-a9d0-4767af3ddd27 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:38.056071 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-66099352-864c-4dcf-a9d0-4767af3ddd27 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:38.056592 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-66099352-864c-4dcf-a9d0-4767af3ddd27 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:38.077633 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.wsgi [None req-66099352-864c-4dcf-a9d0-4767af3ddd27 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] HTTP exception thrown: Instance 88c93e0a-61e3-441e-966d-68099633969e could not be found. Oct 29 01:19:38.078231 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-66099352-864c-4dcf-a9d0-4767af3ddd27 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Returning 404 to user: Instance 88c93e0a-61e3-441e-966d-68099633969e could not be found. {{(pid=115748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:19:38.079322 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-66099352-864c-4dcf-a9d0-4767af3ddd27 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "DELETE /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e" status: 404 len: 111 microversion: 2.1 time: 0.040622 Oct 29 01:19:38.079654 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 533/1051] 10.222.0.90 () {58 vars in 1238 bytes} [Fri Oct 29 01:19:38 2021] DELETE /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:19:38.089151 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-16df4377-9e2e-4041-b463-eacefe89bf0f tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:38.089760 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-16df4377-9e2e-4041-b463-eacefe89bf0f tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 88c93e0a-61e3-441e-966d-68099633969e] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:38.097122 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-16df4377-9e2e-4041-b463-eacefe89bf0f tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:38.097565 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-16df4377-9e2e-4041-b463-eacefe89bf0f tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:38.098343 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-16df4377-9e2e-4041-b463-eacefe89bf0f tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:38.098810 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-16df4377-9e2e-4041-b463-eacefe89bf0f tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:38.113255 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.wsgi [None req-16df4377-9e2e-4041-b463-eacefe89bf0f tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] HTTP exception thrown: Instance 88c93e0a-61e3-441e-966d-68099633969e could not be found. Oct 29 01:19:38.113837 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-16df4377-9e2e-4041-b463-eacefe89bf0f tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Returning 404 to user: Instance 88c93e0a-61e3-441e-966d-68099633969e could not be found. {{(pid=115747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:19:38.114682 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-16df4377-9e2e-4041-b463-eacefe89bf0f tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e" status: 404 len: 111 microversion: 2.1 time: 0.029787 Oct 29 01:19:38.115231 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 519/1052] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:38 2021] GET /compute/v2.1/servers/88c93e0a-61e3-441e-966d-68099633969e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:19:38.319461 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-8f93258f-3883-4570-bc7f-67fa6db45f1f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:38.320310 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-8f93258f-3883-4570-bc7f-67fa6db45f1f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:38.327259 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8f93258f-3883-4570-bc7f-67fa6db45f1f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:38.327717 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8f93258f-3883-4570-bc7f-67fa6db45f1f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:38.328491 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8f93258f-3883-4570-bc7f-67fa6db45f1f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:38.328927 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8f93258f-3883-4570-bc7f-67fa6db45f1f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:38.359727 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-8f93258f-3883-4570-bc7f-67fa6db45f1f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044142 Oct 29 01:19:38.360453 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 534/1053] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:38 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:19:38.792760 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-93fbd8d6-6907-4094-b63f-793e03d5a583 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:38.793388 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-93fbd8d6-6907-4094-b63f-793e03d5a583 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:38.800768 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-93fbd8d6-6907-4094-b63f-793e03d5a583 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:38.801278 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-93fbd8d6-6907-4094-b63f-793e03d5a583 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:38.802684 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-93fbd8d6-6907-4094-b63f-793e03d5a583 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:38.803509 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-93fbd8d6-6907-4094-b63f-793e03d5a583 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:38.872420 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-93fbd8d6-6907-4094-b63f-793e03d5a583 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:38.884581 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-93fbd8d6-6907-4094-b63f-793e03d5a583 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.095166 Oct 29 01:19:38.886114 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 520/1054] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:38 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:39.004701 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f7f903ab-16b9-498a-8d07-e2a0723d1132 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:39.005915 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f7f903ab-16b9-498a-8d07-e2a0723d1132 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:39.012881 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f7f903ab-16b9-498a-8d07-e2a0723d1132 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:39.013331 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f7f903ab-16b9-498a-8d07-e2a0723d1132 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:39.014100 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f7f903ab-16b9-498a-8d07-e2a0723d1132 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:39.014577 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f7f903ab-16b9-498a-8d07-e2a0723d1132 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:39.147637 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-f7f903ab-16b9-498a-8d07-e2a0723d1132 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:39.156535 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f7f903ab-16b9-498a-8d07-e2a0723d1132 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.157789 Oct 29 01:19:39.157112 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 535/1055] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:38 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:19:39.372336 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-55579a4b-14ee-4e02-ab0d-aa539e7bf0ac tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:39.373481 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-55579a4b-14ee-4e02-ab0d-aa539e7bf0ac tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:39.379841 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-55579a4b-14ee-4e02-ab0d-aa539e7bf0ac tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:39.380289 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-55579a4b-14ee-4e02-ab0d-aa539e7bf0ac tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:39.381097 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-55579a4b-14ee-4e02-ab0d-aa539e7bf0ac tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:39.381517 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-55579a4b-14ee-4e02-ab0d-aa539e7bf0ac tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:39.413602 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-55579a4b-14ee-4e02-ab0d-aa539e7bf0ac tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045510 Oct 29 01:19:39.414178 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 521/1056] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:39 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:39.902997 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-74ddc75e-2939-4521-87b7-b65080b5bbd3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:39.903651 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-74ddc75e-2939-4521-87b7-b65080b5bbd3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:39.909820 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-74ddc75e-2939-4521-87b7-b65080b5bbd3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:39.910274 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-74ddc75e-2939-4521-87b7-b65080b5bbd3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:39.911096 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-74ddc75e-2939-4521-87b7-b65080b5bbd3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:39.911537 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-74ddc75e-2939-4521-87b7-b65080b5bbd3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:39.985256 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-74ddc75e-2939-4521-87b7-b65080b5bbd3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:39.995430 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-74ddc75e-2939-4521-87b7-b65080b5bbd3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.096460 Oct 29 01:19:39.996167 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 536/1057] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:39 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:40.175268 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-32da6e2d-2098-4fcc-a7c0-1cd5097a91d4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:40.176251 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-32da6e2d-2098-4fcc-a7c0-1cd5097a91d4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:40.183022 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-32da6e2d-2098-4fcc-a7c0-1cd5097a91d4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:40.183464 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-32da6e2d-2098-4fcc-a7c0-1cd5097a91d4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:40.184240 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-32da6e2d-2098-4fcc-a7c0-1cd5097a91d4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:40.184666 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-32da6e2d-2098-4fcc-a7c0-1cd5097a91d4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:40.314980 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-32da6e2d-2098-4fcc-a7c0-1cd5097a91d4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:40.322665 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-32da6e2d-2098-4fcc-a7c0-1cd5097a91d4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.151247 Oct 29 01:19:40.323736 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 522/1058] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:40 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:40.425160 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-7189dc14-ac32-4bdd-bc12-d283d56cbd0d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:40.426132 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-7189dc14-ac32-4bdd-bc12-d283d56cbd0d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:40.432659 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7189dc14-ac32-4bdd-bc12-d283d56cbd0d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:40.433112 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7189dc14-ac32-4bdd-bc12-d283d56cbd0d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:40.433913 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7189dc14-ac32-4bdd-bc12-d283d56cbd0d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:40.434502 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7189dc14-ac32-4bdd-bc12-d283d56cbd0d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:40.466042 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-7189dc14-ac32-4bdd-bc12-d283d56cbd0d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044612 Oct 29 01:19:40.466631 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 537/1059] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:40 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:41.015703 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-596932d4-79ac-4192-9fb1-8f68a368f326 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:41.016312 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-596932d4-79ac-4192-9fb1-8f68a368f326 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:41.022196 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-596932d4-79ac-4192-9fb1-8f68a368f326 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:41.022678 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-596932d4-79ac-4192-9fb1-8f68a368f326 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:41.023566 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-596932d4-79ac-4192-9fb1-8f68a368f326 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:41.023999 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-596932d4-79ac-4192-9fb1-8f68a368f326 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:41.088800 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-596932d4-79ac-4192-9fb1-8f68a368f326 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:41.096770 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-596932d4-79ac-4192-9fb1-8f68a368f326 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.084786 Oct 29 01:19:41.097391 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 523/1060] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:41 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:41.343373 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-3e5f7958-680c-471f-9d3f-6d63692f73f6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:41.344427 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-3e5f7958-680c-471f-9d3f-6d63692f73f6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:41.351145 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3e5f7958-680c-471f-9d3f-6d63692f73f6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:41.351595 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3e5f7958-680c-471f-9d3f-6d63692f73f6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:41.352367 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3e5f7958-680c-471f-9d3f-6d63692f73f6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:41.352810 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3e5f7958-680c-471f-9d3f-6d63692f73f6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:41.477678 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-041c6c48-4148-4f6c-86ff-905707205e6b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:41.478727 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-041c6c48-4148-4f6c-86ff-905707205e6b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:41.484532 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-3e5f7958-680c-471f-9d3f-6d63692f73f6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:41.488209 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-041c6c48-4148-4f6c-86ff-905707205e6b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:41.488963 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-041c6c48-4148-4f6c-86ff-905707205e6b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:41.489459 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-041c6c48-4148-4f6c-86ff-905707205e6b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:41.489953 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-041c6c48-4148-4f6c-86ff-905707205e6b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:41.492877 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-3e5f7958-680c-471f-9d3f-6d63692f73f6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.155668 Oct 29 01:19:41.493460 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 538/1061] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:41 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:41.528311 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-041c6c48-4148-4f6c-86ff-905707205e6b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054529 Oct 29 01:19:41.529086 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 524/1062] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:41 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:19:42.113946 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-6ed46de5-d2f4-4d51-b5f0-b4b8666b4be6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:42.114729 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-6ed46de5-d2f4-4d51-b5f0-b4b8666b4be6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:42.120968 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6ed46de5-d2f4-4d51-b5f0-b4b8666b4be6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:42.121413 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6ed46de5-d2f4-4d51-b5f0-b4b8666b4be6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:42.122183 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6ed46de5-d2f4-4d51-b5f0-b4b8666b4be6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:42.122655 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6ed46de5-d2f4-4d51-b5f0-b4b8666b4be6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:42.206692 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-6ed46de5-d2f4-4d51-b5f0-b4b8666b4be6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:42.215594 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-6ed46de5-d2f4-4d51-b5f0-b4b8666b4be6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.105294 Oct 29 01:19:42.216339 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 539/1063] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:42 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:19:42.514554 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-0ab2a9d3-3447-4d50-bb51-9bc1cb1bb7ad tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:42.516604 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-0ab2a9d3-3447-4d50-bb51-9bc1cb1bb7ad tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:42.526206 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0ab2a9d3-3447-4d50-bb51-9bc1cb1bb7ad tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:42.527017 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0ab2a9d3-3447-4d50-bb51-9bc1cb1bb7ad tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:42.528259 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0ab2a9d3-3447-4d50-bb51-9bc1cb1bb7ad tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:42.529127 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0ab2a9d3-3447-4d50-bb51-9bc1cb1bb7ad tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:42.546090 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c67c4df7-26f2-4f5e-8ebd-f0439c433b93 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:42.548678 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c67c4df7-26f2-4f5e-8ebd-f0439c433b93 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:42.561327 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c67c4df7-26f2-4f5e-8ebd-f0439c433b93 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:42.562352 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c67c4df7-26f2-4f5e-8ebd-f0439c433b93 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:42.563750 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c67c4df7-26f2-4f5e-8ebd-f0439c433b93 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:42.564543 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c67c4df7-26f2-4f5e-8ebd-f0439c433b93 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:42.607335 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c67c4df7-26f2-4f5e-8ebd-f0439c433b93 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069573 Oct 29 01:19:42.607930 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 540/1064] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:42 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:19:42.678369 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-0ab2a9d3-3447-4d50-bb51-9bc1cb1bb7ad tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:42.688073 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-0ab2a9d3-3447-4d50-bb51-9bc1cb1bb7ad tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.179826 Oct 29 01:19:42.689031 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 525/1065] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:42 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:43.239411 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-ee8ed938-0ade-4431-a21b-af4ec24b9a5b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:43.240500 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-ee8ed938-0ade-4431-a21b-af4ec24b9a5b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:43.250769 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ee8ed938-0ade-4431-a21b-af4ec24b9a5b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:43.251563 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ee8ed938-0ade-4431-a21b-af4ec24b9a5b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:43.252936 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ee8ed938-0ade-4431-a21b-af4ec24b9a5b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:43.253709 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ee8ed938-0ade-4431-a21b-af4ec24b9a5b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:43.321776 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-ee8ed938-0ade-4431-a21b-af4ec24b9a5b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:43.339476 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-ee8ed938-0ade-4431-a21b-af4ec24b9a5b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.106417 Oct 29 01:19:43.340076 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 541/1066] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:43 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:43.619037 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c9f93747-eee1-4ea0-aedd-031c5d1885b8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:43.620000 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c9f93747-eee1-4ea0-aedd-031c5d1885b8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:43.627295 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c9f93747-eee1-4ea0-aedd-031c5d1885b8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:43.627769 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c9f93747-eee1-4ea0-aedd-031c5d1885b8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:43.628704 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c9f93747-eee1-4ea0-aedd-031c5d1885b8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:43.629143 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c9f93747-eee1-4ea0-aedd-031c5d1885b8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:43.659859 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c9f93747-eee1-4ea0-aedd-031c5d1885b8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044601 Oct 29 01:19:43.660424 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 526/1067] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:43 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:43.707273 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-18d9d505-f7a2-40de-b537-e9d6bcd53f4a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:43.707890 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-18d9d505-f7a2-40de-b537-e9d6bcd53f4a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:43.715072 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-18d9d505-f7a2-40de-b537-e9d6bcd53f4a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:43.715518 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-18d9d505-f7a2-40de-b537-e9d6bcd53f4a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:43.716293 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-18d9d505-f7a2-40de-b537-e9d6bcd53f4a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:43.716723 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-18d9d505-f7a2-40de-b537-e9d6bcd53f4a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:43.875973 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-18d9d505-f7a2-40de-b537-e9d6bcd53f4a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:43.883641 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-18d9d505-f7a2-40de-b537-e9d6bcd53f4a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.179999 Oct 29 01:19:43.884207 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 542/1068] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:43 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:19:44.359134 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-5a0cb1e3-3385-4c86-b8ff-3b57c039b1ec tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:44.360003 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-5a0cb1e3-3385-4c86-b8ff-3b57c039b1ec tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:44.366770 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5a0cb1e3-3385-4c86-b8ff-3b57c039b1ec tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:44.367200 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5a0cb1e3-3385-4c86-b8ff-3b57c039b1ec tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:44.367994 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5a0cb1e3-3385-4c86-b8ff-3b57c039b1ec tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:44.368418 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5a0cb1e3-3385-4c86-b8ff-3b57c039b1ec tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:44.431292 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-5a0cb1e3-3385-4c86-b8ff-3b57c039b1ec tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:44.439540 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-5a0cb1e3-3385-4c86-b8ff-3b57c039b1ec tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.084307 Oct 29 01:19:44.440241 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 527/1069] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:44 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:44.671584 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f04f61ac-c1c0-42ab-a186-5e67be8a9272 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:44.672547 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f04f61ac-c1c0-42ab-a186-5e67be8a9272 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:44.678627 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f04f61ac-c1c0-42ab-a186-5e67be8a9272 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:44.679071 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f04f61ac-c1c0-42ab-a186-5e67be8a9272 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:44.679830 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f04f61ac-c1c0-42ab-a186-5e67be8a9272 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:44.680299 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f04f61ac-c1c0-42ab-a186-5e67be8a9272 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:44.712575 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f04f61ac-c1c0-42ab-a186-5e67be8a9272 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044891 Oct 29 01:19:44.713275 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 543/1070] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:44 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:44.900865 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-8c622a47-0ee5-40cf-9628-6f99b666785a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:44.902240 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-8c622a47-0ee5-40cf-9628-6f99b666785a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:44.908717 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8c622a47-0ee5-40cf-9628-6f99b666785a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:44.909164 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8c622a47-0ee5-40cf-9628-6f99b666785a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:44.909944 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8c622a47-0ee5-40cf-9628-6f99b666785a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:44.910380 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8c622a47-0ee5-40cf-9628-6f99b666785a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:45.043299 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-8c622a47-0ee5-40cf-9628-6f99b666785a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:45.051132 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-8c622a47-0ee5-40cf-9628-6f99b666785a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.153935 Oct 29 01:19:45.051700 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 528/1071] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:44 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:45.457156 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-a0fd8c94-e8a6-4559-aba7-450ac5bbcd52 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:45.458157 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-a0fd8c94-e8a6-4559-aba7-450ac5bbcd52 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:45.464583 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a0fd8c94-e8a6-4559-aba7-450ac5bbcd52 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:45.465071 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a0fd8c94-e8a6-4559-aba7-450ac5bbcd52 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:45.465875 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a0fd8c94-e8a6-4559-aba7-450ac5bbcd52 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:45.466305 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a0fd8c94-e8a6-4559-aba7-450ac5bbcd52 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:45.530060 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-a0fd8c94-e8a6-4559-aba7-450ac5bbcd52 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:45.537603 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-a0fd8c94-e8a6-4559-aba7-450ac5bbcd52 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.084342 Oct 29 01:19:45.538173 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 544/1072] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:45 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:45.724050 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b4fda6af-6992-4803-93f1-bd3281e5521d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:45.724909 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b4fda6af-6992-4803-93f1-bd3281e5521d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:45.731501 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b4fda6af-6992-4803-93f1-bd3281e5521d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:45.732163 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b4fda6af-6992-4803-93f1-bd3281e5521d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:45.733259 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b4fda6af-6992-4803-93f1-bd3281e5521d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:45.733942 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b4fda6af-6992-4803-93f1-bd3281e5521d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:45.769038 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b4fda6af-6992-4803-93f1-bd3281e5521d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048807 Oct 29 01:19:45.769605 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 529/1073] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:45 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:46.067163 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2075c5a5-c658-472c-8ac9-af5b635da5b8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:46.067722 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2075c5a5-c658-472c-8ac9-af5b635da5b8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:46.073994 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2075c5a5-c658-472c-8ac9-af5b635da5b8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:46.074475 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2075c5a5-c658-472c-8ac9-af5b635da5b8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:46.075248 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2075c5a5-c658-472c-8ac9-af5b635da5b8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:46.075678 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2075c5a5-c658-472c-8ac9-af5b635da5b8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:46.206421 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-2075c5a5-c658-472c-8ac9-af5b635da5b8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:46.214186 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2075c5a5-c658-472c-8ac9-af5b635da5b8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.150708 Oct 29 01:19:46.214781 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 545/1074] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:46 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:46.556996 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ee31973f-c6a1-490f-995d-03a1d9539757 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:46.557654 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ee31973f-c6a1-490f-995d-03a1d9539757 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:46.564593 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ee31973f-c6a1-490f-995d-03a1d9539757 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:46.565036 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ee31973f-c6a1-490f-995d-03a1d9539757 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:46.565796 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ee31973f-c6a1-490f-995d-03a1d9539757 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:46.566223 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ee31973f-c6a1-490f-995d-03a1d9539757 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:46.628468 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-ee31973f-c6a1-490f-995d-03a1d9539757 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:46.636265 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ee31973f-c6a1-490f-995d-03a1d9539757 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.082603 Oct 29 01:19:46.636905 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 530/1075] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:46 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:46.781089 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-aace2a5e-f460-417a-b6a5-f96968bb0284 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:46.782007 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-aace2a5e-f460-417a-b6a5-f96968bb0284 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:46.787868 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-aace2a5e-f460-417a-b6a5-f96968bb0284 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:46.788318 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-aace2a5e-f460-417a-b6a5-f96968bb0284 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:46.789083 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-aace2a5e-f460-417a-b6a5-f96968bb0284 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:46.789515 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-aace2a5e-f460-417a-b6a5-f96968bb0284 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:46.826094 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-aace2a5e-f460-417a-b6a5-f96968bb0284 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049291 Oct 29 01:19:46.826794 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 546/1076] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:46 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:47.231118 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-879fa980-a4ab-4b62-94bd-7a6042b4f211 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:47.231643 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-879fa980-a4ab-4b62-94bd-7a6042b4f211 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:47.237667 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-879fa980-a4ab-4b62-94bd-7a6042b4f211 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:47.238113 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-879fa980-a4ab-4b62-94bd-7a6042b4f211 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:47.238907 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-879fa980-a4ab-4b62-94bd-7a6042b4f211 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:47.239349 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-879fa980-a4ab-4b62-94bd-7a6042b4f211 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:47.374639 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-879fa980-a4ab-4b62-94bd-7a6042b4f211 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:47.382318 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-879fa980-a4ab-4b62-94bd-7a6042b4f211 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.155099 Oct 29 01:19:47.382925 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 531/1077] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:47 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:47.654988 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-8ead2dfc-9519-4d6a-a88e-47efaf211c2e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:47.658668 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-8ead2dfc-9519-4d6a-a88e-47efaf211c2e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:47.665437 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8ead2dfc-9519-4d6a-a88e-47efaf211c2e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:47.665874 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8ead2dfc-9519-4d6a-a88e-47efaf211c2e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:47.666667 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8ead2dfc-9519-4d6a-a88e-47efaf211c2e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:47.667095 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8ead2dfc-9519-4d6a-a88e-47efaf211c2e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:47.735750 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-8ead2dfc-9519-4d6a-a88e-47efaf211c2e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:47.743975 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-8ead2dfc-9519-4d6a-a88e-47efaf211c2e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.094700 Oct 29 01:19:47.744545 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 547/1078] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:47 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:47.839763 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-522bc7c3-cf4b-42f0-b03f-2d71c5c95e2a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:47.840671 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-522bc7c3-cf4b-42f0-b03f-2d71c5c95e2a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:47.847221 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-522bc7c3-cf4b-42f0-b03f-2d71c5c95e2a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:47.847670 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-522bc7c3-cf4b-42f0-b03f-2d71c5c95e2a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:47.848446 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-522bc7c3-cf4b-42f0-b03f-2d71c5c95e2a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:47.848912 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-522bc7c3-cf4b-42f0-b03f-2d71c5c95e2a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:47.879918 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-522bc7c3-cf4b-42f0-b03f-2d71c5c95e2a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044332 Oct 29 01:19:47.880491 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 532/1079] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:47 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:19:48.399652 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-1eabe44e-c184-470a-a1fe-cb0b165878f7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:48.400253 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-1eabe44e-c184-470a-a1fe-cb0b165878f7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:48.406696 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1eabe44e-c184-470a-a1fe-cb0b165878f7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:48.407138 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1eabe44e-c184-470a-a1fe-cb0b165878f7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:48.407994 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1eabe44e-c184-470a-a1fe-cb0b165878f7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:48.408433 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1eabe44e-c184-470a-a1fe-cb0b165878f7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:48.536290 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-1eabe44e-c184-470a-a1fe-cb0b165878f7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:48.543703 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-1eabe44e-c184-470a-a1fe-cb0b165878f7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.147733 Oct 29 01:19:48.544277 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 548/1080] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:48 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:19:48.761753 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-cb24aecd-093c-4310-b756-b79b4427b165 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:48.762315 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-cb24aecd-093c-4310-b756-b79b4427b165 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:48.769327 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cb24aecd-093c-4310-b756-b79b4427b165 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:48.769773 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cb24aecd-093c-4310-b756-b79b4427b165 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:48.770619 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cb24aecd-093c-4310-b756-b79b4427b165 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:48.771047 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cb24aecd-093c-4310-b756-b79b4427b165 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:48.840908 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-cb24aecd-093c-4310-b756-b79b4427b165 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:48.849007 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-cb24aecd-093c-4310-b756-b79b4427b165 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.091425 Oct 29 01:19:48.849590 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 533/1081] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:48 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:19:48.895171 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-b86131c9-d598-4a17-b3cc-999e68eea849 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:48.896780 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-b86131c9-d598-4a17-b3cc-999e68eea849 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:48.906848 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b86131c9-d598-4a17-b3cc-999e68eea849 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:48.907289 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b86131c9-d598-4a17-b3cc-999e68eea849 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:48.908073 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b86131c9-d598-4a17-b3cc-999e68eea849 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:48.908513 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b86131c9-d598-4a17-b3cc-999e68eea849 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:48.942467 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-b86131c9-d598-4a17-b3cc-999e68eea849 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054038 Oct 29 01:19:48.943041 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 549/1082] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:48 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:49.562838 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-2583ce2c-eda5-4373-bd62-27a41d8648fc tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:49.563459 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-2583ce2c-eda5-4373-bd62-27a41d8648fc tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:49.570547 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2583ce2c-eda5-4373-bd62-27a41d8648fc tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:49.571004 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2583ce2c-eda5-4373-bd62-27a41d8648fc tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:49.571791 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2583ce2c-eda5-4373-bd62-27a41d8648fc tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:49.572665 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2583ce2c-eda5-4373-bd62-27a41d8648fc tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:49.705848 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-2583ce2c-eda5-4373-bd62-27a41d8648fc tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:49.717259 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-2583ce2c-eda5-4373-bd62-27a41d8648fc tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.159809 Oct 29 01:19:49.717936 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 534/1083] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:49 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:49.866412 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-776ebad4-a9f1-4f79-a811-2226ebacf74c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:49.867038 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-776ebad4-a9f1-4f79-a811-2226ebacf74c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:49.874137 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-776ebad4-a9f1-4f79-a811-2226ebacf74c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:49.874630 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-776ebad4-a9f1-4f79-a811-2226ebacf74c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:49.875424 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-776ebad4-a9f1-4f79-a811-2226ebacf74c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:49.875847 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-776ebad4-a9f1-4f79-a811-2226ebacf74c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:49.942558 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-776ebad4-a9f1-4f79-a811-2226ebacf74c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:49.953285 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f0a868e9-60d5-4ff3-bf7c-3e431b9da8fb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:49.954224 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f0a868e9-60d5-4ff3-bf7c-3e431b9da8fb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:49.954753 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-776ebad4-a9f1-4f79-a811-2226ebacf74c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.091926 Oct 29 01:19:49.955628 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 550/1084] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:49 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:49.961154 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f0a868e9-60d5-4ff3-bf7c-3e431b9da8fb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:49.961619 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f0a868e9-60d5-4ff3-bf7c-3e431b9da8fb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:49.962426 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f0a868e9-60d5-4ff3-bf7c-3e431b9da8fb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:49.962844 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f0a868e9-60d5-4ff3-bf7c-3e431b9da8fb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:50.002592 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f0a868e9-60d5-4ff3-bf7c-3e431b9da8fb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053080 Oct 29 01:19:50.003170 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 535/1085] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:49 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:19:50.740792 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-9a38718d-3d29-431c-bc6b-6aaf9c40cbfa tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:50.741442 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-9a38718d-3d29-431c-bc6b-6aaf9c40cbfa tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:50.747463 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9a38718d-3d29-431c-bc6b-6aaf9c40cbfa tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:50.747987 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9a38718d-3d29-431c-bc6b-6aaf9c40cbfa tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:50.749288 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9a38718d-3d29-431c-bc6b-6aaf9c40cbfa tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:50.749728 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9a38718d-3d29-431c-bc6b-6aaf9c40cbfa tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:50.904927 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-9a38718d-3d29-431c-bc6b-6aaf9c40cbfa tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:50.913734 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-9a38718d-3d29-431c-bc6b-6aaf9c40cbfa tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.176565 Oct 29 01:19:50.914323 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 551/1086] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:50 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:50.973029 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-fef24ca2-50b9-4033-993d-019a4420eddb tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:50.973672 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-fef24ca2-50b9-4033-993d-019a4420eddb tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:50.980301 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fef24ca2-50b9-4033-993d-019a4420eddb tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:50.980744 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fef24ca2-50b9-4033-993d-019a4420eddb tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:50.981532 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fef24ca2-50b9-4033-993d-019a4420eddb tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:50.981962 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fef24ca2-50b9-4033-993d-019a4420eddb tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:51.016381 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-8f21228f-48c3-4b17-bb5a-111d9e2ad146 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:51.017358 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-8f21228f-48c3-4b17-bb5a-111d9e2ad146 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:51.023581 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8f21228f-48c3-4b17-bb5a-111d9e2ad146 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:51.024025 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8f21228f-48c3-4b17-bb5a-111d9e2ad146 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:51.024801 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8f21228f-48c3-4b17-bb5a-111d9e2ad146 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:51.025235 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8f21228f-48c3-4b17-bb5a-111d9e2ad146 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:51.052166 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-fef24ca2-50b9-4033-993d-019a4420eddb tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:51.063559 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-fef24ca2-50b9-4033-993d-019a4420eddb tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.094564 Oct 29 01:19:51.064173 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 536/1087] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:50 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:51.067878 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-8f21228f-48c3-4b17-bb5a-111d9e2ad146 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057364 Oct 29 01:19:51.068471 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 552/1088] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:51 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:51.932442 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-1c74cbe8-29a5-4dbb-9c26-734284e00228 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:51.933038 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-1c74cbe8-29a5-4dbb-9c26-734284e00228 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:51.940469 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1c74cbe8-29a5-4dbb-9c26-734284e00228 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:51.940921 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1c74cbe8-29a5-4dbb-9c26-734284e00228 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:51.942266 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1c74cbe8-29a5-4dbb-9c26-734284e00228 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:51.942862 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1c74cbe8-29a5-4dbb-9c26-734284e00228 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:52.074895 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-1c74cbe8-29a5-4dbb-9c26-734284e00228 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:52.080002 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-bd158197-3041-4903-825f-5ad622052707 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:52.080547 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-bd158197-3041-4903-825f-5ad622052707 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:52.083178 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-1c74cbe8-29a5-4dbb-9c26-734284e00228 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.154546 Oct 29 01:19:52.083781 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 537/1089] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:51 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:52.088572 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-6949d180-bbd0-4179-88b2-0c27e42e56ac tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:52.088973 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bd158197-3041-4903-825f-5ad622052707 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:52.089435 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bd158197-3041-4903-825f-5ad622052707 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:52.089598 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-6949d180-bbd0-4179-88b2-0c27e42e56ac tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:52.091096 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bd158197-3041-4903-825f-5ad622052707 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:52.092320 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bd158197-3041-4903-825f-5ad622052707 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:52.096227 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6949d180-bbd0-4179-88b2-0c27e42e56ac tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:52.096674 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6949d180-bbd0-4179-88b2-0c27e42e56ac tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:52.097454 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6949d180-bbd0-4179-88b2-0c27e42e56ac tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:52.097909 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6949d180-bbd0-4179-88b2-0c27e42e56ac tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:52.130286 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-6949d180-bbd0-4179-88b2-0c27e42e56ac tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045453 Oct 29 01:19:52.130906 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 538/1090] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:52 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:52.166377 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-bd158197-3041-4903-825f-5ad622052707 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:52.174890 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-bd158197-3041-4903-825f-5ad622052707 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.098551 Oct 29 01:19:52.175494 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 553/1091] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:52 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:53.100957 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d2bd7331-c921-44d9-a763-e1db00c30c13 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:53.101551 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d2bd7331-c921-44d9-a763-e1db00c30c13 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:53.108634 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d2bd7331-c921-44d9-a763-e1db00c30c13 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:53.109081 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d2bd7331-c921-44d9-a763-e1db00c30c13 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:53.109858 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d2bd7331-c921-44d9-a763-e1db00c30c13 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:53.110292 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d2bd7331-c921-44d9-a763-e1db00c30c13 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:53.142581 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-820692a3-1f13-43d0-9779-7fc16ee299e0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:53.143510 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-820692a3-1f13-43d0-9779-7fc16ee299e0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:53.152639 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-820692a3-1f13-43d0-9779-7fc16ee299e0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:53.153301 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-820692a3-1f13-43d0-9779-7fc16ee299e0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:53.154498 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-820692a3-1f13-43d0-9779-7fc16ee299e0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:53.155282 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-820692a3-1f13-43d0-9779-7fc16ee299e0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:53.190105 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-820692a3-1f13-43d0-9779-7fc16ee299e0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051186 Oct 29 01:19:53.190917 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 554/1092] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:53 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:19:53.195095 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-28c44e80-ae4b-46e2-88b6-de9a95c06bf1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:53.195710 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-28c44e80-ae4b-46e2-88b6-de9a95c06bf1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:53.201686 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-28c44e80-ae4b-46e2-88b6-de9a95c06bf1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:53.202139 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-28c44e80-ae4b-46e2-88b6-de9a95c06bf1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:53.202954 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-28c44e80-ae4b-46e2-88b6-de9a95c06bf1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:53.203398 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-28c44e80-ae4b-46e2-88b6-de9a95c06bf1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:53.251348 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-d2bd7331-c921-44d9-a763-e1db00c30c13 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:53.259433 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d2bd7331-c921-44d9-a763-e1db00c30c13 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.162074 Oct 29 01:19:53.260036 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 539/1093] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:53 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:53.277481 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-28c44e80-ae4b-46e2-88b6-de9a95c06bf1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:53.285767 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-28c44e80-ae4b-46e2-88b6-de9a95c06bf1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.094021 Oct 29 01:19:53.286346 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 555/1094] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:53 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:54.202482 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-42fc5441-0a5d-48f9-913a-8a77753199ac tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:54.203555 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-42fc5441-0a5d-48f9-913a-8a77753199ac tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:54.209800 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-42fc5441-0a5d-48f9-913a-8a77753199ac tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:54.210255 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-42fc5441-0a5d-48f9-913a-8a77753199ac tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:54.211328 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-42fc5441-0a5d-48f9-913a-8a77753199ac tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:54.211790 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-42fc5441-0a5d-48f9-913a-8a77753199ac tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:54.241470 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-42fc5441-0a5d-48f9-913a-8a77753199ac tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043299 Oct 29 01:19:54.242029 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 540/1095] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:54 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:54.277273 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2a9cbc82-2a73-4f53-82c1-dff64902fa50 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:54.277913 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2a9cbc82-2a73-4f53-82c1-dff64902fa50 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:54.284232 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2a9cbc82-2a73-4f53-82c1-dff64902fa50 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:54.284664 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2a9cbc82-2a73-4f53-82c1-dff64902fa50 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:54.285463 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2a9cbc82-2a73-4f53-82c1-dff64902fa50 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:54.285895 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2a9cbc82-2a73-4f53-82c1-dff64902fa50 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:54.302901 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b0ec349a-b09b-42db-9d79-bb3763fb421b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:54.303531 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b0ec349a-b09b-42db-9d79-bb3763fb421b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:54.309769 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b0ec349a-b09b-42db-9d79-bb3763fb421b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:54.310734 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b0ec349a-b09b-42db-9d79-bb3763fb421b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:54.311507 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b0ec349a-b09b-42db-9d79-bb3763fb421b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:54.311937 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b0ec349a-b09b-42db-9d79-bb3763fb421b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:54.382023 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-b0ec349a-b09b-42db-9d79-bb3763fb421b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:54.390225 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b0ec349a-b09b-42db-9d79-bb3763fb421b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.090988 Oct 29 01:19:54.390836 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 541/1096] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:54 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:19:54.440365 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-2a9cbc82-2a73-4f53-82c1-dff64902fa50 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:54.447887 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2a9cbc82-2a73-4f53-82c1-dff64902fa50 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.174289 Oct 29 01:19:54.448454 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 556/1097] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:54 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:55.253391 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-142aceaf-0ced-48b6-871f-c7bbe1d0a39b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:55.254210 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-142aceaf-0ced-48b6-871f-c7bbe1d0a39b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:55.260567 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-142aceaf-0ced-48b6-871f-c7bbe1d0a39b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:55.261031 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-142aceaf-0ced-48b6-871f-c7bbe1d0a39b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:55.261826 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-142aceaf-0ced-48b6-871f-c7bbe1d0a39b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:55.262239 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-142aceaf-0ced-48b6-871f-c7bbe1d0a39b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:55.293943 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-142aceaf-0ced-48b6-871f-c7bbe1d0a39b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044078 Oct 29 01:19:55.294234 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 542/1098] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:55 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:55.407608 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-909f4542-a6be-4d74-a179-8d37f3b7c69d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:55.408192 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-909f4542-a6be-4d74-a179-8d37f3b7c69d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:55.414804 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-909f4542-a6be-4d74-a179-8d37f3b7c69d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:55.415247 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-909f4542-a6be-4d74-a179-8d37f3b7c69d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:55.416008 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-909f4542-a6be-4d74-a179-8d37f3b7c69d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:55.416434 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-909f4542-a6be-4d74-a179-8d37f3b7c69d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:55.464962 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-705bd97c-d024-4457-b19c-ac25c4b45f58 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:55.465682 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-705bd97c-d024-4457-b19c-ac25c4b45f58 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:55.473013 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-705bd97c-d024-4457-b19c-ac25c4b45f58 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:55.473416 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-705bd97c-d024-4457-b19c-ac25c4b45f58 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:55.474198 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-705bd97c-d024-4457-b19c-ac25c4b45f58 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:55.474672 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-705bd97c-d024-4457-b19c-ac25c4b45f58 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:55.477990 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-909f4542-a6be-4d74-a179-8d37f3b7c69d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:55.485634 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-909f4542-a6be-4d74-a179-8d37f3b7c69d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.082332 Oct 29 01:19:55.486244 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 557/1099] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:55 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:55.605994 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-705bd97c-d024-4457-b19c-ac25c4b45f58 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:55.613584 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-705bd97c-d024-4457-b19c-ac25c4b45f58 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.152500 Oct 29 01:19:55.614149 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 543/1100] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:55 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:56.305200 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-3a56aa2c-7742-43b8-aa27-817893f3ae2d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:56.306112 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-3a56aa2c-7742-43b8-aa27-817893f3ae2d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:56.312285 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3a56aa2c-7742-43b8-aa27-817893f3ae2d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:56.312721 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3a56aa2c-7742-43b8-aa27-817893f3ae2d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:56.313616 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3a56aa2c-7742-43b8-aa27-817893f3ae2d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:56.314088 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3a56aa2c-7742-43b8-aa27-817893f3ae2d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:56.344334 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-3a56aa2c-7742-43b8-aa27-817893f3ae2d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042863 Oct 29 01:19:56.344896 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 558/1101] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:56 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:19:56.502421 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d5914cf0-6663-480e-96ff-5b014c51a85e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:56.503055 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d5914cf0-6663-480e-96ff-5b014c51a85e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:56.509632 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d5914cf0-6663-480e-96ff-5b014c51a85e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:56.510081 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d5914cf0-6663-480e-96ff-5b014c51a85e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:56.510925 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d5914cf0-6663-480e-96ff-5b014c51a85e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:56.511388 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d5914cf0-6663-480e-96ff-5b014c51a85e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:56.572950 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-d5914cf0-6663-480e-96ff-5b014c51a85e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:56.581244 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d5914cf0-6663-480e-96ff-5b014c51a85e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.082444 Oct 29 01:19:56.581854 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 544/1102] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:56 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:56.631674 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-fc397222-3f72-4266-a98a-c8dbc754fc9d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:56.632607 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-fc397222-3f72-4266-a98a-c8dbc754fc9d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:56.639171 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fc397222-3f72-4266-a98a-c8dbc754fc9d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:56.639614 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fc397222-3f72-4266-a98a-c8dbc754fc9d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:56.640392 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fc397222-3f72-4266-a98a-c8dbc754fc9d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:56.640823 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fc397222-3f72-4266-a98a-c8dbc754fc9d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:56.770037 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-fc397222-3f72-4266-a98a-c8dbc754fc9d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:56.778113 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-fc397222-3f72-4266-a98a-c8dbc754fc9d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.150517 Oct 29 01:19:56.778724 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 559/1103] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:56 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:57.357238 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-da3b963b-1c74-4c15-8b31-c1acfe14618e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:57.358232 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-da3b963b-1c74-4c15-8b31-c1acfe14618e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:57.364255 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-da3b963b-1c74-4c15-8b31-c1acfe14618e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:57.364735 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-da3b963b-1c74-4c15-8b31-c1acfe14618e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:57.365517 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-da3b963b-1c74-4c15-8b31-c1acfe14618e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:57.365953 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-da3b963b-1c74-4c15-8b31-c1acfe14618e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:57.397882 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-da3b963b-1c74-4c15-8b31-c1acfe14618e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045551 Oct 29 01:19:57.398475 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 545/1104] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:57 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:19:57.601138 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-ba661a2e-eacf-41f2-aaf8-424b1cb4fd7f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:57.602098 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-ba661a2e-eacf-41f2-aaf8-424b1cb4fd7f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:57.611938 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ba661a2e-eacf-41f2-aaf8-424b1cb4fd7f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:57.612599 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ba661a2e-eacf-41f2-aaf8-424b1cb4fd7f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:57.613611 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ba661a2e-eacf-41f2-aaf8-424b1cb4fd7f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:57.614246 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ba661a2e-eacf-41f2-aaf8-424b1cb4fd7f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:57.707652 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-ba661a2e-eacf-41f2-aaf8-424b1cb4fd7f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:57.716059 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-ba661a2e-eacf-41f2-aaf8-424b1cb4fd7f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.120476 Oct 29 01:19:57.716701 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 560/1105] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:57 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:57.800314 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-3d36b6fd-c099-46e4-b67b-e0aebf31fe30 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:57.801524 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-3d36b6fd-c099-46e4-b67b-e0aebf31fe30 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:57.812195 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3d36b6fd-c099-46e4-b67b-e0aebf31fe30 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:57.812841 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3d36b6fd-c099-46e4-b67b-e0aebf31fe30 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:57.813936 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3d36b6fd-c099-46e4-b67b-e0aebf31fe30 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:57.814609 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3d36b6fd-c099-46e4-b67b-e0aebf31fe30 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:57.955541 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-3d36b6fd-c099-46e4-b67b-e0aebf31fe30 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:57.967933 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-3d36b6fd-c099-46e4-b67b-e0aebf31fe30 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.175159 Oct 29 01:19:57.968501 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 546/1106] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:57 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:58.409807 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-09f6860a-5378-4588-bd3f-5c3adeb273db tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:58.410767 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-09f6860a-5378-4588-bd3f-5c3adeb273db tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:58.416740 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-09f6860a-5378-4588-bd3f-5c3adeb273db tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:58.417191 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-09f6860a-5378-4588-bd3f-5c3adeb273db tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:58.417968 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-09f6860a-5378-4588-bd3f-5c3adeb273db tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:58.418414 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-09f6860a-5378-4588-bd3f-5c3adeb273db tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:58.450744 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-09f6860a-5378-4588-bd3f-5c3adeb273db tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044653 Oct 29 01:19:58.451859 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 561/1107] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:58 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:19:58.733390 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a13c6124-e399-40e7-9157-7fddcc02eda6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:58.733906 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a13c6124-e399-40e7-9157-7fddcc02eda6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:58.740549 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a13c6124-e399-40e7-9157-7fddcc02eda6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:58.740986 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a13c6124-e399-40e7-9157-7fddcc02eda6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:58.741756 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a13c6124-e399-40e7-9157-7fddcc02eda6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:58.742365 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a13c6124-e399-40e7-9157-7fddcc02eda6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:58.818865 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-a13c6124-e399-40e7-9157-7fddcc02eda6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:58.831216 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a13c6124-e399-40e7-9157-7fddcc02eda6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.101273 Oct 29 01:19:58.831858 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 547/1108] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:58 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:58.989507 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-76124ace-efb9-459f-9d85-401486a3cbcb tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:58.990285 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-76124ace-efb9-459f-9d85-401486a3cbcb tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:58.997404 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-76124ace-efb9-459f-9d85-401486a3cbcb tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:58.997863 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-76124ace-efb9-459f-9d85-401486a3cbcb tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:58.998747 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-76124ace-efb9-459f-9d85-401486a3cbcb tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:58.999211 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-76124ace-efb9-459f-9d85-401486a3cbcb tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:59.126912 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-76124ace-efb9-459f-9d85-401486a3cbcb tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:59.134801 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-76124ace-efb9-459f-9d85-401486a3cbcb tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.149318 Oct 29 01:19:59.135387 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 562/1109] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:58 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:59.464870 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d7ac7c2b-ea71-4efe-9f95-e16cfd3ef295 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:59.465794 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d7ac7c2b-ea71-4efe-9f95-e16cfd3ef295 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:59.472534 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d7ac7c2b-ea71-4efe-9f95-e16cfd3ef295 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:59.472984 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d7ac7c2b-ea71-4efe-9f95-e16cfd3ef295 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:59.473770 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d7ac7c2b-ea71-4efe-9f95-e16cfd3ef295 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:59.474212 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d7ac7c2b-ea71-4efe-9f95-e16cfd3ef295 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:59.506725 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d7ac7c2b-ea71-4efe-9f95-e16cfd3ef295 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045825 Oct 29 01:19:59.507310 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 548/1110] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:19:59 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:19:59.848934 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-183a86ae-a4dc-46df-83fb-2a7bd91b1b25 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:59.849542 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-183a86ae-a4dc-46df-83fb-2a7bd91b1b25 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:19:59.855562 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-183a86ae-a4dc-46df-83fb-2a7bd91b1b25 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:59.856020 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-183a86ae-a4dc-46df-83fb-2a7bd91b1b25 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:59.856793 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-183a86ae-a4dc-46df-83fb-2a7bd91b1b25 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:19:59.857296 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-183a86ae-a4dc-46df-83fb-2a7bd91b1b25 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:19:59.927698 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-183a86ae-a4dc-46df-83fb-2a7bd91b1b25 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:59.936768 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-183a86ae-a4dc-46df-83fb-2a7bd91b1b25 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.091497 Oct 29 01:19:59.937393 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 563/1111] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:19:59 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:00.154215 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b515330b-b295-4394-9f69-460c01645f7c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:00.155106 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b515330b-b295-4394-9f69-460c01645f7c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:00.162697 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b515330b-b295-4394-9f69-460c01645f7c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:00.163143 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b515330b-b295-4394-9f69-460c01645f7c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:00.163920 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b515330b-b295-4394-9f69-460c01645f7c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:00.164348 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b515330b-b295-4394-9f69-460c01645f7c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:00.305703 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-b515330b-b295-4394-9f69-460c01645f7c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:00.316107 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b515330b-b295-4394-9f69-460c01645f7c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.167221 Oct 29 01:20:00.317178 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 549/1112] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:00 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:00.520254 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-3c2b006b-fa75-4283-91e1-712602d411db tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:00.521145 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-3c2b006b-fa75-4283-91e1-712602d411db tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:00.527716 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3c2b006b-fa75-4283-91e1-712602d411db tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:00.528177 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3c2b006b-fa75-4283-91e1-712602d411db tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:00.535371 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3c2b006b-fa75-4283-91e1-712602d411db tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:00.536005 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3c2b006b-fa75-4283-91e1-712602d411db tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:00.581170 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-3c2b006b-fa75-4283-91e1-712602d411db tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066939 Oct 29 01:20:00.582124 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 564/1113] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:00 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:00.954713 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-47d19229-b6c5-4987-94e1-585f71962b83 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:00.955426 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-47d19229-b6c5-4987-94e1-585f71962b83 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:00.964674 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-47d19229-b6c5-4987-94e1-585f71962b83 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:00.965243 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-47d19229-b6c5-4987-94e1-585f71962b83 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:00.966067 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-47d19229-b6c5-4987-94e1-585f71962b83 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:00.967172 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-47d19229-b6c5-4987-94e1-585f71962b83 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:01.029770 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-47d19229-b6c5-4987-94e1-585f71962b83 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:01.037255 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-47d19229-b6c5-4987-94e1-585f71962b83 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.086962 Oct 29 01:20:01.037808 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 550/1114] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:00 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:20:01.339699 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-a1481cf5-ada8-4bd5-9c7f-226caecd67e3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:01.340296 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-a1481cf5-ada8-4bd5-9c7f-226caecd67e3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:01.347485 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a1481cf5-ada8-4bd5-9c7f-226caecd67e3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:01.348068 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a1481cf5-ada8-4bd5-9c7f-226caecd67e3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:01.348846 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a1481cf5-ada8-4bd5-9c7f-226caecd67e3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:01.349275 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a1481cf5-ada8-4bd5-9c7f-226caecd67e3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:01.479360 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-a1481cf5-ada8-4bd5-9c7f-226caecd67e3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:01.486946 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-a1481cf5-ada8-4bd5-9c7f-226caecd67e3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.151402 Oct 29 01:20:01.487521 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 565/1115] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:01 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:01.595093 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-aeb35ecd-c925-45a9-bab3-6c75768caf16 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:01.597581 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-aeb35ecd-c925-45a9-bab3-6c75768caf16 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:01.605614 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-aeb35ecd-c925-45a9-bab3-6c75768caf16 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:01.606059 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-aeb35ecd-c925-45a9-bab3-6c75768caf16 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:01.606875 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-aeb35ecd-c925-45a9-bab3-6c75768caf16 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:01.607635 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-aeb35ecd-c925-45a9-bab3-6c75768caf16 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:01.641499 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-aeb35ecd-c925-45a9-bab3-6c75768caf16 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051905 Oct 29 01:20:01.642089 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 551/1116] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:01 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:02.054214 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-602b702a-95cb-446f-851d-f5578b71fdea tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:02.054929 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-602b702a-95cb-446f-851d-f5578b71fdea tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:02.062987 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-602b702a-95cb-446f-851d-f5578b71fdea tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:02.063504 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-602b702a-95cb-446f-851d-f5578b71fdea tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:02.064454 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-602b702a-95cb-446f-851d-f5578b71fdea tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:02.064932 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-602b702a-95cb-446f-851d-f5578b71fdea tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:02.149328 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-602b702a-95cb-446f-851d-f5578b71fdea tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:02.157929 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-602b702a-95cb-446f-851d-f5578b71fdea tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.107444 Oct 29 01:20:02.158563 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 566/1117] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:02 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:02.507476 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ef1efbea-09db-40f9-996e-c5aff4f5215e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:02.508082 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ef1efbea-09db-40f9-996e-c5aff4f5215e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:02.515395 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ef1efbea-09db-40f9-996e-c5aff4f5215e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:02.515951 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ef1efbea-09db-40f9-996e-c5aff4f5215e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:02.516793 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ef1efbea-09db-40f9-996e-c5aff4f5215e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:02.517271 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ef1efbea-09db-40f9-996e-c5aff4f5215e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:02.656420 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-1550429b-7f6e-4a55-baea-c34fc8f4179a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:02.657633 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-1550429b-7f6e-4a55-baea-c34fc8f4179a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:02.664189 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1550429b-7f6e-4a55-baea-c34fc8f4179a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:02.664626 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1550429b-7f6e-4a55-baea-c34fc8f4179a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:02.665417 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1550429b-7f6e-4a55-baea-c34fc8f4179a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:02.665838 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1550429b-7f6e-4a55-baea-c34fc8f4179a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:02.672262 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-ef1efbea-09db-40f9-996e-c5aff4f5215e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:02.680546 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ef1efbea-09db-40f9-996e-c5aff4f5215e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.176645 Oct 29 01:20:02.681366 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 552/1118] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:02 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:02.707033 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-1550429b-7f6e-4a55-baea-c34fc8f4179a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055860 Oct 29 01:20:02.707613 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 567/1119] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:02 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:20:03.176454 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f8f6ef38-c913-48d0-9118-9441d507dd90 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:03.177060 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f8f6ef38-c913-48d0-9118-9441d507dd90 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:03.183056 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f8f6ef38-c913-48d0-9118-9441d507dd90 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:03.183506 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f8f6ef38-c913-48d0-9118-9441d507dd90 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:03.184280 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f8f6ef38-c913-48d0-9118-9441d507dd90 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:03.184720 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f8f6ef38-c913-48d0-9118-9441d507dd90 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:03.249939 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-f8f6ef38-c913-48d0-9118-9441d507dd90 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:03.257500 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f8f6ef38-c913-48d0-9118-9441d507dd90 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.084701 Oct 29 01:20:03.258072 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 553/1120] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:03 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:03.701356 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-4a3944e5-a891-428b-933c-e6f66308ac57 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:03.702271 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-4a3944e5-a891-428b-933c-e6f66308ac57 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:03.710776 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4a3944e5-a891-428b-933c-e6f66308ac57 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:03.711611 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4a3944e5-a891-428b-933c-e6f66308ac57 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:03.712391 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4a3944e5-a891-428b-933c-e6f66308ac57 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:03.712882 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4a3944e5-a891-428b-933c-e6f66308ac57 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:03.721674 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-bd263d35-2eeb-4668-b8cc-23252cc8d5d6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:03.723005 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-bd263d35-2eeb-4668-b8cc-23252cc8d5d6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:03.731698 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bd263d35-2eeb-4668-b8cc-23252cc8d5d6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:03.732460 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bd263d35-2eeb-4668-b8cc-23252cc8d5d6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:03.733519 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bd263d35-2eeb-4668-b8cc-23252cc8d5d6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:03.734263 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bd263d35-2eeb-4668-b8cc-23252cc8d5d6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:03.777303 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-bd263d35-2eeb-4668-b8cc-23252cc8d5d6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062206 Oct 29 01:20:03.779711 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 554/1121] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:03 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:20:03.856686 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-4a3944e5-a891-428b-933c-e6f66308ac57 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:03.864966 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-4a3944e5-a891-428b-933c-e6f66308ac57 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.168868 Oct 29 01:20:03.865555 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 568/1122] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:03 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:04.281837 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-25c9d3dd-c91e-48ed-a7c9-24a535219ee6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:04.282352 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-25c9d3dd-c91e-48ed-a7c9-24a535219ee6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:04.288540 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-25c9d3dd-c91e-48ed-a7c9-24a535219ee6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:04.289025 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-25c9d3dd-c91e-48ed-a7c9-24a535219ee6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:04.289808 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-25c9d3dd-c91e-48ed-a7c9-24a535219ee6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:04.290250 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-25c9d3dd-c91e-48ed-a7c9-24a535219ee6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:04.360897 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-25c9d3dd-c91e-48ed-a7c9-24a535219ee6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:04.368309 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-25c9d3dd-c91e-48ed-a7c9-24a535219ee6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.091280 Oct 29 01:20:04.368867 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 555/1123] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:04 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:04.789301 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-64e6f2e0-ec2c-4d17-af16-b0d97a764ffa tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:04.790235 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-64e6f2e0-ec2c-4d17-af16-b0d97a764ffa tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:04.796958 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-64e6f2e0-ec2c-4d17-af16-b0d97a764ffa tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:04.797403 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-64e6f2e0-ec2c-4d17-af16-b0d97a764ffa tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:04.798159 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-64e6f2e0-ec2c-4d17-af16-b0d97a764ffa tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:04.798616 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-64e6f2e0-ec2c-4d17-af16-b0d97a764ffa tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:04.829510 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-64e6f2e0-ec2c-4d17-af16-b0d97a764ffa tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044023 Oct 29 01:20:04.830064 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 569/1124] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:04 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:04.884277 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-245f69b1-41c8-4b25-a916-30532ce4aefa tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:04.885052 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-245f69b1-41c8-4b25-a916-30532ce4aefa tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:04.892407 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-245f69b1-41c8-4b25-a916-30532ce4aefa tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:04.892850 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-245f69b1-41c8-4b25-a916-30532ce4aefa tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:04.893630 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-245f69b1-41c8-4b25-a916-30532ce4aefa tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:04.894061 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-245f69b1-41c8-4b25-a916-30532ce4aefa tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:05.038803 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-245f69b1-41c8-4b25-a916-30532ce4aefa tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:05.047528 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-245f69b1-41c8-4b25-a916-30532ce4aefa tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.166754 Oct 29 01:20:05.048027 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 556/1125] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:04 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:05.387250 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-a4898964-de70-4dc4-ae5b-a81de6726b97 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:05.387972 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-a4898964-de70-4dc4-ae5b-a81de6726b97 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:05.395324 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a4898964-de70-4dc4-ae5b-a81de6726b97 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:05.395803 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a4898964-de70-4dc4-ae5b-a81de6726b97 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:05.396585 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a4898964-de70-4dc4-ae5b-a81de6726b97 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:05.397019 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a4898964-de70-4dc4-ae5b-a81de6726b97 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:05.614448 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-a4898964-de70-4dc4-ae5b-a81de6726b97 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:05.622054 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-a4898964-de70-4dc4-ae5b-a81de6726b97 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.238786 Oct 29 01:20:05.623173 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 570/1126] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:05 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:05.842018 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-e3a86ea9-87d6-49cd-ae5b-e9eb7cc76814 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:05.843021 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-e3a86ea9-87d6-49cd-ae5b-e9eb7cc76814 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:05.848851 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e3a86ea9-87d6-49cd-ae5b-e9eb7cc76814 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:05.849291 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e3a86ea9-87d6-49cd-ae5b-e9eb7cc76814 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:05.850049 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e3a86ea9-87d6-49cd-ae5b-e9eb7cc76814 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:05.850501 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e3a86ea9-87d6-49cd-ae5b-e9eb7cc76814 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:05.879141 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-e3a86ea9-87d6-49cd-ae5b-e9eb7cc76814 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041629 Oct 29 01:20:05.879696 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 557/1127] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:05 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:06.065232 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-8b1895af-e1b7-4434-9743-54722ce9feb0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:06.065823 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-8b1895af-e1b7-4434-9743-54722ce9feb0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:06.072089 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8b1895af-e1b7-4434-9743-54722ce9feb0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:06.072518 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8b1895af-e1b7-4434-9743-54722ce9feb0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:06.073590 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8b1895af-e1b7-4434-9743-54722ce9feb0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:06.074073 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8b1895af-e1b7-4434-9743-54722ce9feb0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:06.197341 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-8b1895af-e1b7-4434-9743-54722ce9feb0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:06.205750 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-8b1895af-e1b7-4434-9743-54722ce9feb0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.144326 Oct 29 01:20:06.206309 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 571/1128] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:06 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:06.639670 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-38a5de08-d273-499b-9531-8dfee3ab0f35 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:06.640344 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-38a5de08-d273-499b-9531-8dfee3ab0f35 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:06.646778 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-38a5de08-d273-499b-9531-8dfee3ab0f35 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:06.647221 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-38a5de08-d273-499b-9531-8dfee3ab0f35 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:06.648957 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-38a5de08-d273-499b-9531-8dfee3ab0f35 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:06.648957 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-38a5de08-d273-499b-9531-8dfee3ab0f35 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:06.713193 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-38a5de08-d273-499b-9531-8dfee3ab0f35 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:06.721660 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-38a5de08-d273-499b-9531-8dfee3ab0f35 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.086193 Oct 29 01:20:06.722478 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 558/1129] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:06 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:06.892177 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-ecb5f7f6-376b-4a6e-9253-bd316f1ab557 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:06.893012 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-ecb5f7f6-376b-4a6e-9253-bd316f1ab557 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:06.899347 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ecb5f7f6-376b-4a6e-9253-bd316f1ab557 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:06.899804 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ecb5f7f6-376b-4a6e-9253-bd316f1ab557 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:06.900582 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ecb5f7f6-376b-4a6e-9253-bd316f1ab557 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:06.901018 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ecb5f7f6-376b-4a6e-9253-bd316f1ab557 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:06.932245 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-ecb5f7f6-376b-4a6e-9253-bd316f1ab557 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044436 Oct 29 01:20:06.933684 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 572/1130] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:06 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:07.222786 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-3c19f7d9-b68c-4f2d-ab64-cb9204f5f39c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:07.223301 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-3c19f7d9-b68c-4f2d-ab64-cb9204f5f39c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:07.229259 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3c19f7d9-b68c-4f2d-ab64-cb9204f5f39c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:07.229703 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3c19f7d9-b68c-4f2d-ab64-cb9204f5f39c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:07.230518 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3c19f7d9-b68c-4f2d-ab64-cb9204f5f39c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:07.230947 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3c19f7d9-b68c-4f2d-ab64-cb9204f5f39c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:07.350497 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-3c19f7d9-b68c-4f2d-ab64-cb9204f5f39c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:07.358283 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-3c19f7d9-b68c-4f2d-ab64-cb9204f5f39c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.139188 Oct 29 01:20:07.358891 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 559/1131] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:07 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:07.738280 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e5f3edac-ab90-47f7-b040-27d0e50897d3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:07.738864 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-e5f3edac-ab90-47f7-b040-27d0e50897d3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:07.744871 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e5f3edac-ab90-47f7-b040-27d0e50897d3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:07.745347 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e5f3edac-ab90-47f7-b040-27d0e50897d3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:07.746129 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e5f3edac-ab90-47f7-b040-27d0e50897d3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:07.746601 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e5f3edac-ab90-47f7-b040-27d0e50897d3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:07.805680 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-e5f3edac-ab90-47f7-b040-27d0e50897d3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:07.814203 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-e5f3edac-ab90-47f7-b040-27d0e50897d3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.079660 Oct 29 01:20:07.814789 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 573/1132] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:07 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:07.944321 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-1b399b73-b0ea-417d-a6b1-03e8d2f6aea4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:07.945264 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-1b399b73-b0ea-417d-a6b1-03e8d2f6aea4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:07.952062 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1b399b73-b0ea-417d-a6b1-03e8d2f6aea4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:07.952564 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1b399b73-b0ea-417d-a6b1-03e8d2f6aea4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:07.953336 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1b399b73-b0ea-417d-a6b1-03e8d2f6aea4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:07.953764 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1b399b73-b0ea-417d-a6b1-03e8d2f6aea4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:07.985260 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-1b399b73-b0ea-417d-a6b1-03e8d2f6aea4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044666 Oct 29 01:20:07.985825 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 560/1133] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:07 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:08.375653 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d2f4bac3-35a4-49aa-81ab-8314ca3d573b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:08.376260 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d2f4bac3-35a4-49aa-81ab-8314ca3d573b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:08.382744 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d2f4bac3-35a4-49aa-81ab-8314ca3d573b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:08.383213 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d2f4bac3-35a4-49aa-81ab-8314ca3d573b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:08.383979 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d2f4bac3-35a4-49aa-81ab-8314ca3d573b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:08.384413 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d2f4bac3-35a4-49aa-81ab-8314ca3d573b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:08.507892 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-d2f4bac3-35a4-49aa-81ab-8314ca3d573b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:08.515955 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d2f4bac3-35a4-49aa-81ab-8314ca3d573b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.144489 Oct 29 01:20:08.516510 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 574/1134] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:08 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:08.831551 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-047ef80e-b00e-46f7-9014-3de19eac87ce tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:08.832072 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-047ef80e-b00e-46f7-9014-3de19eac87ce tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:08.838108 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-047ef80e-b00e-46f7-9014-3de19eac87ce tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:08.838591 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-047ef80e-b00e-46f7-9014-3de19eac87ce tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:08.839353 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-047ef80e-b00e-46f7-9014-3de19eac87ce tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:08.839784 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-047ef80e-b00e-46f7-9014-3de19eac87ce tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:08.899082 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-047ef80e-b00e-46f7-9014-3de19eac87ce tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:08.907230 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-047ef80e-b00e-46f7-9014-3de19eac87ce tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.079419 Oct 29 01:20:08.907799 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 561/1135] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:08 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:08.996628 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e4a0c812-aa63-4c54-a7cb-27fffee4aca4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:08.997544 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-e4a0c812-aa63-4c54-a7cb-27fffee4aca4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:09.003464 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e4a0c812-aa63-4c54-a7cb-27fffee4aca4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:09.003917 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e4a0c812-aa63-4c54-a7cb-27fffee4aca4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:09.004687 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e4a0c812-aa63-4c54-a7cb-27fffee4aca4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:09.005134 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e4a0c812-aa63-4c54-a7cb-27fffee4aca4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:09.034776 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-e4a0c812-aa63-4c54-a7cb-27fffee4aca4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041837 Oct 29 01:20:09.035327 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 575/1136] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:08 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:09.533029 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-e6c8ecbb-fd86-4c91-abb9-3334ebd89a17 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:09.533632 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-e6c8ecbb-fd86-4c91-abb9-3334ebd89a17 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:09.539897 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e6c8ecbb-fd86-4c91-abb9-3334ebd89a17 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:09.540343 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e6c8ecbb-fd86-4c91-abb9-3334ebd89a17 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:09.541107 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e6c8ecbb-fd86-4c91-abb9-3334ebd89a17 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:09.541626 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e6c8ecbb-fd86-4c91-abb9-3334ebd89a17 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:09.661534 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-e6c8ecbb-fd86-4c91-abb9-3334ebd89a17 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:09.669142 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-e6c8ecbb-fd86-4c91-abb9-3334ebd89a17 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.140052 Oct 29 01:20:09.670208 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 562/1137] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:09 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:09.923750 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c093cd14-7bbc-4fe0-9c99-723c85727198 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:09.924260 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c093cd14-7bbc-4fe0-9c99-723c85727198 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:09.930707 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c093cd14-7bbc-4fe0-9c99-723c85727198 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:09.931152 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c093cd14-7bbc-4fe0-9c99-723c85727198 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:09.931913 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c093cd14-7bbc-4fe0-9c99-723c85727198 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:09.932339 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c093cd14-7bbc-4fe0-9c99-723c85727198 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:09.991812 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-c093cd14-7bbc-4fe0-9c99-723c85727198 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:09.999746 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c093cd14-7bbc-4fe0-9c99-723c85727198 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.079643 Oct 29 01:20:10.000344 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 576/1138] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:09 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:10.046244 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-51961032-3560-4860-a8d3-612768c64f52 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:10.047174 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-51961032-3560-4860-a8d3-612768c64f52 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:10.053109 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-51961032-3560-4860-a8d3-612768c64f52 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:10.053558 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-51961032-3560-4860-a8d3-612768c64f52 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:10.054313 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-51961032-3560-4860-a8d3-612768c64f52 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:10.054777 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-51961032-3560-4860-a8d3-612768c64f52 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:10.084519 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-51961032-3560-4860-a8d3-612768c64f52 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041982 Oct 29 01:20:10.085077 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 563/1139] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:10 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:10.688009 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-fc4285f2-0e82-4e49-a3d6-916f85a89a2a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:10.688613 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-fc4285f2-0e82-4e49-a3d6-916f85a89a2a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:10.694484 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fc4285f2-0e82-4e49-a3d6-916f85a89a2a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:10.694927 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fc4285f2-0e82-4e49-a3d6-916f85a89a2a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:10.695680 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fc4285f2-0e82-4e49-a3d6-916f85a89a2a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:10.696107 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fc4285f2-0e82-4e49-a3d6-916f85a89a2a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:10.819581 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-fc4285f2-0e82-4e49-a3d6-916f85a89a2a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:10.827124 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-fc4285f2-0e82-4e49-a3d6-916f85a89a2a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.142801 Oct 29 01:20:10.827671 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 577/1140] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:10 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:11.020247 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c5362f05-a4c9-4c5e-8916-610c3a6b345e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:11.020944 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c5362f05-a4c9-4c5e-8916-610c3a6b345e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:11.028101 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c5362f05-a4c9-4c5e-8916-610c3a6b345e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:11.028607 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c5362f05-a4c9-4c5e-8916-610c3a6b345e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:11.030180 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c5362f05-a4c9-4c5e-8916-610c3a6b345e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:11.030903 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c5362f05-a4c9-4c5e-8916-610c3a6b345e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:11.096614 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f784270d-6d1c-478b-8659-0494fac32d78 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:11.097890 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f784270d-6d1c-478b-8659-0494fac32d78 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:11.100201 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c5362f05-a4c9-4c5e-8916-610c3a6b345e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:11.103807 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f784270d-6d1c-478b-8659-0494fac32d78 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:11.104249 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f784270d-6d1c-478b-8659-0494fac32d78 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:11.105014 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f784270d-6d1c-478b-8659-0494fac32d78 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:11.105438 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f784270d-6d1c-478b-8659-0494fac32d78 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:11.107838 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c5362f05-a4c9-4c5e-8916-610c3a6b345e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.092880 Oct 29 01:20:11.108738 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 564/1141] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:11 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:11.136699 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f784270d-6d1c-478b-8659-0494fac32d78 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043747 Oct 29 01:20:11.137256 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 578/1142] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:11 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:11.845553 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-8301f9f6-febd-4561-b3ba-f430c1a2b187 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:11.846414 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-8301f9f6-febd-4561-b3ba-f430c1a2b187 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:11.852066 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8301f9f6-febd-4561-b3ba-f430c1a2b187 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:11.852531 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8301f9f6-febd-4561-b3ba-f430c1a2b187 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:11.853292 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8301f9f6-febd-4561-b3ba-f430c1a2b187 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:11.853724 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8301f9f6-febd-4561-b3ba-f430c1a2b187 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:11.977985 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-8301f9f6-febd-4561-b3ba-f430c1a2b187 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:11.985363 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-8301f9f6-febd-4561-b3ba-f430c1a2b187 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.144754 Oct 29 01:20:11.985930 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 565/1143] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:11 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:12.125701 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-83e3e3ae-9df2-411c-a094-c010f5b60230 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:12.126337 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-83e3e3ae-9df2-411c-a094-c010f5b60230 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:12.132983 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-83e3e3ae-9df2-411c-a094-c010f5b60230 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:12.133426 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-83e3e3ae-9df2-411c-a094-c010f5b60230 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:12.134203 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-83e3e3ae-9df2-411c-a094-c010f5b60230 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:12.134662 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-83e3e3ae-9df2-411c-a094-c010f5b60230 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:12.148657 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ca451224-bdf9-4654-8302-36974d987052 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:12.149592 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ca451224-bdf9-4654-8302-36974d987052 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:12.156210 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ca451224-bdf9-4654-8302-36974d987052 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:12.156657 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ca451224-bdf9-4654-8302-36974d987052 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:12.157439 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ca451224-bdf9-4654-8302-36974d987052 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:12.157878 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ca451224-bdf9-4654-8302-36974d987052 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:12.189217 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ca451224-bdf9-4654-8302-36974d987052 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044251 Oct 29 01:20:12.189852 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 566/1144] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:12 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:20:12.203273 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-83e3e3ae-9df2-411c-a094-c010f5b60230 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:12.210981 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-83e3e3ae-9df2-411c-a094-c010f5b60230 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.089629 Oct 29 01:20:12.211809 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 579/1145] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:12 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:13.002503 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-26935279-025a-422c-8a51-f71e8113d085 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:13.003106 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-26935279-025a-422c-8a51-f71e8113d085 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:13.008959 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-26935279-025a-422c-8a51-f71e8113d085 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:13.009403 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-26935279-025a-422c-8a51-f71e8113d085 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:13.010212 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-26935279-025a-422c-8a51-f71e8113d085 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:13.010823 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-26935279-025a-422c-8a51-f71e8113d085 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:13.136403 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-26935279-025a-422c-8a51-f71e8113d085 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:13.144113 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-26935279-025a-422c-8a51-f71e8113d085 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.145158 Oct 29 01:20:13.144702 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 567/1146] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:12 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:13.203804 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-ece350da-09a3-4814-b3c8-1569e1f12af5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:13.205476 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-ece350da-09a3-4814-b3c8-1569e1f12af5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:13.212607 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ece350da-09a3-4814-b3c8-1569e1f12af5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:13.212974 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ece350da-09a3-4814-b3c8-1569e1f12af5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:13.213751 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ece350da-09a3-4814-b3c8-1569e1f12af5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:13.214175 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ece350da-09a3-4814-b3c8-1569e1f12af5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:13.228974 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-fa5f71bb-ffa9-4073-8299-4c9556d3dfe2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:13.229789 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-fa5f71bb-ffa9-4073-8299-4c9556d3dfe2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:13.240919 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fa5f71bb-ffa9-4073-8299-4c9556d3dfe2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:13.241363 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fa5f71bb-ffa9-4073-8299-4c9556d3dfe2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:13.242137 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fa5f71bb-ffa9-4073-8299-4c9556d3dfe2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:13.242607 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fa5f71bb-ffa9-4073-8299-4c9556d3dfe2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:13.245092 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-ece350da-09a3-4814-b3c8-1569e1f12af5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047237 Oct 29 01:20:13.245647 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 580/1147] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:13 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:13.309726 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-fa5f71bb-ffa9-4073-8299-4c9556d3dfe2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:13.317319 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-fa5f71bb-ffa9-4073-8299-4c9556d3dfe2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.092980 Oct 29 01:20:13.317897 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 568/1148] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:13 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:14.160461 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-9253b8a9-c92f-4360-a79b-e20cb822ad02 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:14.161081 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-9253b8a9-c92f-4360-a79b-e20cb822ad02 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:14.166975 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9253b8a9-c92f-4360-a79b-e20cb822ad02 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:14.167357 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9253b8a9-c92f-4360-a79b-e20cb822ad02 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:14.168133 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9253b8a9-c92f-4360-a79b-e20cb822ad02 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:14.168570 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9253b8a9-c92f-4360-a79b-e20cb822ad02 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:14.256692 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-75e3f434-b3d8-408e-b4d1-96305c937870 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:14.257616 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-75e3f434-b3d8-408e-b4d1-96305c937870 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:14.263888 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-75e3f434-b3d8-408e-b4d1-96305c937870 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:14.264329 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-75e3f434-b3d8-408e-b4d1-96305c937870 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:14.265099 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-75e3f434-b3d8-408e-b4d1-96305c937870 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:14.265527 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-75e3f434-b3d8-408e-b4d1-96305c937870 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:14.289564 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-9253b8a9-c92f-4360-a79b-e20cb822ad02 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:14.295592 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-75e3f434-b3d8-408e-b4d1-96305c937870 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042552 Oct 29 01:20:14.296160 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 569/1149] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:14 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:20:14.297572 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-9253b8a9-c92f-4360-a79b-e20cb822ad02 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.140776 Oct 29 01:20:14.298125 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 581/1150] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:14 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:14.334921 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c34404e4-d546-436d-a118-7cca5f64f547 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:14.335520 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c34404e4-d546-436d-a118-7cca5f64f547 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:14.342115 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c34404e4-d546-436d-a118-7cca5f64f547 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:14.342590 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c34404e4-d546-436d-a118-7cca5f64f547 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:14.343339 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c34404e4-d546-436d-a118-7cca5f64f547 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:14.343765 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c34404e4-d546-436d-a118-7cca5f64f547 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:14.407312 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c34404e4-d546-436d-a118-7cca5f64f547 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:14.414980 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c34404e4-d546-436d-a118-7cca5f64f547 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.083630 Oct 29 01:20:14.415479 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 570/1151] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:14 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:15.307220 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-002226f1-3463-463a-b1f6-39941d7cb0c4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:15.308050 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-002226f1-3463-463a-b1f6-39941d7cb0c4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:15.314034 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-2d5f2a2f-232d-4735-af50-e753f78ac8aa tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:15.314807 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-2d5f2a2f-232d-4735-af50-e753f78ac8aa tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:15.314914 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-002226f1-3463-463a-b1f6-39941d7cb0c4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:15.315372 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-002226f1-3463-463a-b1f6-39941d7cb0c4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:15.316148 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-002226f1-3463-463a-b1f6-39941d7cb0c4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:15.316584 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-002226f1-3463-463a-b1f6-39941d7cb0c4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:15.321001 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2d5f2a2f-232d-4735-af50-e753f78ac8aa tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:15.321438 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2d5f2a2f-232d-4735-af50-e753f78ac8aa tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:15.322192 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2d5f2a2f-232d-4735-af50-e753f78ac8aa tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:15.322703 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2d5f2a2f-232d-4735-af50-e753f78ac8aa tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:15.347235 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-002226f1-3463-463a-b1f6-39941d7cb0c4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043942 Oct 29 01:20:15.347806 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 582/1152] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:15 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:15.431350 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-bb37f01e-be40-40b8-bbb1-5c4c52030f18 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:15.432127 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-bb37f01e-be40-40b8-bbb1-5c4c52030f18 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:15.438812 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bb37f01e-be40-40b8-bbb1-5c4c52030f18 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:15.439265 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bb37f01e-be40-40b8-bbb1-5c4c52030f18 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:15.440103 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bb37f01e-be40-40b8-bbb1-5c4c52030f18 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:15.440547 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bb37f01e-be40-40b8-bbb1-5c4c52030f18 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:15.446072 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-2d5f2a2f-232d-4735-af50-e753f78ac8aa tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:15.453421 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-2d5f2a2f-232d-4735-af50-e753f78ac8aa tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.143410 Oct 29 01:20:15.453994 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 571/1153] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:15 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:15.501750 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-bb37f01e-be40-40b8-bbb1-5c4c52030f18 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:15.509142 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-bb37f01e-be40-40b8-bbb1-5c4c52030f18 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.081475 Oct 29 01:20:15.509698 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 583/1154] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:15 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:20:16.358488 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9d194c5d-35fb-47e6-9f62-c7c94c23b620 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:16.359409 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9d194c5d-35fb-47e6-9f62-c7c94c23b620 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:16.365602 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9d194c5d-35fb-47e6-9f62-c7c94c23b620 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:16.366041 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9d194c5d-35fb-47e6-9f62-c7c94c23b620 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:16.366819 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9d194c5d-35fb-47e6-9f62-c7c94c23b620 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:16.367249 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9d194c5d-35fb-47e6-9f62-c7c94c23b620 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:16.395816 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9d194c5d-35fb-47e6-9f62-c7c94c23b620 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041085 Oct 29 01:20:16.396363 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 572/1155] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:16 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:16.472402 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f7f4ec14-8331-4789-b90d-2560d4024e67 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:16.472995 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f7f4ec14-8331-4789-b90d-2560d4024e67 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:16.478788 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f7f4ec14-8331-4789-b90d-2560d4024e67 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:16.479338 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f7f4ec14-8331-4789-b90d-2560d4024e67 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:16.480099 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f7f4ec14-8331-4789-b90d-2560d4024e67 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:16.480533 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f7f4ec14-8331-4789-b90d-2560d4024e67 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:16.525296 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-7e8e8cb3-a342-47cb-b577-d2a25f93f5c5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:16.526167 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-7e8e8cb3-a342-47cb-b577-d2a25f93f5c5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:16.532717 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7e8e8cb3-a342-47cb-b577-d2a25f93f5c5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:16.533251 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7e8e8cb3-a342-47cb-b577-d2a25f93f5c5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:16.534078 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7e8e8cb3-a342-47cb-b577-d2a25f93f5c5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:16.534611 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7e8e8cb3-a342-47cb-b577-d2a25f93f5c5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:16.601339 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-7e8e8cb3-a342-47cb-b577-d2a25f93f5c5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:16.609091 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-7e8e8cb3-a342-47cb-b577-d2a25f93f5c5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.087348 Oct 29 01:20:16.609684 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 573/1156] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:16 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:20:16.629532 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-f7f4ec14-8331-4789-b90d-2560d4024e67 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:16.636825 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f7f4ec14-8331-4789-b90d-2560d4024e67 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.169081 Oct 29 01:20:16.637379 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 584/1157] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:16 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:17.407179 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-e9e5d549-f832-4840-bd26-a1029646be21 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:17.408068 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-e9e5d549-f832-4840-bd26-a1029646be21 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:17.414281 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e9e5d549-f832-4840-bd26-a1029646be21 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:17.414753 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e9e5d549-f832-4840-bd26-a1029646be21 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:17.415511 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e9e5d549-f832-4840-bd26-a1029646be21 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:17.415939 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e9e5d549-f832-4840-bd26-a1029646be21 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:17.447361 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-e9e5d549-f832-4840-bd26-a1029646be21 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043859 Oct 29 01:20:17.447926 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 574/1158] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:17 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:17.625221 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-b7503468-8358-411e-9621-227253701b6f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:17.625812 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-b7503468-8358-411e-9621-227253701b6f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:17.631988 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b7503468-8358-411e-9621-227253701b6f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:17.632434 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b7503468-8358-411e-9621-227253701b6f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:17.633192 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b7503468-8358-411e-9621-227253701b6f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:17.633621 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b7503468-8358-411e-9621-227253701b6f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:17.654645 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d2e8257b-8279-49b9-8ba9-65bbcc96b9aa tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:17.655286 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d2e8257b-8279-49b9-8ba9-65bbcc96b9aa tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:17.661047 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d2e8257b-8279-49b9-8ba9-65bbcc96b9aa tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:17.661429 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d2e8257b-8279-49b9-8ba9-65bbcc96b9aa tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:17.662198 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d2e8257b-8279-49b9-8ba9-65bbcc96b9aa tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:17.662668 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d2e8257b-8279-49b9-8ba9-65bbcc96b9aa tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:17.693839 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-b7503468-8358-411e-9621-227253701b6f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:17.701288 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-b7503468-8358-411e-9621-227253701b6f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.080191 Oct 29 01:20:17.701856 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 585/1159] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:17 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:17.782065 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-d2e8257b-8279-49b9-8ba9-65bbcc96b9aa tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:17.789377 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d2e8257b-8279-49b9-8ba9-65bbcc96b9aa tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.138843 Oct 29 01:20:17.789932 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 575/1160] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:17 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:20:18.460127 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-3c096bc2-0c97-44ae-9d39-4c9814bac7ee tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:18.460825 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-3c096bc2-0c97-44ae-9d39-4c9814bac7ee tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:18.468180 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3c096bc2-0c97-44ae-9d39-4c9814bac7ee tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:18.468643 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3c096bc2-0c97-44ae-9d39-4c9814bac7ee tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:18.469440 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3c096bc2-0c97-44ae-9d39-4c9814bac7ee tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:18.469880 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3c096bc2-0c97-44ae-9d39-4c9814bac7ee tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:18.504965 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-3c096bc2-0c97-44ae-9d39-4c9814bac7ee tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049131 Oct 29 01:20:18.505542 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 586/1161] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:18 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:18.717955 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-79d0e30b-b72b-410d-8a19-836fa920e449 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:18.718535 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-79d0e30b-b72b-410d-8a19-836fa920e449 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:18.724748 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-79d0e30b-b72b-410d-8a19-836fa920e449 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:18.725191 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-79d0e30b-b72b-410d-8a19-836fa920e449 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:18.725949 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-79d0e30b-b72b-410d-8a19-836fa920e449 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:18.726376 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-79d0e30b-b72b-410d-8a19-836fa920e449 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:18.790578 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-79d0e30b-b72b-410d-8a19-836fa920e449 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:18.798284 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-79d0e30b-b72b-410d-8a19-836fa920e449 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.084747 Oct 29 01:20:18.798950 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 576/1162] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:18 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:18.808475 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-478c1cb7-96a1-4f14-a26c-fc3f4e8fc0b9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:18.809225 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-478c1cb7-96a1-4f14-a26c-fc3f4e8fc0b9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:18.816896 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-478c1cb7-96a1-4f14-a26c-fc3f4e8fc0b9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:18.817366 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-478c1cb7-96a1-4f14-a26c-fc3f4e8fc0b9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:18.818121 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-478c1cb7-96a1-4f14-a26c-fc3f4e8fc0b9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:18.818579 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-478c1cb7-96a1-4f14-a26c-fc3f4e8fc0b9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:18.941290 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-478c1cb7-96a1-4f14-a26c-fc3f4e8fc0b9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:18.949652 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-478c1cb7-96a1-4f14-a26c-fc3f4e8fc0b9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.144743 Oct 29 01:20:18.950215 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 587/1163] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:18 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:19.517780 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9b1687bf-ae66-4d0e-9d0a-d8c7ebd98a89 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:19.518755 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9b1687bf-ae66-4d0e-9d0a-d8c7ebd98a89 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:19.524683 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9b1687bf-ae66-4d0e-9d0a-d8c7ebd98a89 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:19.525131 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9b1687bf-ae66-4d0e-9d0a-d8c7ebd98a89 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:19.527243 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9b1687bf-ae66-4d0e-9d0a-d8c7ebd98a89 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:19.527243 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9b1687bf-ae66-4d0e-9d0a-d8c7ebd98a89 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:19.558257 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9b1687bf-ae66-4d0e-9d0a-d8c7ebd98a89 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044790 Oct 29 01:20:19.558865 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 577/1164] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:19 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:19.816679 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c11276c5-ff85-45a1-83dd-3c3fcd63f323 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:19.817735 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c11276c5-ff85-45a1-83dd-3c3fcd63f323 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:19.825350 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c11276c5-ff85-45a1-83dd-3c3fcd63f323 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:19.826865 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c11276c5-ff85-45a1-83dd-3c3fcd63f323 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:19.828335 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c11276c5-ff85-45a1-83dd-3c3fcd63f323 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:19.829145 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c11276c5-ff85-45a1-83dd-3c3fcd63f323 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:19.899133 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-c11276c5-ff85-45a1-83dd-3c3fcd63f323 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:19.909188 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c11276c5-ff85-45a1-83dd-3c3fcd63f323 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.096840 Oct 29 01:20:19.909790 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 588/1165] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:19 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:19.966896 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f7fa2870-b1fe-4494-bafd-8bba15a81f7e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:19.967601 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f7fa2870-b1fe-4494-bafd-8bba15a81f7e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:19.974321 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f7fa2870-b1fe-4494-bafd-8bba15a81f7e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:19.974813 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f7fa2870-b1fe-4494-bafd-8bba15a81f7e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:19.975589 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f7fa2870-b1fe-4494-bafd-8bba15a81f7e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:19.976067 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f7fa2870-b1fe-4494-bafd-8bba15a81f7e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:20.113429 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-f7fa2870-b1fe-4494-bafd-8bba15a81f7e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:20.120975 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f7fa2870-b1fe-4494-bafd-8bba15a81f7e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.157881 Oct 29 01:20:20.121553 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 578/1166] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:19 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:20.571582 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-5d9a7d3e-a879-4ac0-91f0-5000bb92395c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:20.573115 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-5d9a7d3e-a879-4ac0-91f0-5000bb92395c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:20.580321 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5d9a7d3e-a879-4ac0-91f0-5000bb92395c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:20.580767 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5d9a7d3e-a879-4ac0-91f0-5000bb92395c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:20.581544 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5d9a7d3e-a879-4ac0-91f0-5000bb92395c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:20.581977 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5d9a7d3e-a879-4ac0-91f0-5000bb92395c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:20.614126 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-5d9a7d3e-a879-4ac0-91f0-5000bb92395c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047361 Oct 29 01:20:20.614732 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 589/1167] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:20 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:20:20.926497 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-8e7ad328-55d5-4e13-a16e-35a903b015de tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:20.927149 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-8e7ad328-55d5-4e13-a16e-35a903b015de tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:20.933584 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8e7ad328-55d5-4e13-a16e-35a903b015de tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:20.934105 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8e7ad328-55d5-4e13-a16e-35a903b015de tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:20.935033 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8e7ad328-55d5-4e13-a16e-35a903b015de tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:20.935506 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8e7ad328-55d5-4e13-a16e-35a903b015de tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:21.007905 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-8e7ad328-55d5-4e13-a16e-35a903b015de tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:21.016657 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-8e7ad328-55d5-4e13-a16e-35a903b015de tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.094088 Oct 29 01:20:21.017414 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 579/1168] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:20 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:21.138712 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-0cede9f2-5084-4e27-925c-043e29cc77dc tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:21.139474 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-0cede9f2-5084-4e27-925c-043e29cc77dc tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:21.146490 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0cede9f2-5084-4e27-925c-043e29cc77dc tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:21.146942 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0cede9f2-5084-4e27-925c-043e29cc77dc tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:21.147747 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0cede9f2-5084-4e27-925c-043e29cc77dc tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:21.148179 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0cede9f2-5084-4e27-925c-043e29cc77dc tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:21.283769 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-0cede9f2-5084-4e27-925c-043e29cc77dc tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:21.291565 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-0cede9f2-5084-4e27-925c-043e29cc77dc tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.156632 Oct 29 01:20:21.292113 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 590/1169] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:21 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:21.626578 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-abc5423d-fde9-4a3c-a171-c32f02a3fec7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:21.627618 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-abc5423d-fde9-4a3c-a171-c32f02a3fec7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:21.633669 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-abc5423d-fde9-4a3c-a171-c32f02a3fec7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:21.634111 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-abc5423d-fde9-4a3c-a171-c32f02a3fec7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:21.634893 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-abc5423d-fde9-4a3c-a171-c32f02a3fec7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:21.635321 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-abc5423d-fde9-4a3c-a171-c32f02a3fec7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:21.665653 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-abc5423d-fde9-4a3c-a171-c32f02a3fec7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043533 Oct 29 01:20:21.666291 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 580/1170] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:21 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:20:22.033284 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-1f164d5d-3509-44d4-9544-15d51531d9ac tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:22.034005 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-1f164d5d-3509-44d4-9544-15d51531d9ac tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:22.039885 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1f164d5d-3509-44d4-9544-15d51531d9ac tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:22.040328 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1f164d5d-3509-44d4-9544-15d51531d9ac tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:22.041087 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1f164d5d-3509-44d4-9544-15d51531d9ac tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:22.041619 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1f164d5d-3509-44d4-9544-15d51531d9ac tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:22.117970 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-1f164d5d-3509-44d4-9544-15d51531d9ac tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:22.126384 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-1f164d5d-3509-44d4-9544-15d51531d9ac tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.097428 Oct 29 01:20:22.126983 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 591/1171] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:22 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:22.309322 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ccc2fac7-c1a0-4a65-a1cb-7745e19da5fa tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:22.309884 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ccc2fac7-c1a0-4a65-a1cb-7745e19da5fa tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:22.317405 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ccc2fac7-c1a0-4a65-a1cb-7745e19da5fa tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:22.318592 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ccc2fac7-c1a0-4a65-a1cb-7745e19da5fa tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:22.320016 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ccc2fac7-c1a0-4a65-a1cb-7745e19da5fa tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:22.320513 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ccc2fac7-c1a0-4a65-a1cb-7745e19da5fa tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:22.457865 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-ccc2fac7-c1a0-4a65-a1cb-7745e19da5fa tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:22.466128 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ccc2fac7-c1a0-4a65-a1cb-7745e19da5fa tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.161309 Oct 29 01:20:22.467296 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 581/1172] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:22 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:22.677672 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-eb5c3d4b-ad9e-4eba-8fee-d52b5f3d58a8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:22.679150 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-eb5c3d4b-ad9e-4eba-8fee-d52b5f3d58a8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:22.686062 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-eb5c3d4b-ad9e-4eba-8fee-d52b5f3d58a8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:22.686534 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-eb5c3d4b-ad9e-4eba-8fee-d52b5f3d58a8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:22.687308 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-eb5c3d4b-ad9e-4eba-8fee-d52b5f3d58a8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:22.687738 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-eb5c3d4b-ad9e-4eba-8fee-d52b5f3d58a8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:22.718211 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-eb5c3d4b-ad9e-4eba-8fee-d52b5f3d58a8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044366 Oct 29 01:20:22.718826 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 592/1173] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:22 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:23.145671 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-8917f849-81e9-45f9-9d2b-f01e0c300add tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:23.146317 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-8917f849-81e9-45f9-9d2b-f01e0c300add tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:23.152613 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8917f849-81e9-45f9-9d2b-f01e0c300add tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:23.153053 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8917f849-81e9-45f9-9d2b-f01e0c300add tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:23.153963 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8917f849-81e9-45f9-9d2b-f01e0c300add tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:23.154402 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8917f849-81e9-45f9-9d2b-f01e0c300add tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:23.220434 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-8917f849-81e9-45f9-9d2b-f01e0c300add tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:23.227747 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-8917f849-81e9-45f9-9d2b-f01e0c300add tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.086814 Oct 29 01:20:23.228311 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 582/1174] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:23 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:20:23.484149 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-610d8908-ea1e-42a2-b07b-2f7fd72d5d3f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:23.484703 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-610d8908-ea1e-42a2-b07b-2f7fd72d5d3f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:23.491975 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-610d8908-ea1e-42a2-b07b-2f7fd72d5d3f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:23.492449 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-610d8908-ea1e-42a2-b07b-2f7fd72d5d3f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:23.493285 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-610d8908-ea1e-42a2-b07b-2f7fd72d5d3f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:23.493754 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-610d8908-ea1e-42a2-b07b-2f7fd72d5d3f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:23.623398 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-610d8908-ea1e-42a2-b07b-2f7fd72d5d3f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:23.630954 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-610d8908-ea1e-42a2-b07b-2f7fd72d5d3f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.150505 Oct 29 01:20:23.631521 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 593/1175] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:23 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:23.730509 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-45a67a5b-2a2b-4262-93b4-cf7128266da9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:23.731528 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-45a67a5b-2a2b-4262-93b4-cf7128266da9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:23.739074 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-45a67a5b-2a2b-4262-93b4-cf7128266da9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:23.739502 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-45a67a5b-2a2b-4262-93b4-cf7128266da9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:23.740320 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-45a67a5b-2a2b-4262-93b4-cf7128266da9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:23.740760 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-45a67a5b-2a2b-4262-93b4-cf7128266da9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:23.774533 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-45a67a5b-2a2b-4262-93b4-cf7128266da9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047708 Oct 29 01:20:23.775158 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 583/1176] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:23 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:24.246098 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-daa1cfe7-fc9a-4049-8dc1-1f88bfe43f62 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:24.246736 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-daa1cfe7-fc9a-4049-8dc1-1f88bfe43f62 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:24.253247 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-daa1cfe7-fc9a-4049-8dc1-1f88bfe43f62 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:24.253692 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-daa1cfe7-fc9a-4049-8dc1-1f88bfe43f62 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:24.254494 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-daa1cfe7-fc9a-4049-8dc1-1f88bfe43f62 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:24.254931 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-daa1cfe7-fc9a-4049-8dc1-1f88bfe43f62 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:24.318213 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-daa1cfe7-fc9a-4049-8dc1-1f88bfe43f62 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:24.325896 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-daa1cfe7-fc9a-4049-8dc1-1f88bfe43f62 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.083570 Oct 29 01:20:24.326490 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 594/1177] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:24 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:24.649094 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c829e633-48b1-4169-b24b-a6c8ad0279cf tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:24.649700 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c829e633-48b1-4169-b24b-a6c8ad0279cf tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:24.656532 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c829e633-48b1-4169-b24b-a6c8ad0279cf tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:24.657034 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c829e633-48b1-4169-b24b-a6c8ad0279cf tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:24.657805 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c829e633-48b1-4169-b24b-a6c8ad0279cf tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:24.658228 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c829e633-48b1-4169-b24b-a6c8ad0279cf tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:24.786852 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-5b94fbb5-81e7-4cbf-b1f1-5c2be6490cbe tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:24.787769 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-5b94fbb5-81e7-4cbf-b1f1-5c2be6490cbe tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:24.789732 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c829e633-48b1-4169-b24b-a6c8ad0279cf tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:24.793862 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5b94fbb5-81e7-4cbf-b1f1-5c2be6490cbe tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:24.794307 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5b94fbb5-81e7-4cbf-b1f1-5c2be6490cbe tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:24.795111 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5b94fbb5-81e7-4cbf-b1f1-5c2be6490cbe tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:24.795552 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5b94fbb5-81e7-4cbf-b1f1-5c2be6490cbe tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:24.797915 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c829e633-48b1-4169-b24b-a6c8ad0279cf tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.152457 Oct 29 01:20:24.798529 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 584/1178] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:24 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:24.831868 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-5b94fbb5-81e7-4cbf-b1f1-5c2be6490cbe tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049142 Oct 29 01:20:24.832441 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 595/1179] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:24 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:25.344662 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c877c8fd-cdb1-489f-bffe-69436e38c3d8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:25.345273 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c877c8fd-cdb1-489f-bffe-69436e38c3d8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:25.351127 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c877c8fd-cdb1-489f-bffe-69436e38c3d8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:25.351570 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c877c8fd-cdb1-489f-bffe-69436e38c3d8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:25.352327 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c877c8fd-cdb1-489f-bffe-69436e38c3d8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:25.352759 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c877c8fd-cdb1-489f-bffe-69436e38c3d8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:25.414555 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c877c8fd-cdb1-489f-bffe-69436e38c3d8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:25.422233 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c877c8fd-cdb1-489f-bffe-69436e38c3d8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.082142 Oct 29 01:20:25.422838 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 585/1180] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:25 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:25.818003 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-3f43894c-6f8c-455d-817a-7dba68d1a1dd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:25.818621 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-3f43894c-6f8c-455d-817a-7dba68d1a1dd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:25.825356 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3f43894c-6f8c-455d-817a-7dba68d1a1dd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:25.826412 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3f43894c-6f8c-455d-817a-7dba68d1a1dd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:25.827194 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3f43894c-6f8c-455d-817a-7dba68d1a1dd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:25.827623 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3f43894c-6f8c-455d-817a-7dba68d1a1dd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:25.844235 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-25b76912-58fa-4574-a462-fc7773c1202d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:25.845244 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-25b76912-58fa-4574-a462-fc7773c1202d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:25.852593 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-25b76912-58fa-4574-a462-fc7773c1202d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:25.853026 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-25b76912-58fa-4574-a462-fc7773c1202d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:25.853991 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-25b76912-58fa-4574-a462-fc7773c1202d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:25.854422 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-25b76912-58fa-4574-a462-fc7773c1202d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:25.894770 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-25b76912-58fa-4574-a462-fc7773c1202d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054861 Oct 29 01:20:25.895367 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 586/1181] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:25 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:20:25.973540 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-3f43894c-6f8c-455d-817a-7dba68d1a1dd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:25.982106 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-3f43894c-6f8c-455d-817a-7dba68d1a1dd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.167700 Oct 29 01:20:25.982825 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 596/1182] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:25 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:26.439662 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-8ab7ce10-7e50-4990-add7-fe1a18705e68 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:26.440267 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-8ab7ce10-7e50-4990-add7-fe1a18705e68 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:26.446040 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8ab7ce10-7e50-4990-add7-fe1a18705e68 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:26.446514 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8ab7ce10-7e50-4990-add7-fe1a18705e68 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:26.447285 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8ab7ce10-7e50-4990-add7-fe1a18705e68 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:26.447806 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8ab7ce10-7e50-4990-add7-fe1a18705e68 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:26.514723 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-8ab7ce10-7e50-4990-add7-fe1a18705e68 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:26.522073 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-8ab7ce10-7e50-4990-add7-fe1a18705e68 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.086308 Oct 29 01:20:26.522669 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 587/1183] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:26 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:20:26.907619 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-9830f18f-1c1a-4db9-bbaf-24bf2cd548e1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:26.908544 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-9830f18f-1c1a-4db9-bbaf-24bf2cd548e1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:26.915884 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9830f18f-1c1a-4db9-bbaf-24bf2cd548e1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:26.916351 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9830f18f-1c1a-4db9-bbaf-24bf2cd548e1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:26.917123 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9830f18f-1c1a-4db9-bbaf-24bf2cd548e1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:26.917553 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9830f18f-1c1a-4db9-bbaf-24bf2cd548e1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:26.953231 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-9830f18f-1c1a-4db9-bbaf-24bf2cd548e1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050618 Oct 29 01:20:26.953849 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 597/1184] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:26 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:27.000400 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-61fa0451-e862-431f-8337-5b7be9d72524 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:27.001295 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-61fa0451-e862-431f-8337-5b7be9d72524 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:27.007541 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-61fa0451-e862-431f-8337-5b7be9d72524 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:27.007980 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-61fa0451-e862-431f-8337-5b7be9d72524 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:27.008743 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-61fa0451-e862-431f-8337-5b7be9d72524 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:27.009174 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-61fa0451-e862-431f-8337-5b7be9d72524 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:27.144470 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-61fa0451-e862-431f-8337-5b7be9d72524 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:27.153093 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-61fa0451-e862-431f-8337-5b7be9d72524 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.156909 Oct 29 01:20:27.153678 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 588/1185] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:26 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:27.542938 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-51e6e264-bd28-4bc6-a2e0-0f7c8e5157e1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:27.543887 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-51e6e264-bd28-4bc6-a2e0-0f7c8e5157e1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:27.551174 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-51e6e264-bd28-4bc6-a2e0-0f7c8e5157e1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:27.551628 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-51e6e264-bd28-4bc6-a2e0-0f7c8e5157e1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:27.552409 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-51e6e264-bd28-4bc6-a2e0-0f7c8e5157e1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:27.552840 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-51e6e264-bd28-4bc6-a2e0-0f7c8e5157e1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:27.619314 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-51e6e264-bd28-4bc6-a2e0-0f7c8e5157e1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:27.627323 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-51e6e264-bd28-4bc6-a2e0-0f7c8e5157e1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.088426 Oct 29 01:20:27.627874 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 598/1186] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:27 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:27.965071 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-5bc63376-595a-43e6-9f31-d3d924429469 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:27.966000 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-5bc63376-595a-43e6-9f31-d3d924429469 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:27.972963 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5bc63376-595a-43e6-9f31-d3d924429469 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:27.973417 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5bc63376-595a-43e6-9f31-d3d924429469 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:27.974190 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5bc63376-595a-43e6-9f31-d3d924429469 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:27.974665 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5bc63376-595a-43e6-9f31-d3d924429469 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:28.007019 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-5bc63376-595a-43e6-9f31-d3d924429469 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046002 Oct 29 01:20:28.007719 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 589/1187] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:27 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:28.171563 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-7b68106e-6a8a-47aa-b59e-cf947e466dd0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:28.172259 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-7b68106e-6a8a-47aa-b59e-cf947e466dd0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:28.179114 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7b68106e-6a8a-47aa-b59e-cf947e466dd0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:28.179493 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7b68106e-6a8a-47aa-b59e-cf947e466dd0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:28.180305 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7b68106e-6a8a-47aa-b59e-cf947e466dd0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:28.180774 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7b68106e-6a8a-47aa-b59e-cf947e466dd0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:28.308739 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-7b68106e-6a8a-47aa-b59e-cf947e466dd0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:28.329160 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-7b68106e-6a8a-47aa-b59e-cf947e466dd0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.162212 Oct 29 01:20:28.330546 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 599/1188] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:28 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:28.645989 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-466dbe9e-e4d4-4a73-a889-460138ce72b3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:28.646514 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-466dbe9e-e4d4-4a73-a889-460138ce72b3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:28.653344 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-466dbe9e-e4d4-4a73-a889-460138ce72b3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:28.653798 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-466dbe9e-e4d4-4a73-a889-460138ce72b3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:28.654627 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-466dbe9e-e4d4-4a73-a889-460138ce72b3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:28.655063 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-466dbe9e-e4d4-4a73-a889-460138ce72b3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:28.733417 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-466dbe9e-e4d4-4a73-a889-460138ce72b3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:28.741358 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-466dbe9e-e4d4-4a73-a889-460138ce72b3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.100266 Oct 29 01:20:28.742071 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 590/1189] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:28 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:29.019379 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-b39baec0-9112-42c4-9bc8-93f752fb7f90 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:29.020331 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-b39baec0-9112-42c4-9bc8-93f752fb7f90 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:29.026365 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b39baec0-9112-42c4-9bc8-93f752fb7f90 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:29.026850 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b39baec0-9112-42c4-9bc8-93f752fb7f90 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:29.028028 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b39baec0-9112-42c4-9bc8-93f752fb7f90 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:29.028028 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b39baec0-9112-42c4-9bc8-93f752fb7f90 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:29.062763 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-b39baec0-9112-42c4-9bc8-93f752fb7f90 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047746 Oct 29 01:20:29.063345 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 600/1190] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:29 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:29.349838 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9ae528f7-d4f0-44e7-9977-ae2dccaba81b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:29.350564 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9ae528f7-d4f0-44e7-9977-ae2dccaba81b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:29.357150 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9ae528f7-d4f0-44e7-9977-ae2dccaba81b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:29.357590 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9ae528f7-d4f0-44e7-9977-ae2dccaba81b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:29.358350 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9ae528f7-d4f0-44e7-9977-ae2dccaba81b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:29.359287 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9ae528f7-d4f0-44e7-9977-ae2dccaba81b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:29.486641 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-9ae528f7-d4f0-44e7-9977-ae2dccaba81b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:29.496703 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9ae528f7-d4f0-44e7-9977-ae2dccaba81b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.150556 Oct 29 01:20:29.497301 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 591/1191] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:29 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:29.758565 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d1e6f2b7-9a2d-4c95-98e3-1741aa2056c7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:29.759100 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d1e6f2b7-9a2d-4c95-98e3-1741aa2056c7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:29.766837 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d1e6f2b7-9a2d-4c95-98e3-1741aa2056c7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:29.767328 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d1e6f2b7-9a2d-4c95-98e3-1741aa2056c7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:29.768105 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d1e6f2b7-9a2d-4c95-98e3-1741aa2056c7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:29.768532 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d1e6f2b7-9a2d-4c95-98e3-1741aa2056c7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:29.837333 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-d1e6f2b7-9a2d-4c95-98e3-1741aa2056c7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:29.845481 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d1e6f2b7-9a2d-4c95-98e3-1741aa2056c7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.090702 Oct 29 01:20:29.846044 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 601/1192] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:29 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:30.074365 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-786a2386-0ca6-44ba-a9fb-b0b40834c9dd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:30.075239 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-786a2386-0ca6-44ba-a9fb-b0b40834c9dd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:30.081885 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-786a2386-0ca6-44ba-a9fb-b0b40834c9dd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:30.082367 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-786a2386-0ca6-44ba-a9fb-b0b40834c9dd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:30.083177 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-786a2386-0ca6-44ba-a9fb-b0b40834c9dd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:30.083616 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-786a2386-0ca6-44ba-a9fb-b0b40834c9dd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:30.114180 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-786a2386-0ca6-44ba-a9fb-b0b40834c9dd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043708 Oct 29 01:20:30.115008 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 592/1193] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:30 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:30.516019 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-1deff1fc-f68e-49e2-9be4-00306e3edf79 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:30.516612 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-1deff1fc-f68e-49e2-9be4-00306e3edf79 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:30.522366 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1deff1fc-f68e-49e2-9be4-00306e3edf79 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:30.522837 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1deff1fc-f68e-49e2-9be4-00306e3edf79 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:30.523587 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1deff1fc-f68e-49e2-9be4-00306e3edf79 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:30.524020 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1deff1fc-f68e-49e2-9be4-00306e3edf79 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:30.651686 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-1deff1fc-f68e-49e2-9be4-00306e3edf79 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:30.660014 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-1deff1fc-f68e-49e2-9be4-00306e3edf79 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.148416 Oct 29 01:20:30.660539 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 602/1194] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:30 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:30.863284 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-59258301-0795-48ed-a0e7-8723f9bfe158 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:30.863900 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-59258301-0795-48ed-a0e7-8723f9bfe158 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:30.870378 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-59258301-0795-48ed-a0e7-8723f9bfe158 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:30.870967 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-59258301-0795-48ed-a0e7-8723f9bfe158 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:30.871741 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-59258301-0795-48ed-a0e7-8723f9bfe158 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:30.872184 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-59258301-0795-48ed-a0e7-8723f9bfe158 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:30.936717 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-59258301-0795-48ed-a0e7-8723f9bfe158 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:30.946011 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-59258301-0795-48ed-a0e7-8723f9bfe158 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.087470 Oct 29 01:20:30.946621 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 593/1195] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:30 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:31.126376 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-55e46267-47a0-494b-b086-39ff78101b40 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:31.127322 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-55e46267-47a0-494b-b086-39ff78101b40 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:31.133751 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-55e46267-47a0-494b-b086-39ff78101b40 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:31.134192 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-55e46267-47a0-494b-b086-39ff78101b40 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:31.135055 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-55e46267-47a0-494b-b086-39ff78101b40 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:31.135509 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-55e46267-47a0-494b-b086-39ff78101b40 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:31.168300 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-55e46267-47a0-494b-b086-39ff78101b40 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046093 Oct 29 01:20:31.168935 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 603/1196] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:31 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:31.677640 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-da3ee0cb-a473-488b-917c-e34bbce15e7f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:31.678357 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-da3ee0cb-a473-488b-917c-e34bbce15e7f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:31.684640 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-da3ee0cb-a473-488b-917c-e34bbce15e7f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:31.685099 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-da3ee0cb-a473-488b-917c-e34bbce15e7f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:31.685878 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-da3ee0cb-a473-488b-917c-e34bbce15e7f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:31.686316 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-da3ee0cb-a473-488b-917c-e34bbce15e7f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:31.812763 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-da3ee0cb-a473-488b-917c-e34bbce15e7f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:31.823558 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-da3ee0cb-a473-488b-917c-e34bbce15e7f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.149461 Oct 29 01:20:31.824166 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 594/1197] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:31 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:31.964069 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-76eb277f-7c8f-4979-a329-67e2d025367c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:31.964675 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-76eb277f-7c8f-4979-a329-67e2d025367c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:31.972615 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-76eb277f-7c8f-4979-a329-67e2d025367c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:31.973062 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-76eb277f-7c8f-4979-a329-67e2d025367c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:31.973836 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-76eb277f-7c8f-4979-a329-67e2d025367c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:31.974263 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-76eb277f-7c8f-4979-a329-67e2d025367c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:32.035573 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-76eb277f-7c8f-4979-a329-67e2d025367c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:32.043534 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-76eb277f-7c8f-4979-a329-67e2d025367c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.083792 Oct 29 01:20:32.044112 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 604/1198] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:31 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:32.184059 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-2cfb7510-5bcf-4995-82ff-480a5057a165 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:32.184969 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-2cfb7510-5bcf-4995-82ff-480a5057a165 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:32.191120 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2cfb7510-5bcf-4995-82ff-480a5057a165 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:32.191561 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2cfb7510-5bcf-4995-82ff-480a5057a165 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:32.192438 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2cfb7510-5bcf-4995-82ff-480a5057a165 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:32.192874 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2cfb7510-5bcf-4995-82ff-480a5057a165 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:32.222714 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-2cfb7510-5bcf-4995-82ff-480a5057a165 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042322 Oct 29 01:20:32.223190 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 595/1199] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:32 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:32.840926 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-7c0a481e-13d8-4be2-92d5-9eda6b692f7a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:32.841531 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-7c0a481e-13d8-4be2-92d5-9eda6b692f7a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:32.847870 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7c0a481e-13d8-4be2-92d5-9eda6b692f7a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:32.848320 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7c0a481e-13d8-4be2-92d5-9eda6b692f7a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:32.849083 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7c0a481e-13d8-4be2-92d5-9eda6b692f7a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:32.849516 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7c0a481e-13d8-4be2-92d5-9eda6b692f7a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:32.979956 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-7c0a481e-13d8-4be2-92d5-9eda6b692f7a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:32.988374 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-7c0a481e-13d8-4be2-92d5-9eda6b692f7a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.151466 Oct 29 01:20:32.988958 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 605/1200] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:32 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:33.060913 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-0396d90f-ad1e-47ff-9e80-2b61f5792958 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:33.061514 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-0396d90f-ad1e-47ff-9e80-2b61f5792958 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:33.067787 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0396d90f-ad1e-47ff-9e80-2b61f5792958 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:33.068233 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0396d90f-ad1e-47ff-9e80-2b61f5792958 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:33.068992 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0396d90f-ad1e-47ff-9e80-2b61f5792958 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:33.069417 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0396d90f-ad1e-47ff-9e80-2b61f5792958 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:33.130373 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-0396d90f-ad1e-47ff-9e80-2b61f5792958 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:33.138622 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-0396d90f-ad1e-47ff-9e80-2b61f5792958 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.081046 Oct 29 01:20:33.139585 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 596/1201] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:33 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:33.233258 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e20d3b85-7d59-4037-9ebf-fb8158594bb4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:33.234209 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-e20d3b85-7d59-4037-9ebf-fb8158594bb4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:33.240151 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e20d3b85-7d59-4037-9ebf-fb8158594bb4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:33.240599 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e20d3b85-7d59-4037-9ebf-fb8158594bb4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:33.241370 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e20d3b85-7d59-4037-9ebf-fb8158594bb4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:33.241815 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e20d3b85-7d59-4037-9ebf-fb8158594bb4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:33.271581 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-e20d3b85-7d59-4037-9ebf-fb8158594bb4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042168 Oct 29 01:20:33.272132 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 606/1202] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:33 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:34.009655 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-1e2063db-2d07-4416-b633-5ad0572c4775 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:34.010241 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-1e2063db-2d07-4416-b633-5ad0572c4775 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:34.016153 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1e2063db-2d07-4416-b633-5ad0572c4775 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:34.016594 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1e2063db-2d07-4416-b633-5ad0572c4775 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:34.017350 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1e2063db-2d07-4416-b633-5ad0572c4775 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:34.017776 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1e2063db-2d07-4416-b633-5ad0572c4775 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:34.139529 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-1e2063db-2d07-4416-b633-5ad0572c4775 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:34.147007 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-1e2063db-2d07-4416-b633-5ad0572c4775 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.141184 Oct 29 01:20:34.147589 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 597/1203] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:34 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:34.156927 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-553a5a52-b691-4f3e-a4d9-86a39b091153 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:34.157526 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-553a5a52-b691-4f3e-a4d9-86a39b091153 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:34.163896 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-553a5a52-b691-4f3e-a4d9-86a39b091153 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:34.164343 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-553a5a52-b691-4f3e-a4d9-86a39b091153 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:34.165180 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-553a5a52-b691-4f3e-a4d9-86a39b091153 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:34.165622 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-553a5a52-b691-4f3e-a4d9-86a39b091153 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:34.228582 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-553a5a52-b691-4f3e-a4d9-86a39b091153 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:34.236491 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-553a5a52-b691-4f3e-a4d9-86a39b091153 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.083868 Oct 29 01:20:34.237051 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 607/1204] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:34 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:34.283869 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f08b66f6-7e05-43bd-9886-bdd5b21b4ed0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:34.284787 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f08b66f6-7e05-43bd-9886-bdd5b21b4ed0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:34.290906 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f08b66f6-7e05-43bd-9886-bdd5b21b4ed0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:34.291355 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f08b66f6-7e05-43bd-9886-bdd5b21b4ed0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:34.292124 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f08b66f6-7e05-43bd-9886-bdd5b21b4ed0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:34.292561 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f08b66f6-7e05-43bd-9886-bdd5b21b4ed0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:34.321667 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f08b66f6-7e05-43bd-9886-bdd5b21b4ed0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042067 Oct 29 01:20:34.322261 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 598/1205] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:34 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:35.164529 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-a8d64398-edc2-49e6-ac55-7f3ea59c24a9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:35.165146 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-a8d64398-edc2-49e6-ac55-7f3ea59c24a9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:35.172083 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a8d64398-edc2-49e6-ac55-7f3ea59c24a9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:35.172527 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a8d64398-edc2-49e6-ac55-7f3ea59c24a9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:35.173306 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a8d64398-edc2-49e6-ac55-7f3ea59c24a9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:35.173745 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a8d64398-edc2-49e6-ac55-7f3ea59c24a9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:35.253912 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-3aef9f8b-2c23-480c-9a79-4a0a9f45b0a5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:35.254607 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-3aef9f8b-2c23-480c-9a79-4a0a9f45b0a5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:35.261591 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3aef9f8b-2c23-480c-9a79-4a0a9f45b0a5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:35.262042 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3aef9f8b-2c23-480c-9a79-4a0a9f45b0a5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:35.262856 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3aef9f8b-2c23-480c-9a79-4a0a9f45b0a5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:35.263291 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3aef9f8b-2c23-480c-9a79-4a0a9f45b0a5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:35.332355 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-a8d64398-edc2-49e6-ac55-7f3ea59c24a9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:35.340436 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-a8d64398-edc2-49e6-ac55-7f3ea59c24a9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.179620 Oct 29 01:20:35.341353 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 608/1206] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:35 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:35.345803 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-233079b4-90c1-4208-ab34-ce0dbd6cb4a0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:35.346830 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-233079b4-90c1-4208-ab34-ce0dbd6cb4a0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:35.352862 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-233079b4-90c1-4208-ab34-ce0dbd6cb4a0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:35.353316 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-233079b4-90c1-4208-ab34-ce0dbd6cb4a0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:35.354028 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-3aef9f8b-2c23-480c-9a79-4a0a9f45b0a5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:35.354157 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-233079b4-90c1-4208-ab34-ce0dbd6cb4a0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:35.354577 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-233079b4-90c1-4208-ab34-ce0dbd6cb4a0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:35.362218 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-3aef9f8b-2c23-480c-9a79-4a0a9f45b0a5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.112867 Oct 29 01:20:35.362851 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 599/1207] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:35 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:20:35.385420 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-233079b4-90c1-4208-ab34-ce0dbd6cb4a0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043135 Oct 29 01:20:35.386050 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 609/1208] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:35 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:36.357611 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-8934c61d-2936-47f9-94c9-ed79d2158bf0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:36.358206 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-8934c61d-2936-47f9-94c9-ed79d2158bf0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:36.366693 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8934c61d-2936-47f9-94c9-ed79d2158bf0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:36.367145 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8934c61d-2936-47f9-94c9-ed79d2158bf0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:36.367921 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8934c61d-2936-47f9-94c9-ed79d2158bf0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:36.368352 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8934c61d-2936-47f9-94c9-ed79d2158bf0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:36.379412 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-1c9b5c41-82a4-4465-8a57-cdff1a5e01a7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:36.380293 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-1c9b5c41-82a4-4465-8a57-cdff1a5e01a7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:36.386907 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1c9b5c41-82a4-4465-8a57-cdff1a5e01a7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:36.387356 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1c9b5c41-82a4-4465-8a57-cdff1a5e01a7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:36.388138 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1c9b5c41-82a4-4465-8a57-cdff1a5e01a7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:36.388570 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1c9b5c41-82a4-4465-8a57-cdff1a5e01a7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:36.472217 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-1c9b5c41-82a4-4465-8a57-cdff1a5e01a7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:36.480468 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-1c9b5c41-82a4-4465-8a57-cdff1a5e01a7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.105503 Oct 29 01:20:36.480975 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 610/1209] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:36 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:36.486114 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-98e45af2-248c-493d-a441-8bc515faeab9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:36.487068 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-98e45af2-248c-493d-a441-8bc515faeab9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:36.494273 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-98e45af2-248c-493d-a441-8bc515faeab9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:36.494757 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-98e45af2-248c-493d-a441-8bc515faeab9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:36.495562 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-98e45af2-248c-493d-a441-8bc515faeab9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:36.497568 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-98e45af2-248c-493d-a441-8bc515faeab9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:36.535033 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-98e45af2-248c-493d-a441-8bc515faeab9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052805 Oct 29 01:20:36.535478 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 611/1210] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:36 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:36.537389 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-8934c61d-2936-47f9-94c9-ed79d2158bf0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:36.546073 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-8934c61d-2936-47f9-94c9-ed79d2158bf0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.192070 Oct 29 01:20:36.547334 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 600/1211] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:36 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:37.500678 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-4aee18c7-56c4-4672-9310-2b2e8fe5d0c4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:37.501731 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-4aee18c7-56c4-4672-9310-2b2e8fe5d0c4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:37.509213 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4aee18c7-56c4-4672-9310-2b2e8fe5d0c4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:37.509677 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4aee18c7-56c4-4672-9310-2b2e8fe5d0c4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:37.510492 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4aee18c7-56c4-4672-9310-2b2e8fe5d0c4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:37.510927 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4aee18c7-56c4-4672-9310-2b2e8fe5d0c4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:37.547315 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-bc3b7b8e-c21a-4920-818e-3f64073676be tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:37.548876 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-bc3b7b8e-c21a-4920-818e-3f64073676be tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:37.558574 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bc3b7b8e-c21a-4920-818e-3f64073676be tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:37.558924 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bc3b7b8e-c21a-4920-818e-3f64073676be tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:37.559857 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bc3b7b8e-c21a-4920-818e-3f64073676be tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:37.560413 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bc3b7b8e-c21a-4920-818e-3f64073676be tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:37.579992 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-4aee18c7-56c4-4672-9310-2b2e8fe5d0c4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:37.587664 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-4aee18c7-56c4-4672-9310-2b2e8fe5d0c4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.093373 Oct 29 01:20:37.589026 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 612/1212] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:37 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:37.591889 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-bc3b7b8e-c21a-4920-818e-3f64073676be tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049182 Oct 29 01:20:37.596697 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 601/1213] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:37 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:20:37.596853 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-57dc29b2-43f8-4010-ac92-6d8ff4c46699 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:37.597458 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-57dc29b2-43f8-4010-ac92-6d8ff4c46699 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:37.605519 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-57dc29b2-43f8-4010-ac92-6d8ff4c46699 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:37.606220 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-57dc29b2-43f8-4010-ac92-6d8ff4c46699 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:37.607221 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-57dc29b2-43f8-4010-ac92-6d8ff4c46699 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:37.607804 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-57dc29b2-43f8-4010-ac92-6d8ff4c46699 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:37.738138 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-57dc29b2-43f8-4010-ac92-6d8ff4c46699 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:37.751174 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-57dc29b2-43f8-4010-ac92-6d8ff4c46699 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.160316 Oct 29 01:20:37.752040 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 613/1214] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:37 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:38.607752 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9579d334-6a98-4c2a-bd41-5d2ea9d5a49c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:38.608691 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-00e18ad0-4bbb-48ab-9ebe-875e8c2e01da tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:38.609244 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9579d334-6a98-4c2a-bd41-5d2ea9d5a49c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:38.609715 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-00e18ad0-4bbb-48ab-9ebe-875e8c2e01da tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:38.619834 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-00e18ad0-4bbb-48ab-9ebe-875e8c2e01da tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:38.620838 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-00e18ad0-4bbb-48ab-9ebe-875e8c2e01da tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:38.621560 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9579d334-6a98-4c2a-bd41-5d2ea9d5a49c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:38.622294 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9579d334-6a98-4c2a-bd41-5d2ea9d5a49c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:38.622468 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-00e18ad0-4bbb-48ab-9ebe-875e8c2e01da tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:38.623091 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-00e18ad0-4bbb-48ab-9ebe-875e8c2e01da tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:38.623666 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9579d334-6a98-4c2a-bd41-5d2ea9d5a49c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:38.624859 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9579d334-6a98-4c2a-bd41-5d2ea9d5a49c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:38.662012 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9579d334-6a98-4c2a-bd41-5d2ea9d5a49c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060594 Oct 29 01:20:38.662633 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 602/1215] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:38 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:38.690109 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-00e18ad0-4bbb-48ab-9ebe-875e8c2e01da tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:38.697543 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-00e18ad0-4bbb-48ab-9ebe-875e8c2e01da tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.094872 Oct 29 01:20:38.698177 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 614/1216] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:38 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:38.775944 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-be0765de-037d-4544-b2a4-9d40995c299e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:38.776611 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-be0765de-037d-4544-b2a4-9d40995c299e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:38.783267 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-be0765de-037d-4544-b2a4-9d40995c299e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:38.783783 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-be0765de-037d-4544-b2a4-9d40995c299e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:38.784492 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-be0765de-037d-4544-b2a4-9d40995c299e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:38.785296 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-be0765de-037d-4544-b2a4-9d40995c299e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:38.912807 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-be0765de-037d-4544-b2a4-9d40995c299e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:38.920389 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-be0765de-037d-4544-b2a4-9d40995c299e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.148221 Oct 29 01:20:38.920951 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 603/1217] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:38 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:39.673206 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-50912fdc-41d6-4f24-b485-b1fa0873f0c7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:39.674112 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-50912fdc-41d6-4f24-b485-b1fa0873f0c7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:39.680337 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-50912fdc-41d6-4f24-b485-b1fa0873f0c7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:39.680780 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-50912fdc-41d6-4f24-b485-b1fa0873f0c7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:39.681715 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-50912fdc-41d6-4f24-b485-b1fa0873f0c7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:39.682140 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-50912fdc-41d6-4f24-b485-b1fa0873f0c7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:39.711879 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-50912fdc-41d6-4f24-b485-b1fa0873f0c7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042222 Oct 29 01:20:39.712436 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 615/1218] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:39 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:39.714434 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d9018d28-af42-4454-a8a9-8ddd31f26ed1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:39.715153 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d9018d28-af42-4454-a8a9-8ddd31f26ed1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:39.721413 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d9018d28-af42-4454-a8a9-8ddd31f26ed1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:39.721858 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d9018d28-af42-4454-a8a9-8ddd31f26ed1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:39.722673 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d9018d28-af42-4454-a8a9-8ddd31f26ed1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:39.723088 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d9018d28-af42-4454-a8a9-8ddd31f26ed1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:39.784259 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-d9018d28-af42-4454-a8a9-8ddd31f26ed1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:39.791832 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d9018d28-af42-4454-a8a9-8ddd31f26ed1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.081567 Oct 29 01:20:39.792397 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 604/1219] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:39 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:20:39.938059 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-617628c2-ad04-4c2e-aebd-8992b2ab35dd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:39.938605 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-617628c2-ad04-4c2e-aebd-8992b2ab35dd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:39.944504 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-617628c2-ad04-4c2e-aebd-8992b2ab35dd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:39.944950 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-617628c2-ad04-4c2e-aebd-8992b2ab35dd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:39.945716 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-617628c2-ad04-4c2e-aebd-8992b2ab35dd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:39.946149 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-617628c2-ad04-4c2e-aebd-8992b2ab35dd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:40.066991 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-617628c2-ad04-4c2e-aebd-8992b2ab35dd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:40.074359 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-617628c2-ad04-4c2e-aebd-8992b2ab35dd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.141171 Oct 29 01:20:40.075069 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 616/1220] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:39 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:40.723669 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-8d54fdca-a296-4024-b58f-e4324b7af3bc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:40.724575 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-8d54fdca-a296-4024-b58f-e4324b7af3bc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:40.731109 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8d54fdca-a296-4024-b58f-e4324b7af3bc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:40.731553 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8d54fdca-a296-4024-b58f-e4324b7af3bc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:40.732314 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8d54fdca-a296-4024-b58f-e4324b7af3bc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:40.732742 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8d54fdca-a296-4024-b58f-e4324b7af3bc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:40.761186 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-8d54fdca-a296-4024-b58f-e4324b7af3bc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041246 Oct 29 01:20:40.761742 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 605/1221] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:40 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:40.808734 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-ce640a0a-37b7-4810-887c-dc6a4b2e7297 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:40.809351 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-ce640a0a-37b7-4810-887c-dc6a4b2e7297 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:40.815864 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ce640a0a-37b7-4810-887c-dc6a4b2e7297 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:40.816312 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ce640a0a-37b7-4810-887c-dc6a4b2e7297 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:40.817194 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ce640a0a-37b7-4810-887c-dc6a4b2e7297 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:40.817635 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ce640a0a-37b7-4810-887c-dc6a4b2e7297 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:40.882174 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-ce640a0a-37b7-4810-887c-dc6a4b2e7297 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:40.889542 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-ce640a0a-37b7-4810-887c-dc6a4b2e7297 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.084463 Oct 29 01:20:40.890813 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 617/1222] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:40 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:41.091506 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-589c56dd-1e23-4a0f-92ba-ea70316332d0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:41.092033 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-589c56dd-1e23-4a0f-92ba-ea70316332d0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:41.097849 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-589c56dd-1e23-4a0f-92ba-ea70316332d0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:41.098296 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-589c56dd-1e23-4a0f-92ba-ea70316332d0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:41.099085 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-589c56dd-1e23-4a0f-92ba-ea70316332d0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:41.099517 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-589c56dd-1e23-4a0f-92ba-ea70316332d0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:41.218677 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-589c56dd-1e23-4a0f-92ba-ea70316332d0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:41.225893 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-589c56dd-1e23-4a0f-92ba-ea70316332d0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.138139 Oct 29 01:20:41.226470 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 606/1223] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:41 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:41.773284 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f048422e-3885-4068-a754-1fba688fdc1f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:41.774219 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f048422e-3885-4068-a754-1fba688fdc1f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:41.780059 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f048422e-3885-4068-a754-1fba688fdc1f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:41.781007 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f048422e-3885-4068-a754-1fba688fdc1f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:41.781862 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f048422e-3885-4068-a754-1fba688fdc1f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:41.782293 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f048422e-3885-4068-a754-1fba688fdc1f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:41.810974 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f048422e-3885-4068-a754-1fba688fdc1f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041421 Oct 29 01:20:41.811621 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 618/1224] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:41 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:41.906494 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-4db82677-b302-49c6-b6f0-effb0f9cb638 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:41.907099 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-4db82677-b302-49c6-b6f0-effb0f9cb638 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:41.913327 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4db82677-b302-49c6-b6f0-effb0f9cb638 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:41.913777 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4db82677-b302-49c6-b6f0-effb0f9cb638 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:41.914568 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4db82677-b302-49c6-b6f0-effb0f9cb638 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:41.915003 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4db82677-b302-49c6-b6f0-effb0f9cb638 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:41.975176 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-4db82677-b302-49c6-b6f0-effb0f9cb638 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:41.982713 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-4db82677-b302-49c6-b6f0-effb0f9cb638 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.080538 Oct 29 01:20:41.983285 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 607/1225] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:41 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:42.242717 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-3e693d49-5ba6-4714-813f-f138925b3c07 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:42.243328 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-3e693d49-5ba6-4714-813f-f138925b3c07 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:42.249874 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3e693d49-5ba6-4714-813f-f138925b3c07 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:42.250317 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3e693d49-5ba6-4714-813f-f138925b3c07 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:42.251126 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3e693d49-5ba6-4714-813f-f138925b3c07 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:42.251587 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3e693d49-5ba6-4714-813f-f138925b3c07 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:42.370934 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-3e693d49-5ba6-4714-813f-f138925b3c07 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:42.378953 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-3e693d49-5ba6-4714-813f-f138925b3c07 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.139924 Oct 29 01:20:42.379546 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 619/1226] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:42 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:42.822774 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-97be7291-1a6f-48ff-8ff3-0910cc0f8784 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:42.823682 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-97be7291-1a6f-48ff-8ff3-0910cc0f8784 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:42.830115 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-97be7291-1a6f-48ff-8ff3-0910cc0f8784 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:42.830590 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-97be7291-1a6f-48ff-8ff3-0910cc0f8784 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:42.831372 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-97be7291-1a6f-48ff-8ff3-0910cc0f8784 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:42.831798 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-97be7291-1a6f-48ff-8ff3-0910cc0f8784 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:42.861944 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-97be7291-1a6f-48ff-8ff3-0910cc0f8784 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043053 Oct 29 01:20:42.862549 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 608/1227] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:42 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:43.000047 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-7633afd9-8ce3-4a9f-9e88-ce97deb95b86 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:43.000656 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-7633afd9-8ce3-4a9f-9e88-ce97deb95b86 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:43.006497 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7633afd9-8ce3-4a9f-9e88-ce97deb95b86 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:43.006951 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7633afd9-8ce3-4a9f-9e88-ce97deb95b86 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:43.007712 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7633afd9-8ce3-4a9f-9e88-ce97deb95b86 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:43.008145 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7633afd9-8ce3-4a9f-9e88-ce97deb95b86 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:43.070658 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-7633afd9-8ce3-4a9f-9e88-ce97deb95b86 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:43.078144 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-7633afd9-8ce3-4a9f-9e88-ce97deb95b86 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.081697 Oct 29 01:20:43.078677 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 620/1228] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:42 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:43.396373 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c86701b7-f7a0-4cfb-a83a-2181a610c95d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:43.396980 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c86701b7-f7a0-4cfb-a83a-2181a610c95d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:43.403191 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c86701b7-f7a0-4cfb-a83a-2181a610c95d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:43.403633 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c86701b7-f7a0-4cfb-a83a-2181a610c95d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:43.404383 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c86701b7-f7a0-4cfb-a83a-2181a610c95d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:43.404809 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c86701b7-f7a0-4cfb-a83a-2181a610c95d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:43.524031 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c86701b7-f7a0-4cfb-a83a-2181a610c95d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:43.531668 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c86701b7-f7a0-4cfb-a83a-2181a610c95d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.139705 Oct 29 01:20:43.532224 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 609/1229] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:43 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:43.873881 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-70fa2200-b7ce-4e89-8f84-7ec7feaa79f2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:43.874878 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-70fa2200-b7ce-4e89-8f84-7ec7feaa79f2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:43.881257 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-70fa2200-b7ce-4e89-8f84-7ec7feaa79f2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:43.881709 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-70fa2200-b7ce-4e89-8f84-7ec7feaa79f2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:43.882504 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-70fa2200-b7ce-4e89-8f84-7ec7feaa79f2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:43.882944 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-70fa2200-b7ce-4e89-8f84-7ec7feaa79f2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:43.911869 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-70fa2200-b7ce-4e89-8f84-7ec7feaa79f2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041832 Oct 29 01:20:43.912421 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 621/1230] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:43 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:44.095435 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-e13a9b4f-d7d2-4def-86e3-32787376bd1d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:44.096033 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-e13a9b4f-d7d2-4def-86e3-32787376bd1d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:44.103513 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e13a9b4f-d7d2-4def-86e3-32787376bd1d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:44.104102 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e13a9b4f-d7d2-4def-86e3-32787376bd1d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:44.104979 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e13a9b4f-d7d2-4def-86e3-32787376bd1d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:44.105401 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e13a9b4f-d7d2-4def-86e3-32787376bd1d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:44.165100 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-e13a9b4f-d7d2-4def-86e3-32787376bd1d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:44.172457 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-e13a9b4f-d7d2-4def-86e3-32787376bd1d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.080663 Oct 29 01:20:44.173144 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 610/1231] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:44 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:44.548886 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e9871bad-cdeb-48fc-98df-633aaa9b6d85 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:44.549520 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-e9871bad-cdeb-48fc-98df-633aaa9b6d85 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:44.555381 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e9871bad-cdeb-48fc-98df-633aaa9b6d85 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:44.555824 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e9871bad-cdeb-48fc-98df-633aaa9b6d85 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:44.556573 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e9871bad-cdeb-48fc-98df-633aaa9b6d85 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:44.557006 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e9871bad-cdeb-48fc-98df-633aaa9b6d85 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:44.685987 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-e9871bad-cdeb-48fc-98df-633aaa9b6d85 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:44.694337 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-e9871bad-cdeb-48fc-98df-633aaa9b6d85 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.149225 Oct 29 01:20:44.694942 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 622/1232] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:44 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:44.923361 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f2d1dcfe-2758-4978-8a74-6f47307a2b66 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:44.924263 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f2d1dcfe-2758-4978-8a74-6f47307a2b66 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:44.930994 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f2d1dcfe-2758-4978-8a74-6f47307a2b66 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:44.931438 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f2d1dcfe-2758-4978-8a74-6f47307a2b66 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:44.932191 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f2d1dcfe-2758-4978-8a74-6f47307a2b66 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:44.932616 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f2d1dcfe-2758-4978-8a74-6f47307a2b66 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:44.962158 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f2d1dcfe-2758-4978-8a74-6f47307a2b66 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042314 Oct 29 01:20:44.962843 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 611/1233] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:44 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:45.188856 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-ffa5965b-ccff-46b9-83f2-d9e1f93bc2a3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:45.189379 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-ffa5965b-ccff-46b9-83f2-d9e1f93bc2a3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:45.196443 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ffa5965b-ccff-46b9-83f2-d9e1f93bc2a3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:45.196891 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ffa5965b-ccff-46b9-83f2-d9e1f93bc2a3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:45.197655 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ffa5965b-ccff-46b9-83f2-d9e1f93bc2a3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:45.198096 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ffa5965b-ccff-46b9-83f2-d9e1f93bc2a3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:45.257550 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-ffa5965b-ccff-46b9-83f2-d9e1f93bc2a3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:45.264801 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-ffa5965b-ccff-46b9-83f2-d9e1f93bc2a3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.079746 Oct 29 01:20:45.265357 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 623/1234] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:45 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:45.712287 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-fbdd8e94-a44f-45d0-8e70-0b4d1f8db422 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:45.712999 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-fbdd8e94-a44f-45d0-8e70-0b4d1f8db422 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:45.718913 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fbdd8e94-a44f-45d0-8e70-0b4d1f8db422 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:45.719361 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fbdd8e94-a44f-45d0-8e70-0b4d1f8db422 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:45.720130 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fbdd8e94-a44f-45d0-8e70-0b4d1f8db422 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:45.720564 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fbdd8e94-a44f-45d0-8e70-0b4d1f8db422 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:45.838165 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-fbdd8e94-a44f-45d0-8e70-0b4d1f8db422 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:45.845816 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-fbdd8e94-a44f-45d0-8e70-0b4d1f8db422 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.137523 Oct 29 01:20:45.846526 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 612/1235] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:45 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:45.973513 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-aae5ca93-4b60-4b3a-8c9c-2b5d767602e1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:45.974455 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-aae5ca93-4b60-4b3a-8c9c-2b5d767602e1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:45.980431 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-aae5ca93-4b60-4b3a-8c9c-2b5d767602e1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:45.980877 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-aae5ca93-4b60-4b3a-8c9c-2b5d767602e1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:45.981637 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-aae5ca93-4b60-4b3a-8c9c-2b5d767602e1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:45.982072 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-aae5ca93-4b60-4b3a-8c9c-2b5d767602e1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:46.011054 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-aae5ca93-4b60-4b3a-8c9c-2b5d767602e1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041759 Oct 29 01:20:46.011623 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 624/1236] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:45 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:46.281291 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-2247bd92-4d2e-42b3-8604-4aafe57a302d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:46.281905 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-2247bd92-4d2e-42b3-8604-4aafe57a302d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:46.288168 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2247bd92-4d2e-42b3-8604-4aafe57a302d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:46.288607 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2247bd92-4d2e-42b3-8604-4aafe57a302d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:46.289364 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2247bd92-4d2e-42b3-8604-4aafe57a302d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:46.289790 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2247bd92-4d2e-42b3-8604-4aafe57a302d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:46.351464 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-2247bd92-4d2e-42b3-8604-4aafe57a302d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:46.358978 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-2247bd92-4d2e-42b3-8604-4aafe57a302d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.081368 Oct 29 01:20:46.359536 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 613/1237] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:46 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:46.863687 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d1c314f3-ca36-44c5-b832-7d93ba41d599 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:46.864287 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d1c314f3-ca36-44c5-b832-7d93ba41d599 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:46.870552 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d1c314f3-ca36-44c5-b832-7d93ba41d599 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:46.870999 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d1c314f3-ca36-44c5-b832-7d93ba41d599 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:46.871755 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d1c314f3-ca36-44c5-b832-7d93ba41d599 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:46.872184 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d1c314f3-ca36-44c5-b832-7d93ba41d599 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:47.000955 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-d1c314f3-ca36-44c5-b832-7d93ba41d599 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:47.008951 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d1c314f3-ca36-44c5-b832-7d93ba41d599 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.149055 Oct 29 01:20:47.009567 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 625/1238] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:46 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:47.022942 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-92aeb793-81d1-42bc-8aa5-5e12dac553b8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:47.023848 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-92aeb793-81d1-42bc-8aa5-5e12dac553b8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:47.029772 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-92aeb793-81d1-42bc-8aa5-5e12dac553b8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:47.030221 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-92aeb793-81d1-42bc-8aa5-5e12dac553b8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:47.031125 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-92aeb793-81d1-42bc-8aa5-5e12dac553b8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:47.031586 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-92aeb793-81d1-42bc-8aa5-5e12dac553b8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:47.059811 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-92aeb793-81d1-42bc-8aa5-5e12dac553b8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041284 Oct 29 01:20:47.060366 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 614/1239] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:47 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:47.376078 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d7fe1cc6-1a38-4749-aaa6-b43c0b0b541d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:47.376700 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d7fe1cc6-1a38-4749-aaa6-b43c0b0b541d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:47.383181 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d7fe1cc6-1a38-4749-aaa6-b43c0b0b541d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:47.383620 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d7fe1cc6-1a38-4749-aaa6-b43c0b0b541d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:47.384381 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d7fe1cc6-1a38-4749-aaa6-b43c0b0b541d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:47.384813 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d7fe1cc6-1a38-4749-aaa6-b43c0b0b541d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:47.443383 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-d7fe1cc6-1a38-4749-aaa6-b43c0b0b541d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:47.450808 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d7fe1cc6-1a38-4749-aaa6-b43c0b0b541d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.078419 Oct 29 01:20:47.451366 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 626/1240] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:47 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:47.717793 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:20:47.718354 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: Fri Oct 29 01:20:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 29 01:20:48.026513 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-187d4e18-9632-41e3-b08e-82b3d095c121 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:48.027030 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-187d4e18-9632-41e3-b08e-82b3d095c121 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:48.033312 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-187d4e18-9632-41e3-b08e-82b3d095c121 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:48.033761 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-187d4e18-9632-41e3-b08e-82b3d095c121 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:48.034563 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-187d4e18-9632-41e3-b08e-82b3d095c121 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:48.034997 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-187d4e18-9632-41e3-b08e-82b3d095c121 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:48.071026 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-990336e4-8462-400d-b411-134faf8b469c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:48.071949 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-990336e4-8462-400d-b411-134faf8b469c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:48.078224 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-990336e4-8462-400d-b411-134faf8b469c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:48.078710 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-990336e4-8462-400d-b411-134faf8b469c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:48.079522 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-990336e4-8462-400d-b411-134faf8b469c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:48.079959 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-990336e4-8462-400d-b411-134faf8b469c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:48.111627 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-990336e4-8462-400d-b411-134faf8b469c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044190 Oct 29 01:20:48.112212 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 627/1241] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:48 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:20:48.160860 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-187d4e18-9632-41e3-b08e-82b3d095c121 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:48.168350 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-187d4e18-9632-41e3-b08e-82b3d095c121 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.145676 Oct 29 01:20:48.168908 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 615/1242] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:48 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:48.467796 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f21ff357-89d7-4415-bf17-b7f2ed3e3308 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:48.468401 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f21ff357-89d7-4415-bf17-b7f2ed3e3308 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:48.474505 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f21ff357-89d7-4415-bf17-b7f2ed3e3308 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:48.474961 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f21ff357-89d7-4415-bf17-b7f2ed3e3308 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:48.475730 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f21ff357-89d7-4415-bf17-b7f2ed3e3308 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:48.476170 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f21ff357-89d7-4415-bf17-b7f2ed3e3308 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:48.538803 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-f21ff357-89d7-4415-bf17-b7f2ed3e3308 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:48.546383 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f21ff357-89d7-4415-bf17-b7f2ed3e3308 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.082261 Oct 29 01:20:48.547005 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 628/1243] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:48 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:49.123234 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ad39161f-f910-4adb-b265-6c8ac03a43d4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:49.124155 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ad39161f-f910-4adb-b265-6c8ac03a43d4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:49.130433 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ad39161f-f910-4adb-b265-6c8ac03a43d4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:49.130886 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ad39161f-f910-4adb-b265-6c8ac03a43d4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:49.131649 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ad39161f-f910-4adb-b265-6c8ac03a43d4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:49.132082 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ad39161f-f910-4adb-b265-6c8ac03a43d4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:49.161950 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ad39161f-f910-4adb-b265-6c8ac03a43d4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040937 Oct 29 01:20:49.161950 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 616/1244] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:49 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:49.185226 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-0135d47b-d203-40b2-adda-9889ec9cf6d9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:49.185880 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-0135d47b-d203-40b2-adda-9889ec9cf6d9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:49.192341 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0135d47b-d203-40b2-adda-9889ec9cf6d9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:49.192791 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0135d47b-d203-40b2-adda-9889ec9cf6d9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:49.193568 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0135d47b-d203-40b2-adda-9889ec9cf6d9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:49.194004 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0135d47b-d203-40b2-adda-9889ec9cf6d9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:49.318236 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-0135d47b-d203-40b2-adda-9889ec9cf6d9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:49.325540 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-0135d47b-d203-40b2-adda-9889ec9cf6d9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.144350 Oct 29 01:20:49.326107 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 629/1245] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:49 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:49.562992 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-4573a430-d317-44fe-95c6-72ee8c4f5a36 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:49.563548 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-4573a430-d317-44fe-95c6-72ee8c4f5a36 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:49.570205 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4573a430-d317-44fe-95c6-72ee8c4f5a36 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:49.570682 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4573a430-d317-44fe-95c6-72ee8c4f5a36 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:49.571448 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4573a430-d317-44fe-95c6-72ee8c4f5a36 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:49.571878 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4573a430-d317-44fe-95c6-72ee8c4f5a36 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:49.632830 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-4573a430-d317-44fe-95c6-72ee8c4f5a36 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:49.640208 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-4573a430-d317-44fe-95c6-72ee8c4f5a36 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.080965 Oct 29 01:20:49.640768 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 617/1246] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:49 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:50.172139 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-39c5bc4b-1fc2-463d-8804-1da577329a09 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:50.173003 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-39c5bc4b-1fc2-463d-8804-1da577329a09 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:50.180715 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-39c5bc4b-1fc2-463d-8804-1da577329a09 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:50.181268 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-39c5bc4b-1fc2-463d-8804-1da577329a09 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:50.182557 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-39c5bc4b-1fc2-463d-8804-1da577329a09 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:50.183454 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-39c5bc4b-1fc2-463d-8804-1da577329a09 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:50.213298 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-39c5bc4b-1fc2-463d-8804-1da577329a09 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045316 Oct 29 01:20:50.213951 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 630/1247] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:50 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:50.342518 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9b3e1b9e-fc08-4923-b233-1dcca355c1a9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:50.343123 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9b3e1b9e-fc08-4923-b233-1dcca355c1a9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:50.350169 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9b3e1b9e-fc08-4923-b233-1dcca355c1a9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:50.350657 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9b3e1b9e-fc08-4923-b233-1dcca355c1a9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:50.351431 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9b3e1b9e-fc08-4923-b233-1dcca355c1a9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:50.351869 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9b3e1b9e-fc08-4923-b233-1dcca355c1a9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:50.470263 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-9b3e1b9e-fc08-4923-b233-1dcca355c1a9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:50.478187 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9b3e1b9e-fc08-4923-b233-1dcca355c1a9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.139385 Oct 29 01:20:50.478767 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 618/1248] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:50 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:50.656713 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-82bd2dc6-456d-4f40-9b15-beb08d2a359d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:50.657320 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-82bd2dc6-456d-4f40-9b15-beb08d2a359d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:50.663216 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-82bd2dc6-456d-4f40-9b15-beb08d2a359d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:50.663668 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-82bd2dc6-456d-4f40-9b15-beb08d2a359d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:50.664425 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-82bd2dc6-456d-4f40-9b15-beb08d2a359d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:50.664860 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-82bd2dc6-456d-4f40-9b15-beb08d2a359d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:50.726470 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-82bd2dc6-456d-4f40-9b15-beb08d2a359d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:50.733860 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-82bd2dc6-456d-4f40-9b15-beb08d2a359d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.080804 Oct 29 01:20:50.734445 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 631/1249] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:50 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:51.224603 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a324775b-2c99-4877-a652-cf5838ef38d9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:51.225518 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a324775b-2c99-4877-a652-cf5838ef38d9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:51.231880 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a324775b-2c99-4877-a652-cf5838ef38d9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:51.232322 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a324775b-2c99-4877-a652-cf5838ef38d9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:51.233088 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a324775b-2c99-4877-a652-cf5838ef38d9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:51.233514 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a324775b-2c99-4877-a652-cf5838ef38d9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:51.275600 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a324775b-2c99-4877-a652-cf5838ef38d9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054607 Oct 29 01:20:51.276195 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 619/1250] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:51 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:51.495286 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-57bccd45-1d34-43d6-896a-362987a42d30 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:51.495864 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-57bccd45-1d34-43d6-896a-362987a42d30 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:51.502462 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-57bccd45-1d34-43d6-896a-362987a42d30 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:51.502910 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-57bccd45-1d34-43d6-896a-362987a42d30 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:51.503714 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-57bccd45-1d34-43d6-896a-362987a42d30 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:51.504138 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-57bccd45-1d34-43d6-896a-362987a42d30 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:51.634014 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-57bccd45-1d34-43d6-896a-362987a42d30 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:51.642197 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-57bccd45-1d34-43d6-896a-362987a42d30 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.150991 Oct 29 01:20:51.642978 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 632/1251] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:51 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:51.751569 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-4f472cc9-c435-4a16-9c61-6c7b287e339c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:51.752227 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-4f472cc9-c435-4a16-9c61-6c7b287e339c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:51.758908 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4f472cc9-c435-4a16-9c61-6c7b287e339c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:51.759550 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4f472cc9-c435-4a16-9c61-6c7b287e339c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:51.760266 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4f472cc9-c435-4a16-9c61-6c7b287e339c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:51.760695 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4f472cc9-c435-4a16-9c61-6c7b287e339c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:51.823942 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-4f472cc9-c435-4a16-9c61-6c7b287e339c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:51.831284 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-4f472cc9-c435-4a16-9c61-6c7b287e339c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.083490 Oct 29 01:20:51.832349 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 620/1252] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:51 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:52.287055 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-71d23d62-2369-4e7b-96fa-98d71722b45d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:52.287977 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-71d23d62-2369-4e7b-96fa-98d71722b45d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:52.293897 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-71d23d62-2369-4e7b-96fa-98d71722b45d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:52.294349 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-71d23d62-2369-4e7b-96fa-98d71722b45d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:52.295134 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-71d23d62-2369-4e7b-96fa-98d71722b45d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:52.295570 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-71d23d62-2369-4e7b-96fa-98d71722b45d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:52.324749 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-71d23d62-2369-4e7b-96fa-98d71722b45d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041466 Oct 29 01:20:52.325313 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 633/1253] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:52 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:52.661429 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-82657899-23b8-4b3e-8ada-68de69be1fab tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:52.662313 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-82657899-23b8-4b3e-8ada-68de69be1fab tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:52.668246 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-82657899-23b8-4b3e-8ada-68de69be1fab tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:52.668693 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-82657899-23b8-4b3e-8ada-68de69be1fab tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:52.669461 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-82657899-23b8-4b3e-8ada-68de69be1fab tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:52.669902 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-82657899-23b8-4b3e-8ada-68de69be1fab tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:52.791009 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-82657899-23b8-4b3e-8ada-68de69be1fab tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:52.798357 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-82657899-23b8-4b3e-8ada-68de69be1fab tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.141603 Oct 29 01:20:52.798970 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 621/1254] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:52 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:20:52.848453 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-51e00bfd-f4ee-421a-bf54-d6dd758899dd tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:52.849038 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-51e00bfd-f4ee-421a-bf54-d6dd758899dd tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:52.855255 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-51e00bfd-f4ee-421a-bf54-d6dd758899dd tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:52.855701 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-51e00bfd-f4ee-421a-bf54-d6dd758899dd tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:52.856466 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-51e00bfd-f4ee-421a-bf54-d6dd758899dd tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:52.856898 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-51e00bfd-f4ee-421a-bf54-d6dd758899dd tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:52.915645 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-51e00bfd-f4ee-421a-bf54-d6dd758899dd tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:52.922857 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-51e00bfd-f4ee-421a-bf54-d6dd758899dd tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.078515 Oct 29 01:20:52.923423 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 634/1255] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:52 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:53.336759 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-33b1e981-a345-4b40-a8f5-6f9c32fdc991 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:53.338003 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-33b1e981-a345-4b40-a8f5-6f9c32fdc991 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:53.344316 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-33b1e981-a345-4b40-a8f5-6f9c32fdc991 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:53.344771 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-33b1e981-a345-4b40-a8f5-6f9c32fdc991 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:53.345570 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-33b1e981-a345-4b40-a8f5-6f9c32fdc991 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:53.346011 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-33b1e981-a345-4b40-a8f5-6f9c32fdc991 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:53.380898 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-33b1e981-a345-4b40-a8f5-6f9c32fdc991 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047965 Oct 29 01:20:53.381464 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 622/1256] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:53 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:53.815646 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-7a207003-b5e7-4032-8481-5fa2519ec1de tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:53.816789 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-7a207003-b5e7-4032-8481-5fa2519ec1de tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:53.822652 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7a207003-b5e7-4032-8481-5fa2519ec1de tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:53.823228 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7a207003-b5e7-4032-8481-5fa2519ec1de tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:53.823947 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7a207003-b5e7-4032-8481-5fa2519ec1de tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:53.824382 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7a207003-b5e7-4032-8481-5fa2519ec1de tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:53.940019 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-22ff45da-7bdc-4e44-a838-e96e57983eb7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:53.940731 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-22ff45da-7bdc-4e44-a838-e96e57983eb7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:53.945933 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-7a207003-b5e7-4032-8481-5fa2519ec1de tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:53.948376 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-22ff45da-7bdc-4e44-a838-e96e57983eb7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:53.948834 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-22ff45da-7bdc-4e44-a838-e96e57983eb7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:53.949632 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-22ff45da-7bdc-4e44-a838-e96e57983eb7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:53.950068 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-22ff45da-7bdc-4e44-a838-e96e57983eb7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:53.953707 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-7a207003-b5e7-4032-8481-5fa2519ec1de tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.141681 Oct 29 01:20:53.954285 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 635/1257] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:53 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:54.012613 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-22ff45da-7bdc-4e44-a838-e96e57983eb7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:54.024838 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-22ff45da-7bdc-4e44-a838-e96e57983eb7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.088512 Oct 29 01:20:54.025412 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 623/1258] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:53 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:20:54.392424 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e4c9acb9-576e-4c60-a2cd-9bce2930a65e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:54.393361 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-e4c9acb9-576e-4c60-a2cd-9bce2930a65e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:54.399606 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e4c9acb9-576e-4c60-a2cd-9bce2930a65e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:54.400069 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e4c9acb9-576e-4c60-a2cd-9bce2930a65e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:54.400849 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e4c9acb9-576e-4c60-a2cd-9bce2930a65e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:54.401288 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e4c9acb9-576e-4c60-a2cd-9bce2930a65e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:54.432771 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-e4c9acb9-576e-4c60-a2cd-9bce2930a65e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044139 Oct 29 01:20:54.433347 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 636/1259] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:54 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:54.971424 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b77ee0ed-9a05-43cf-89a7-5772abcc1f18 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:54.972039 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b77ee0ed-9a05-43cf-89a7-5772abcc1f18 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:54.978871 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b77ee0ed-9a05-43cf-89a7-5772abcc1f18 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:54.979329 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b77ee0ed-9a05-43cf-89a7-5772abcc1f18 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:54.980096 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b77ee0ed-9a05-43cf-89a7-5772abcc1f18 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:54.980533 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b77ee0ed-9a05-43cf-89a7-5772abcc1f18 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:55.042904 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-373e1b52-1f91-474e-82e2-830c36cea8b2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:55.043518 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-373e1b52-1f91-474e-82e2-830c36cea8b2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:55.049574 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-373e1b52-1f91-474e-82e2-830c36cea8b2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:55.050018 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-373e1b52-1f91-474e-82e2-830c36cea8b2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:55.050815 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-373e1b52-1f91-474e-82e2-830c36cea8b2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:55.051260 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-373e1b52-1f91-474e-82e2-830c36cea8b2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:55.112059 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-373e1b52-1f91-474e-82e2-830c36cea8b2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:55.119646 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-373e1b52-1f91-474e-82e2-830c36cea8b2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.080580 Oct 29 01:20:55.120216 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 637/1260] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:55 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:20:55.124143 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-b77ee0ed-9a05-43cf-89a7-5772abcc1f18 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:55.132049 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b77ee0ed-9a05-43cf-89a7-5772abcc1f18 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.164308 Oct 29 01:20:55.132607 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 624/1261] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:54 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:55.444952 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-efd6112d-e830-4556-922a-97d67a55d542 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:55.445867 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-efd6112d-e830-4556-922a-97d67a55d542 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:55.451974 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-efd6112d-e830-4556-922a-97d67a55d542 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:55.452420 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-efd6112d-e830-4556-922a-97d67a55d542 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:55.453215 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-efd6112d-e830-4556-922a-97d67a55d542 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:55.453653 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-efd6112d-e830-4556-922a-97d67a55d542 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:55.481634 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-efd6112d-e830-4556-922a-97d67a55d542 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041009 Oct 29 01:20:55.482176 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 638/1262] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:55 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:56.136748 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-1f38edc3-ae1c-45a3-a5ec-86796423187f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:56.137305 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-1f38edc3-ae1c-45a3-a5ec-86796423187f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:56.143489 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1f38edc3-ae1c-45a3-a5ec-86796423187f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:56.143937 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1f38edc3-ae1c-45a3-a5ec-86796423187f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:56.145256 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1f38edc3-ae1c-45a3-a5ec-86796423187f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:56.145684 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1f38edc3-ae1c-45a3-a5ec-86796423187f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:56.149111 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f287be5a-4811-48dd-b492-fe0e28a39fca tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:56.149726 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f287be5a-4811-48dd-b492-fe0e28a39fca tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:56.155887 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f287be5a-4811-48dd-b492-fe0e28a39fca tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:56.156337 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f287be5a-4811-48dd-b492-fe0e28a39fca tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:56.157108 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f287be5a-4811-48dd-b492-fe0e28a39fca tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:56.157544 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f287be5a-4811-48dd-b492-fe0e28a39fca tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:56.213636 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-1f38edc3-ae1c-45a3-a5ec-86796423187f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:56.220882 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-1f38edc3-ae1c-45a3-a5ec-86796423187f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.088001 Oct 29 01:20:56.221449 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 625/1263] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:56 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:56.296972 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-f287be5a-4811-48dd-b492-fe0e28a39fca tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:56.304764 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f287be5a-4811-48dd-b492-fe0e28a39fca tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.159233 Oct 29 01:20:56.305332 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 639/1264] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:56 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:20:56.493965 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-fb42178b-5da1-4e6c-8fae-6996c05ba0dc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:56.494881 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-fb42178b-5da1-4e6c-8fae-6996c05ba0dc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:56.500763 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fb42178b-5da1-4e6c-8fae-6996c05ba0dc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:56.501213 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fb42178b-5da1-4e6c-8fae-6996c05ba0dc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:56.501977 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fb42178b-5da1-4e6c-8fae-6996c05ba0dc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:56.502437 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fb42178b-5da1-4e6c-8fae-6996c05ba0dc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:56.683305 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-fb42178b-5da1-4e6c-8fae-6996c05ba0dc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.193444 Oct 29 01:20:56.683863 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 626/1265] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:56 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:57.236931 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-6bdd3cda-e085-463d-a853-771a34bda56c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:57.237499 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-6bdd3cda-e085-463d-a853-771a34bda56c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:57.243674 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6bdd3cda-e085-463d-a853-771a34bda56c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:57.244118 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6bdd3cda-e085-463d-a853-771a34bda56c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:57.244871 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6bdd3cda-e085-463d-a853-771a34bda56c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:57.245295 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6bdd3cda-e085-463d-a853-771a34bda56c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:57.304116 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-6bdd3cda-e085-463d-a853-771a34bda56c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:57.311577 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-6bdd3cda-e085-463d-a853-771a34bda56c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.078380 Oct 29 01:20:57.312133 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 640/1266] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:57 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:57.321088 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9da08ee7-93e8-4ded-b340-c41e3d816700 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:57.321762 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9da08ee7-93e8-4ded-b340-c41e3d816700 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:57.327857 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9da08ee7-93e8-4ded-b340-c41e3d816700 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:57.328310 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9da08ee7-93e8-4ded-b340-c41e3d816700 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:57.329079 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9da08ee7-93e8-4ded-b340-c41e3d816700 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:57.329514 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9da08ee7-93e8-4ded-b340-c41e3d816700 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:57.447428 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-9da08ee7-93e8-4ded-b340-c41e3d816700 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:57.454863 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9da08ee7-93e8-4ded-b340-c41e3d816700 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.137312 Oct 29 01:20:57.455420 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 627/1267] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:57 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:57.695402 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-57138546-59f0-4080-8524-1e059ee72ee3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:57.696328 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-57138546-59f0-4080-8524-1e059ee72ee3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:57.702247 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-57138546-59f0-4080-8524-1e059ee72ee3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:57.702723 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-57138546-59f0-4080-8524-1e059ee72ee3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:57.703493 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-57138546-59f0-4080-8524-1e059ee72ee3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:57.703931 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-57138546-59f0-4080-8524-1e059ee72ee3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:57.732344 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-57138546-59f0-4080-8524-1e059ee72ee3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041399 Oct 29 01:20:57.732898 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 641/1268] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:57 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:58.328671 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c5b7c23f-dbd5-42c7-9efe-cfc8ce85e665 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:58.329214 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c5b7c23f-dbd5-42c7-9efe-cfc8ce85e665 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:58.335545 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c5b7c23f-dbd5-42c7-9efe-cfc8ce85e665 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:58.336001 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c5b7c23f-dbd5-42c7-9efe-cfc8ce85e665 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:58.336797 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c5b7c23f-dbd5-42c7-9efe-cfc8ce85e665 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:58.337504 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c5b7c23f-dbd5-42c7-9efe-cfc8ce85e665 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:58.396043 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c5b7c23f-dbd5-42c7-9efe-cfc8ce85e665 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:58.403483 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c5b7c23f-dbd5-42c7-9efe-cfc8ce85e665 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.078572 Oct 29 01:20:58.404036 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 628/1269] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:58 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:58.473357 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-24866105-38ef-4740-b7e8-b2638ed13b90 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:58.473951 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-24866105-38ef-4740-b7e8-b2638ed13b90 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:58.480164 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-24866105-38ef-4740-b7e8-b2638ed13b90 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:58.480614 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-24866105-38ef-4740-b7e8-b2638ed13b90 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:58.481382 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-24866105-38ef-4740-b7e8-b2638ed13b90 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:58.481815 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-24866105-38ef-4740-b7e8-b2638ed13b90 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:58.603658 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-24866105-38ef-4740-b7e8-b2638ed13b90 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:58.611189 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-24866105-38ef-4740-b7e8-b2638ed13b90 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.142206 Oct 29 01:20:58.611914 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 642/1270] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:58 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:58.743795 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-0dee7af9-a465-42e9-9a79-f9c8b7c2ff11 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:58.744704 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-0dee7af9-a465-42e9-9a79-f9c8b7c2ff11 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:58.750532 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0dee7af9-a465-42e9-9a79-f9c8b7c2ff11 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:58.750982 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0dee7af9-a465-42e9-9a79-f9c8b7c2ff11 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:58.752192 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0dee7af9-a465-42e9-9a79-f9c8b7c2ff11 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:58.752880 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0dee7af9-a465-42e9-9a79-f9c8b7c2ff11 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:58.781882 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-0dee7af9-a465-42e9-9a79-f9c8b7c2ff11 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041787 Oct 29 01:20:58.782650 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 629/1271] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:58 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:59.420924 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c30dff46-9bf0-43f1-8d46-5fa7751d62f9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:59.421532 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c30dff46-9bf0-43f1-8d46-5fa7751d62f9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:59.428038 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c30dff46-9bf0-43f1-8d46-5fa7751d62f9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:59.428490 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c30dff46-9bf0-43f1-8d46-5fa7751d62f9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:59.429283 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c30dff46-9bf0-43f1-8d46-5fa7751d62f9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:59.429718 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c30dff46-9bf0-43f1-8d46-5fa7751d62f9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:59.494101 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-c30dff46-9bf0-43f1-8d46-5fa7751d62f9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:59.501537 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c30dff46-9bf0-43f1-8d46-5fa7751d62f9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.084342 Oct 29 01:20:59.502104 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 643/1272] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:59 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:59.627376 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-445e9904-d3fd-4b24-a726-57acd45908d0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:59.627974 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-445e9904-d3fd-4b24-a726-57acd45908d0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:59.634172 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-445e9904-d3fd-4b24-a726-57acd45908d0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:59.634946 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-445e9904-d3fd-4b24-a726-57acd45908d0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:59.635441 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-445e9904-d3fd-4b24-a726-57acd45908d0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:59.635871 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-445e9904-d3fd-4b24-a726-57acd45908d0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:59.754348 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-445e9904-d3fd-4b24-a726-57acd45908d0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:59.761690 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-445e9904-d3fd-4b24-a726-57acd45908d0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.137952 Oct 29 01:20:59.762249 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 630/1273] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:20:59 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:59.793308 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-88e36d93-3387-4f27-9d77-c58b6f04ef7f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:59.794218 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-88e36d93-3387-4f27-9d77-c58b6f04ef7f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:20:59.800024 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-88e36d93-3387-4f27-9d77-c58b6f04ef7f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:59.801106 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-88e36d93-3387-4f27-9d77-c58b6f04ef7f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:59.801864 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-88e36d93-3387-4f27-9d77-c58b6f04ef7f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:59.802295 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-88e36d93-3387-4f27-9d77-c58b6f04ef7f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:59.835983 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-88e36d93-3387-4f27-9d77-c58b6f04ef7f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046429 Oct 29 01:20:59.836545 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 644/1274] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:20:59 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:00.518727 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-62cd217e-8eca-4101-ba90-e48fb8927f9b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:00.519339 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-62cd217e-8eca-4101-ba90-e48fb8927f9b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:00.525701 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-62cd217e-8eca-4101-ba90-e48fb8927f9b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:00.526147 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-62cd217e-8eca-4101-ba90-e48fb8927f9b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:00.526929 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-62cd217e-8eca-4101-ba90-e48fb8927f9b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:00.527358 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-62cd217e-8eca-4101-ba90-e48fb8927f9b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:00.585672 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-62cd217e-8eca-4101-ba90-e48fb8927f9b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:00.593438 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-62cd217e-8eca-4101-ba90-e48fb8927f9b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.078354 Oct 29 01:21:00.593992 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 631/1275] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:00 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:00.779596 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-459600c7-f083-420b-bcc2-062178a00b74 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:00.780117 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-459600c7-f083-420b-bcc2-062178a00b74 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:00.786290 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-459600c7-f083-420b-bcc2-062178a00b74 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:00.786765 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-459600c7-f083-420b-bcc2-062178a00b74 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:00.787521 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-459600c7-f083-420b-bcc2-062178a00b74 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:00.787948 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-459600c7-f083-420b-bcc2-062178a00b74 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:00.848063 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-58e30fd7-4c59-4f52-a2ca-e6114f26ae46 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:00.849139 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-58e30fd7-4c59-4f52-a2ca-e6114f26ae46 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:00.855771 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-58e30fd7-4c59-4f52-a2ca-e6114f26ae46 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:00.856415 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-58e30fd7-4c59-4f52-a2ca-e6114f26ae46 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:00.857191 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-58e30fd7-4c59-4f52-a2ca-e6114f26ae46 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:00.857628 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-58e30fd7-4c59-4f52-a2ca-e6114f26ae46 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:00.889966 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-58e30fd7-4c59-4f52-a2ca-e6114f26ae46 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045573 Oct 29 01:21:00.890531 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 632/1276] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:00 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:21:00.914723 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-459600c7-f083-420b-bcc2-062178a00b74 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:00.922122 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-459600c7-f083-420b-bcc2-062178a00b74 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.146619 Oct 29 01:21:00.922726 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 645/1277] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:00 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:01.609831 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c03b45cb-48b4-4f4b-91b7-46e45eb8a9cd tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:01.610459 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c03b45cb-48b4-4f4b-91b7-46e45eb8a9cd tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:01.616765 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c03b45cb-48b4-4f4b-91b7-46e45eb8a9cd tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:01.617215 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c03b45cb-48b4-4f4b-91b7-46e45eb8a9cd tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:01.617999 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c03b45cb-48b4-4f4b-91b7-46e45eb8a9cd tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:01.618764 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c03b45cb-48b4-4f4b-91b7-46e45eb8a9cd tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:01.676959 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c03b45cb-48b4-4f4b-91b7-46e45eb8a9cd tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:01.684337 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c03b45cb-48b4-4f4b-91b7-46e45eb8a9cd tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.078165 Oct 29 01:21:01.684878 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 633/1278] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:01 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:01.901043 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-4ced057e-0fd3-4384-9b4e-ba25f3bdadf9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:01.901964 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-4ced057e-0fd3-4384-9b4e-ba25f3bdadf9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:01.908204 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4ced057e-0fd3-4384-9b4e-ba25f3bdadf9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:01.908658 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4ced057e-0fd3-4384-9b4e-ba25f3bdadf9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:01.909428 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4ced057e-0fd3-4384-9b4e-ba25f3bdadf9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:01.910462 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4ced057e-0fd3-4384-9b4e-ba25f3bdadf9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:01.939358 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-4b92925e-e72c-4ed1-b191-e5ed173e41f4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:01.939963 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-4ced057e-0fd3-4384-9b4e-ba25f3bdadf9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042220 Oct 29 01:21:01.940066 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-4b92925e-e72c-4ed1-b191-e5ed173e41f4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:01.940167 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 646/1279] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:01 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:01.946182 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4b92925e-e72c-4ed1-b191-e5ed173e41f4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:01.946675 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4b92925e-e72c-4ed1-b191-e5ed173e41f4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:01.947451 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4b92925e-e72c-4ed1-b191-e5ed173e41f4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:01.947883 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4b92925e-e72c-4ed1-b191-e5ed173e41f4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:02.068270 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-4b92925e-e72c-4ed1-b191-e5ed173e41f4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:02.075841 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-4b92925e-e72c-4ed1-b191-e5ed173e41f4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.140061 Oct 29 01:21:02.076406 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 634/1280] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:01 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:21:02.701554 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-15497fd0-69da-43f1-94af-073cf714bfff tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:02.702157 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-15497fd0-69da-43f1-94af-073cf714bfff tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:02.708597 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-15497fd0-69da-43f1-94af-073cf714bfff tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:02.709036 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-15497fd0-69da-43f1-94af-073cf714bfff tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:02.709793 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-15497fd0-69da-43f1-94af-073cf714bfff tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:02.710222 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-15497fd0-69da-43f1-94af-073cf714bfff tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:02.772911 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-15497fd0-69da-43f1-94af-073cf714bfff tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:02.780248 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-15497fd0-69da-43f1-94af-073cf714bfff tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.082470 Oct 29 01:21:02.780803 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 647/1281] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:02 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:02.951048 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c3360c82-22ea-4fd9-bb88-114806aa72eb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:02.952065 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c3360c82-22ea-4fd9-bb88-114806aa72eb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:02.958462 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c3360c82-22ea-4fd9-bb88-114806aa72eb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:02.958913 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c3360c82-22ea-4fd9-bb88-114806aa72eb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:02.959689 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c3360c82-22ea-4fd9-bb88-114806aa72eb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:02.960131 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c3360c82-22ea-4fd9-bb88-114806aa72eb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:02.989087 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c3360c82-22ea-4fd9-bb88-114806aa72eb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041765 Oct 29 01:21:02.989632 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 635/1282] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:02 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:03.096386 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-4a8575ae-b87d-4b87-be95-0bf833113966 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:03.096997 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-4a8575ae-b87d-4b87-be95-0bf833113966 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:03.104166 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4a8575ae-b87d-4b87-be95-0bf833113966 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:03.104609 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4a8575ae-b87d-4b87-be95-0bf833113966 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:03.105369 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4a8575ae-b87d-4b87-be95-0bf833113966 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:03.105795 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4a8575ae-b87d-4b87-be95-0bf833113966 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:03.453413 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-4a8575ae-b87d-4b87-be95-0bf833113966 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:03.460699 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-4a8575ae-b87d-4b87-be95-0bf833113966 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.371145 Oct 29 01:21:03.461259 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 648/1283] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:03 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:03.796152 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-37d773ae-1a0d-4fe0-8968-c376e89a38b5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:03.796670 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-37d773ae-1a0d-4fe0-8968-c376e89a38b5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:03.802557 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-37d773ae-1a0d-4fe0-8968-c376e89a38b5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:03.802998 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-37d773ae-1a0d-4fe0-8968-c376e89a38b5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:03.803750 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-37d773ae-1a0d-4fe0-8968-c376e89a38b5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:03.804179 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-37d773ae-1a0d-4fe0-8968-c376e89a38b5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:03.865314 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-37d773ae-1a0d-4fe0-8968-c376e89a38b5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:03.872620 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-37d773ae-1a0d-4fe0-8968-c376e89a38b5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.080168 Oct 29 01:21:03.873178 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 636/1284] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:03 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:04.000396 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c2e804c6-0acc-4b07-8fb5-d32a06d0e4bf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:04.001868 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c2e804c6-0acc-4b07-8fb5-d32a06d0e4bf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:04.008327 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c2e804c6-0acc-4b07-8fb5-d32a06d0e4bf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:04.008772 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c2e804c6-0acc-4b07-8fb5-d32a06d0e4bf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:04.009609 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c2e804c6-0acc-4b07-8fb5-d32a06d0e4bf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:04.010039 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c2e804c6-0acc-4b07-8fb5-d32a06d0e4bf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:04.039067 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c2e804c6-0acc-4b07-8fb5-d32a06d0e4bf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042387 Oct 29 01:21:04.039624 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 649/1285] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:03 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:04.477122 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f87bfac2-6e4f-41ef-8c2f-5663ea005e59 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:04.477722 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f87bfac2-6e4f-41ef-8c2f-5663ea005e59 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:04.483541 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f87bfac2-6e4f-41ef-8c2f-5663ea005e59 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:04.483980 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f87bfac2-6e4f-41ef-8c2f-5663ea005e59 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:04.484731 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f87bfac2-6e4f-41ef-8c2f-5663ea005e59 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:04.485157 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f87bfac2-6e4f-41ef-8c2f-5663ea005e59 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:04.604000 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-f87bfac2-6e4f-41ef-8c2f-5663ea005e59 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:04.611245 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f87bfac2-6e4f-41ef-8c2f-5663ea005e59 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.137815 Oct 29 01:21:04.611803 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 637/1286] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:04 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:04.888973 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-ea9abd34-e5fc-43df-8537-a2dade6b25fd tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:04.890041 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-ea9abd34-e5fc-43df-8537-a2dade6b25fd tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:04.895771 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ea9abd34-e5fc-43df-8537-a2dade6b25fd tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:04.896221 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ea9abd34-e5fc-43df-8537-a2dade6b25fd tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:04.896991 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ea9abd34-e5fc-43df-8537-a2dade6b25fd tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:04.897428 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ea9abd34-e5fc-43df-8537-a2dade6b25fd tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:04.958872 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-ea9abd34-e5fc-43df-8537-a2dade6b25fd tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:04.966313 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-ea9abd34-e5fc-43df-8537-a2dade6b25fd tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.081118 Oct 29 01:21:04.966916 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 650/1287] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:04 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:05.051210 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-1a026085-efeb-43fc-ad75-a73e95e08b6d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:05.052128 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-1a026085-efeb-43fc-ad75-a73e95e08b6d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:05.058477 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1a026085-efeb-43fc-ad75-a73e95e08b6d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:05.058929 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1a026085-efeb-43fc-ad75-a73e95e08b6d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:05.059735 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1a026085-efeb-43fc-ad75-a73e95e08b6d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:05.060185 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1a026085-efeb-43fc-ad75-a73e95e08b6d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:05.089898 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-1a026085-efeb-43fc-ad75-a73e95e08b6d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043132 Oct 29 01:21:05.090481 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 638/1288] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:05 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:05.628913 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-36d73683-de5b-466b-af8c-bf726b7103af tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:05.629511 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-36d73683-de5b-466b-af8c-bf726b7103af tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:05.635506 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-36d73683-de5b-466b-af8c-bf726b7103af tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:05.635949 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-36d73683-de5b-466b-af8c-bf726b7103af tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:05.636715 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-36d73683-de5b-466b-af8c-bf726b7103af tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:05.637145 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-36d73683-de5b-466b-af8c-bf726b7103af tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:05.759807 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-36d73683-de5b-466b-af8c-bf726b7103af tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:05.767811 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-36d73683-de5b-466b-af8c-bf726b7103af tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.142459 Oct 29 01:21:05.768396 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 651/1289] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:05 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:05.983443 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b9c6c322-cddd-45d6-aeb8-312af2f602a7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:05.984039 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b9c6c322-cddd-45d6-aeb8-312af2f602a7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:05.990068 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b9c6c322-cddd-45d6-aeb8-312af2f602a7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:05.990572 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b9c6c322-cddd-45d6-aeb8-312af2f602a7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:05.991354 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b9c6c322-cddd-45d6-aeb8-312af2f602a7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:05.991795 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b9c6c322-cddd-45d6-aeb8-312af2f602a7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:06.053070 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-b9c6c322-cddd-45d6-aeb8-312af2f602a7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:06.061192 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b9c6c322-cddd-45d6-aeb8-312af2f602a7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.081410 Oct 29 01:21:06.061766 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 639/1290] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:05 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:06.102333 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-85f64653-7716-4a0d-bbde-4f5d6b888151 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:06.103331 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-85f64653-7716-4a0d-bbde-4f5d6b888151 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:06.109840 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-85f64653-7716-4a0d-bbde-4f5d6b888151 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:06.110294 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-85f64653-7716-4a0d-bbde-4f5d6b888151 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:06.111117 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-85f64653-7716-4a0d-bbde-4f5d6b888151 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:06.111553 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-85f64653-7716-4a0d-bbde-4f5d6b888151 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:06.142634 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-85f64653-7716-4a0d-bbde-4f5d6b888151 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044010 Oct 29 01:21:06.143229 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 652/1291] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:06 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:06.785948 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-add01374-4857-4cdc-b296-d08a85420c12 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:06.786746 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-add01374-4857-4cdc-b296-d08a85420c12 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:06.793028 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-add01374-4857-4cdc-b296-d08a85420c12 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:06.793473 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-add01374-4857-4cdc-b296-d08a85420c12 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:06.794240 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-add01374-4857-4cdc-b296-d08a85420c12 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:06.794697 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-add01374-4857-4cdc-b296-d08a85420c12 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:06.915402 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-add01374-4857-4cdc-b296-d08a85420c12 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:06.922649 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-add01374-4857-4cdc-b296-d08a85420c12 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.141094 Oct 29 01:21:06.923201 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 640/1292] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:06 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:07.077649 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-4d240247-6a94-4540-bdd1-8b72e598d023 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:07.078175 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-4d240247-6a94-4540-bdd1-8b72e598d023 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:07.084232 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4d240247-6a94-4540-bdd1-8b72e598d023 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:07.084684 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4d240247-6a94-4540-bdd1-8b72e598d023 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:07.085458 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4d240247-6a94-4540-bdd1-8b72e598d023 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:07.085896 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4d240247-6a94-4540-bdd1-8b72e598d023 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:07.154575 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-4d240247-6a94-4540-bdd1-8b72e598d023 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:07.155224 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-39db6ccb-deea-4ad6-a931-c0dcff995af2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:07.155786 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-39db6ccb-deea-4ad6-a931-c0dcff995af2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:07.162947 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-39db6ccb-deea-4ad6-a931-c0dcff995af2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:07.163405 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-39db6ccb-deea-4ad6-a931-c0dcff995af2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:07.163940 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-4d240247-6a94-4540-bdd1-8b72e598d023 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.089978 Oct 29 01:21:07.164194 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-39db6ccb-deea-4ad6-a931-c0dcff995af2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:07.164550 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 653/1293] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:07 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:07.164792 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-39db6ccb-deea-4ad6-a931-c0dcff995af2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:07.197320 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-39db6ccb-deea-4ad6-a931-c0dcff995af2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046357 Oct 29 01:21:07.197884 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 641/1294] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:07 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:07.940244 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-7d01defe-a135-482a-97d1-9d8966510542 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:07.941401 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-7d01defe-a135-482a-97d1-9d8966510542 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:07.947382 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7d01defe-a135-482a-97d1-9d8966510542 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:07.947830 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7d01defe-a135-482a-97d1-9d8966510542 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:07.948604 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7d01defe-a135-482a-97d1-9d8966510542 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:07.949041 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7d01defe-a135-482a-97d1-9d8966510542 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:08.069785 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-7d01defe-a135-482a-97d1-9d8966510542 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:08.077237 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-7d01defe-a135-482a-97d1-9d8966510542 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.140669 Oct 29 01:21:08.077803 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 654/1295] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:07 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:08.181100 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-6c747d16-7115-4ea8-ba6c-7bd900afe733 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:08.181656 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-6c747d16-7115-4ea8-ba6c-7bd900afe733 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:08.188013 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6c747d16-7115-4ea8-ba6c-7bd900afe733 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:08.188467 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6c747d16-7115-4ea8-ba6c-7bd900afe733 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:08.189238 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6c747d16-7115-4ea8-ba6c-7bd900afe733 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:08.189674 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6c747d16-7115-4ea8-ba6c-7bd900afe733 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:08.208879 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-fcbb4a47-44aa-4093-b55d-f50b4f5c8298 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:08.209803 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-fcbb4a47-44aa-4093-b55d-f50b4f5c8298 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:08.216441 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fcbb4a47-44aa-4093-b55d-f50b4f5c8298 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:08.216900 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fcbb4a47-44aa-4093-b55d-f50b4f5c8298 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:08.217668 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fcbb4a47-44aa-4093-b55d-f50b4f5c8298 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:08.218097 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fcbb4a47-44aa-4093-b55d-f50b4f5c8298 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:08.249868 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-fcbb4a47-44aa-4093-b55d-f50b4f5c8298 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044070 Oct 29 01:21:08.250183 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 655/1296] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:08 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:21:08.251737 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-6c747d16-7115-4ea8-ba6c-7bd900afe733 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:08.259836 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-6c747d16-7115-4ea8-ba6c-7bd900afe733 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.082448 Oct 29 01:21:08.260393 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 642/1297] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:08 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:09.095257 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-ad955078-8b9c-41a5-ba05-97665a687fdb tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:09.095873 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-ad955078-8b9c-41a5-ba05-97665a687fdb tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:09.101906 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ad955078-8b9c-41a5-ba05-97665a687fdb tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:09.102403 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ad955078-8b9c-41a5-ba05-97665a687fdb tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:09.103298 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ad955078-8b9c-41a5-ba05-97665a687fdb tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:09.103733 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ad955078-8b9c-41a5-ba05-97665a687fdb tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:09.227597 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-ad955078-8b9c-41a5-ba05-97665a687fdb tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:09.235708 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-ad955078-8b9c-41a5-ba05-97665a687fdb tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.144222 Oct 29 01:21:09.236280 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 656/1298] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:09 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:09.260134 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d1b4f9d5-a6fc-458b-9644-aa81b6c03a73 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:09.261075 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d1b4f9d5-a6fc-458b-9644-aa81b6c03a73 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:09.267226 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d1b4f9d5-a6fc-458b-9644-aa81b6c03a73 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:09.267670 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d1b4f9d5-a6fc-458b-9644-aa81b6c03a73 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:09.268431 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d1b4f9d5-a6fc-458b-9644-aa81b6c03a73 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:09.268866 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d1b4f9d5-a6fc-458b-9644-aa81b6c03a73 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:09.275988 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-3ab33fb8-722d-4a5e-b7c3-34d6d96e7bdf tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:09.276605 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-3ab33fb8-722d-4a5e-b7c3-34d6d96e7bdf tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:09.282411 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3ab33fb8-722d-4a5e-b7c3-34d6d96e7bdf tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:09.282892 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3ab33fb8-722d-4a5e-b7c3-34d6d96e7bdf tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:09.283671 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3ab33fb8-722d-4a5e-b7c3-34d6d96e7bdf tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:09.284111 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3ab33fb8-722d-4a5e-b7c3-34d6d96e7bdf tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:09.298536 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d1b4f9d5-a6fc-458b-9644-aa81b6c03a73 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042023 Oct 29 01:21:09.299297 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 643/1299] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:09 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:09.344275 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-3ab33fb8-722d-4a5e-b7c3-34d6d96e7bdf tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:09.351933 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-3ab33fb8-722d-4a5e-b7c3-34d6d96e7bdf tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.079559 Oct 29 01:21:09.352492 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 657/1300] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:09 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:21:10.253071 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-1c26382b-c162-4dcd-be07-25d1c9537626 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:10.253574 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-1c26382b-c162-4dcd-be07-25d1c9537626 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:10.259487 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1c26382b-c162-4dcd-be07-25d1c9537626 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:10.259939 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1c26382b-c162-4dcd-be07-25d1c9537626 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:10.260704 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1c26382b-c162-4dcd-be07-25d1c9537626 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:10.261270 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1c26382b-c162-4dcd-be07-25d1c9537626 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:10.310464 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-3c536bb1-2208-4a33-8a03-69129a74af0d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:10.311390 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-3c536bb1-2208-4a33-8a03-69129a74af0d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:10.317537 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3c536bb1-2208-4a33-8a03-69129a74af0d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:10.317987 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3c536bb1-2208-4a33-8a03-69129a74af0d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:10.318789 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3c536bb1-2208-4a33-8a03-69129a74af0d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:10.319227 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3c536bb1-2208-4a33-8a03-69129a74af0d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:10.349859 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-3c536bb1-2208-4a33-8a03-69129a74af0d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043102 Oct 29 01:21:10.350448 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 658/1301] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:10 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:21:10.369262 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c39d67c7-2e53-4981-8bae-e8baed5e35c9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:10.369873 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c39d67c7-2e53-4981-8bae-e8baed5e35c9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:10.375642 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c39d67c7-2e53-4981-8bae-e8baed5e35c9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:10.376091 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c39d67c7-2e53-4981-8bae-e8baed5e35c9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:10.376864 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c39d67c7-2e53-4981-8bae-e8baed5e35c9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:10.377301 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c39d67c7-2e53-4981-8bae-e8baed5e35c9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:10.380532 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-1c26382b-c162-4dcd-be07-25d1c9537626 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:10.388065 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-1c26382b-c162-4dcd-be07-25d1c9537626 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.138745 Oct 29 01:21:10.388628 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 644/1302] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:10 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:10.436230 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-c39d67c7-2e53-4981-8bae-e8baed5e35c9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:10.444966 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c39d67c7-2e53-4981-8bae-e8baed5e35c9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.079322 Oct 29 01:21:10.445536 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 659/1303] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:10 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:21:11.360204 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-653dc307-3c54-46e5-8d3b-33e987b67ed2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:11.361124 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-653dc307-3c54-46e5-8d3b-33e987b67ed2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:11.367866 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-653dc307-3c54-46e5-8d3b-33e987b67ed2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:11.368411 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-653dc307-3c54-46e5-8d3b-33e987b67ed2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:11.369241 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-653dc307-3c54-46e5-8d3b-33e987b67ed2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:11.369681 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-653dc307-3c54-46e5-8d3b-33e987b67ed2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:11.398514 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-653dc307-3c54-46e5-8d3b-33e987b67ed2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042064 Oct 29 01:21:11.399071 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 645/1304] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:11 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:11.405025 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-123f2f28-b3a3-4964-9b7c-664e236d5338 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:11.405656 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-123f2f28-b3a3-4964-9b7c-664e236d5338 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:11.411851 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-123f2f28-b3a3-4964-9b7c-664e236d5338 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:11.412300 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-123f2f28-b3a3-4964-9b7c-664e236d5338 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:11.413061 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-123f2f28-b3a3-4964-9b7c-664e236d5338 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:11.413492 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-123f2f28-b3a3-4964-9b7c-664e236d5338 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:11.463398 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f71df995-68d2-46d8-bc13-466808e55d69 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:11.464013 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f71df995-68d2-46d8-bc13-466808e55d69 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:11.469818 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f71df995-68d2-46d8-bc13-466808e55d69 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:11.470272 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f71df995-68d2-46d8-bc13-466808e55d69 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:11.471071 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f71df995-68d2-46d8-bc13-466808e55d69 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:11.471543 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f71df995-68d2-46d8-bc13-466808e55d69 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:11.541427 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-f71df995-68d2-46d8-bc13-466808e55d69 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:11.548633 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f71df995-68d2-46d8-bc13-466808e55d69 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.089163 Oct 29 01:21:11.549195 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 646/1305] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:11 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:21:11.559369 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-123f2f28-b3a3-4964-9b7c-664e236d5338 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:11.566713 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-123f2f28-b3a3-4964-9b7c-664e236d5338 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.165323 Oct 29 01:21:11.567271 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 660/1306] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:11 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:21:12.410599 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f78040c5-81ef-4b0d-8031-d9c61def40fb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:12.411555 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f78040c5-81ef-4b0d-8031-d9c61def40fb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:12.417753 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f78040c5-81ef-4b0d-8031-d9c61def40fb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:12.418190 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f78040c5-81ef-4b0d-8031-d9c61def40fb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:12.418976 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f78040c5-81ef-4b0d-8031-d9c61def40fb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:12.419403 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f78040c5-81ef-4b0d-8031-d9c61def40fb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:12.447941 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f78040c5-81ef-4b0d-8031-d9c61def40fb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041629 Oct 29 01:21:12.448478 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 647/1307] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:12 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:21:12.566167 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-b26c48a7-54ae-43f4-a753-6a409bf62832 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:12.566898 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-b26c48a7-54ae-43f4-a753-6a409bf62832 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:12.573157 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b26c48a7-54ae-43f4-a753-6a409bf62832 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:12.573597 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b26c48a7-54ae-43f4-a753-6a409bf62832 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:12.574350 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b26c48a7-54ae-43f4-a753-6a409bf62832 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:12.574805 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b26c48a7-54ae-43f4-a753-6a409bf62832 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:12.583580 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-52f812b1-51fa-4a97-a79f-ef9b0939c4b0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:12.584196 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-52f812b1-51fa-4a97-a79f-ef9b0939c4b0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:12.590461 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-52f812b1-51fa-4a97-a79f-ef9b0939c4b0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:12.590915 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-52f812b1-51fa-4a97-a79f-ef9b0939c4b0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:12.591719 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-52f812b1-51fa-4a97-a79f-ef9b0939c4b0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:12.592160 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-52f812b1-51fa-4a97-a79f-ef9b0939c4b0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:12.648836 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-b26c48a7-54ae-43f4-a753-6a409bf62832 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:12.656750 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-b26c48a7-54ae-43f4-a753-6a409bf62832 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.094317 Oct 29 01:21:12.657312 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 661/1308] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:12 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:12.729971 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-52f812b1-51fa-4a97-a79f-ef9b0939c4b0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:12.737410 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-52f812b1-51fa-4a97-a79f-ef9b0939c4b0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.157477 Oct 29 01:21:12.738500 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 648/1309] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:12 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:21:13.459786 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-ff289268-15e9-4c8f-acca-50357c18b05c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:13.460729 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-ff289268-15e9-4c8f-acca-50357c18b05c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:13.466839 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ff289268-15e9-4c8f-acca-50357c18b05c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:13.467286 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ff289268-15e9-4c8f-acca-50357c18b05c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:13.468048 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ff289268-15e9-4c8f-acca-50357c18b05c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:13.468484 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ff289268-15e9-4c8f-acca-50357c18b05c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:13.497468 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-ff289268-15e9-4c8f-acca-50357c18b05c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042013 Oct 29 01:21:13.498019 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 662/1310] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:13 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:13.673894 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f0bfdc0e-e9cc-4729-821f-2e3cccff27c4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:13.674529 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f0bfdc0e-e9cc-4729-821f-2e3cccff27c4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:13.680736 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f0bfdc0e-e9cc-4729-821f-2e3cccff27c4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:13.681184 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f0bfdc0e-e9cc-4729-821f-2e3cccff27c4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:13.681948 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f0bfdc0e-e9cc-4729-821f-2e3cccff27c4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:13.682380 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f0bfdc0e-e9cc-4729-821f-2e3cccff27c4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:13.742361 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-f0bfdc0e-e9cc-4729-821f-2e3cccff27c4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:13.749661 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f0bfdc0e-e9cc-4729-821f-2e3cccff27c4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.079480 Oct 29 01:21:13.750216 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 649/1311] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:13 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:13.755244 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-eaf70caa-6c36-403e-95d5-ec6a2d481657 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:13.755854 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-eaf70caa-6c36-403e-95d5-ec6a2d481657 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:13.762184 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-eaf70caa-6c36-403e-95d5-ec6a2d481657 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:13.762674 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-eaf70caa-6c36-403e-95d5-ec6a2d481657 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:13.763447 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-eaf70caa-6c36-403e-95d5-ec6a2d481657 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:13.763876 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-eaf70caa-6c36-403e-95d5-ec6a2d481657 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:13.883253 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-eaf70caa-6c36-403e-95d5-ec6a2d481657 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:13.890922 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-eaf70caa-6c36-403e-95d5-ec6a2d481657 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.139897 Oct 29 01:21:13.891478 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 663/1312] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:13 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:14.509719 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b4bbc048-eb53-474c-8140-008e320fe4a9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:14.510682 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b4bbc048-eb53-474c-8140-008e320fe4a9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:14.516543 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b4bbc048-eb53-474c-8140-008e320fe4a9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:14.516997 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b4bbc048-eb53-474c-8140-008e320fe4a9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:14.517776 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b4bbc048-eb53-474c-8140-008e320fe4a9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:14.518215 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b4bbc048-eb53-474c-8140-008e320fe4a9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:14.547254 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b4bbc048-eb53-474c-8140-008e320fe4a9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041340 Oct 29 01:21:14.547805 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 650/1313] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:14 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:14.766674 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-39a277c0-9764-40fb-851e-44d1602d4916 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:14.767237 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-39a277c0-9764-40fb-851e-44d1602d4916 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:14.773999 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-39a277c0-9764-40fb-851e-44d1602d4916 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:14.774469 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-39a277c0-9764-40fb-851e-44d1602d4916 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:14.775229 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-39a277c0-9764-40fb-851e-44d1602d4916 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:14.775656 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-39a277c0-9764-40fb-851e-44d1602d4916 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:14.835829 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-39a277c0-9764-40fb-851e-44d1602d4916 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:14.843461 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-39a277c0-9764-40fb-851e-44d1602d4916 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.080528 Oct 29 01:21:14.844013 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 664/1314] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:14 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:14.908509 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-cc353a5d-4c67-4a31-b07d-38f36ff5863c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:14.909113 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-cc353a5d-4c67-4a31-b07d-38f36ff5863c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:14.915382 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cc353a5d-4c67-4a31-b07d-38f36ff5863c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:14.915820 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cc353a5d-4c67-4a31-b07d-38f36ff5863c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:14.916570 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cc353a5d-4c67-4a31-b07d-38f36ff5863c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:14.916997 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cc353a5d-4c67-4a31-b07d-38f36ff5863c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:15.046092 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-cc353a5d-4c67-4a31-b07d-38f36ff5863c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:15.053870 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-cc353a5d-4c67-4a31-b07d-38f36ff5863c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.149029 Oct 29 01:21:15.054449 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 651/1315] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:14 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:15.558745 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-34c0b0f2-e3ba-4b1d-ba96-73e6d18350b9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:15.559658 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-34c0b0f2-e3ba-4b1d-ba96-73e6d18350b9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:15.565459 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-34c0b0f2-e3ba-4b1d-ba96-73e6d18350b9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:15.565907 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-34c0b0f2-e3ba-4b1d-ba96-73e6d18350b9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:15.566682 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-34c0b0f2-e3ba-4b1d-ba96-73e6d18350b9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:15.567113 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-34c0b0f2-e3ba-4b1d-ba96-73e6d18350b9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:15.595455 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-34c0b0f2-e3ba-4b1d-ba96-73e6d18350b9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040300 Oct 29 01:21:15.596034 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 665/1316] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:15 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:15.859907 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-4ad82ece-fd18-4145-ba2c-427e7b731685 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:15.860516 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-4ad82ece-fd18-4145-ba2c-427e7b731685 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:15.866371 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4ad82ece-fd18-4145-ba2c-427e7b731685 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:15.866851 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4ad82ece-fd18-4145-ba2c-427e7b731685 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:15.867610 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4ad82ece-fd18-4145-ba2c-427e7b731685 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:15.868042 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4ad82ece-fd18-4145-ba2c-427e7b731685 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:15.927834 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-4ad82ece-fd18-4145-ba2c-427e7b731685 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:15.935292 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-4ad82ece-fd18-4145-ba2c-427e7b731685 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.079077 Oct 29 01:21:15.935853 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 652/1317] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:15 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:16.071334 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-ca82b6e7-d5fb-4b1b-bacc-83820a91d973 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:16.071925 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-ca82b6e7-d5fb-4b1b-bacc-83820a91d973 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:16.078135 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ca82b6e7-d5fb-4b1b-bacc-83820a91d973 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:16.078622 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ca82b6e7-d5fb-4b1b-bacc-83820a91d973 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:16.079388 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ca82b6e7-d5fb-4b1b-bacc-83820a91d973 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:16.079823 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ca82b6e7-d5fb-4b1b-bacc-83820a91d973 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:16.200660 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-ca82b6e7-d5fb-4b1b-bacc-83820a91d973 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:16.208571 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-ca82b6e7-d5fb-4b1b-bacc-83820a91d973 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.140928 Oct 29 01:21:16.209138 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 666/1318] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:16 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:16.607540 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-3e05850d-f764-4556-aebd-849f1fc38098 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:16.608470 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-3e05850d-f764-4556-aebd-849f1fc38098 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:16.614767 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3e05850d-f764-4556-aebd-849f1fc38098 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:16.615217 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3e05850d-f764-4556-aebd-849f1fc38098 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:16.615982 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3e05850d-f764-4556-aebd-849f1fc38098 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:16.616421 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3e05850d-f764-4556-aebd-849f1fc38098 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:16.645423 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-3e05850d-f764-4556-aebd-849f1fc38098 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041621 Oct 29 01:21:16.645971 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 653/1319] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:16 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:16.951778 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2e95e101-c4bf-4fa6-b0c2-2eda703d26df tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:16.952308 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2e95e101-c4bf-4fa6-b0c2-2eda703d26df tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:16.958482 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2e95e101-c4bf-4fa6-b0c2-2eda703d26df tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:16.958934 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2e95e101-c4bf-4fa6-b0c2-2eda703d26df tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:16.959703 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2e95e101-c4bf-4fa6-b0c2-2eda703d26df tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:16.960138 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2e95e101-c4bf-4fa6-b0c2-2eda703d26df tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:17.020193 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-2e95e101-c4bf-4fa6-b0c2-2eda703d26df tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:17.027499 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2e95e101-c4bf-4fa6-b0c2-2eda703d26df tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.079464 Oct 29 01:21:17.028047 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 667/1320] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:16 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:17.226911 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-276e5b39-e072-434a-9c68-dfbdd58c91b6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:17.227537 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-276e5b39-e072-434a-9c68-dfbdd58c91b6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:17.233544 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-276e5b39-e072-434a-9c68-dfbdd58c91b6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:17.233987 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-276e5b39-e072-434a-9c68-dfbdd58c91b6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:17.234768 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-276e5b39-e072-434a-9c68-dfbdd58c91b6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:17.235199 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-276e5b39-e072-434a-9c68-dfbdd58c91b6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:17.356331 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-276e5b39-e072-434a-9c68-dfbdd58c91b6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:17.363735 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-276e5b39-e072-434a-9c68-dfbdd58c91b6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.140528 Oct 29 01:21:17.364292 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 654/1321] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:17 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:17.656976 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-7c00cd83-63eb-42ee-b359-b10972104a5f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:17.657896 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-7c00cd83-63eb-42ee-b359-b10972104a5f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:17.664164 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7c00cd83-63eb-42ee-b359-b10972104a5f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:17.664690 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7c00cd83-63eb-42ee-b359-b10972104a5f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:17.665461 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7c00cd83-63eb-42ee-b359-b10972104a5f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:17.665902 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7c00cd83-63eb-42ee-b359-b10972104a5f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:17.694891 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-7c00cd83-63eb-42ee-b359-b10972104a5f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041698 Oct 29 01:21:17.695501 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 668/1322] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:17 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:18.044744 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-59970cd5-6d58-435d-8f36-cdbc3e7e9b05 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:18.045345 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-59970cd5-6d58-435d-8f36-cdbc3e7e9b05 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:18.051614 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-59970cd5-6d58-435d-8f36-cdbc3e7e9b05 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:18.052053 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-59970cd5-6d58-435d-8f36-cdbc3e7e9b05 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:18.052803 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-59970cd5-6d58-435d-8f36-cdbc3e7e9b05 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:18.053231 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-59970cd5-6d58-435d-8f36-cdbc3e7e9b05 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:18.112177 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-59970cd5-6d58-435d-8f36-cdbc3e7e9b05 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:18.119899 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-59970cd5-6d58-435d-8f36-cdbc3e7e9b05 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.078870 Oct 29 01:21:18.120453 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 655/1323] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:18 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:21:18.380646 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-02630c91-7e7a-4190-86de-dab13a403615 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:18.381253 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-02630c91-7e7a-4190-86de-dab13a403615 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:18.387151 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-02630c91-7e7a-4190-86de-dab13a403615 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:18.387604 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-02630c91-7e7a-4190-86de-dab13a403615 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:18.388374 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-02630c91-7e7a-4190-86de-dab13a403615 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:18.388820 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-02630c91-7e7a-4190-86de-dab13a403615 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:18.509633 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-02630c91-7e7a-4190-86de-dab13a403615 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:18.520708 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-02630c91-7e7a-4190-86de-dab13a403615 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.143689 Oct 29 01:21:18.521284 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 669/1324] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:18 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:18.705588 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b0eeed53-1ae4-4a0d-829c-e5233337f171 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:18.707018 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b0eeed53-1ae4-4a0d-829c-e5233337f171 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:18.713539 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b0eeed53-1ae4-4a0d-829c-e5233337f171 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:18.713990 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b0eeed53-1ae4-4a0d-829c-e5233337f171 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:18.714792 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b0eeed53-1ae4-4a0d-829c-e5233337f171 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:18.715227 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b0eeed53-1ae4-4a0d-829c-e5233337f171 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:18.744874 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b0eeed53-1ae4-4a0d-829c-e5233337f171 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043106 Oct 29 01:21:18.745440 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 656/1325] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:18 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:19.137109 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-cb4e921f-f4ed-4d61-883a-f97313d3b0f7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:19.137724 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-cb4e921f-f4ed-4d61-883a-f97313d3b0f7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:19.144581 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cb4e921f-f4ed-4d61-883a-f97313d3b0f7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:19.145033 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cb4e921f-f4ed-4d61-883a-f97313d3b0f7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:19.145797 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cb4e921f-f4ed-4d61-883a-f97313d3b0f7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:19.146234 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cb4e921f-f4ed-4d61-883a-f97313d3b0f7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:19.206055 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-cb4e921f-f4ed-4d61-883a-f97313d3b0f7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:19.214435 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-cb4e921f-f4ed-4d61-883a-f97313d3b0f7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.081212 Oct 29 01:21:19.214936 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 670/1326] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:19 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:19.540305 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-eb7ffc86-2502-442c-9499-07190561a468 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:19.540705 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-eb7ffc86-2502-442c-9499-07190561a468 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:19.546912 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-eb7ffc86-2502-442c-9499-07190561a468 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:19.547362 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-eb7ffc86-2502-442c-9499-07190561a468 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:19.548144 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-eb7ffc86-2502-442c-9499-07190561a468 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:19.548581 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-eb7ffc86-2502-442c-9499-07190561a468 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:19.673580 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-eb7ffc86-2502-442c-9499-07190561a468 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:19.681841 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-eb7ffc86-2502-442c-9499-07190561a468 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.145391 Oct 29 01:21:19.682697 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 657/1327] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:19 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:19.757159 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-5f932d92-4969-4e46-99f7-dea7195f8ca6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:19.758083 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-5f932d92-4969-4e46-99f7-dea7195f8ca6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:19.764258 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5f932d92-4969-4e46-99f7-dea7195f8ca6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:19.764704 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5f932d92-4969-4e46-99f7-dea7195f8ca6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:19.765477 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5f932d92-4969-4e46-99f7-dea7195f8ca6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:19.765909 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5f932d92-4969-4e46-99f7-dea7195f8ca6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:19.797498 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-5f932d92-4969-4e46-99f7-dea7195f8ca6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044774 Oct 29 01:21:19.797966 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 671/1328] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:19 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:20.230985 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-0097c3b2-70ea-45f7-a3b4-0b5c984cf774 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:20.231662 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-0097c3b2-70ea-45f7-a3b4-0b5c984cf774 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:20.238322 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0097c3b2-70ea-45f7-a3b4-0b5c984cf774 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:20.238808 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0097c3b2-70ea-45f7-a3b4-0b5c984cf774 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:20.239621 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0097c3b2-70ea-45f7-a3b4-0b5c984cf774 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:20.240060 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0097c3b2-70ea-45f7-a3b4-0b5c984cf774 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:20.302120 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-0097c3b2-70ea-45f7-a3b4-0b5c984cf774 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:20.309774 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-0097c3b2-70ea-45f7-a3b4-0b5c984cf774 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.082434 Oct 29 01:21:20.310362 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 658/1329] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:20 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:20.699853 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-7e7dcbc4-57eb-4603-a587-bfdc86d5dd76 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:20.700473 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-7e7dcbc4-57eb-4603-a587-bfdc86d5dd76 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:20.707516 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7e7dcbc4-57eb-4603-a587-bfdc86d5dd76 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:20.707963 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7e7dcbc4-57eb-4603-a587-bfdc86d5dd76 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:20.708736 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7e7dcbc4-57eb-4603-a587-bfdc86d5dd76 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:20.709165 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7e7dcbc4-57eb-4603-a587-bfdc86d5dd76 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:20.809664 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-520d759f-1c2b-459e-ab5b-4bb2e0f2a8f1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:20.810630 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-520d759f-1c2b-459e-ab5b-4bb2e0f2a8f1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:20.817321 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-520d759f-1c2b-459e-ab5b-4bb2e0f2a8f1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:20.817763 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-520d759f-1c2b-459e-ab5b-4bb2e0f2a8f1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:20.818575 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-520d759f-1c2b-459e-ab5b-4bb2e0f2a8f1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:20.819010 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-520d759f-1c2b-459e-ab5b-4bb2e0f2a8f1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:20.834711 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-7e7dcbc4-57eb-4603-a587-bfdc86d5dd76 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:20.842502 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-7e7dcbc4-57eb-4603-a587-bfdc86d5dd76 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.146358 Oct 29 01:21:20.843079 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 672/1330] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:20 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:20.850810 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-520d759f-1c2b-459e-ab5b-4bb2e0f2a8f1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044915 Oct 29 01:21:20.851390 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 659/1331] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:20 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:21:21.327230 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-1003cf7d-0b81-4701-ada1-938e880c8e0a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:21.327740 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-1003cf7d-0b81-4701-ada1-938e880c8e0a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:21.333612 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1003cf7d-0b81-4701-ada1-938e880c8e0a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:21.334057 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1003cf7d-0b81-4701-ada1-938e880c8e0a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:21.334925 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1003cf7d-0b81-4701-ada1-938e880c8e0a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:21.335364 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1003cf7d-0b81-4701-ada1-938e880c8e0a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:21.397278 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-1003cf7d-0b81-4701-ada1-938e880c8e0a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:21.404947 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-1003cf7d-0b81-4701-ada1-938e880c8e0a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.081917 Oct 29 01:21:21.405541 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 673/1332] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:21 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:21.859309 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-fd36f383-ede5-453f-9b15-04b66266099c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:21.859917 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-fd36f383-ede5-453f-9b15-04b66266099c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:21.862000 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-81685a6c-a964-4d8b-8909-01b268ea3a4d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:21.863460 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-81685a6c-a964-4d8b-8909-01b268ea3a4d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:21.867061 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fd36f383-ede5-453f-9b15-04b66266099c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:21.867512 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fd36f383-ede5-453f-9b15-04b66266099c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:21.868295 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fd36f383-ede5-453f-9b15-04b66266099c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:21.868729 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fd36f383-ede5-453f-9b15-04b66266099c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:21.869650 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-81685a6c-a964-4d8b-8909-01b268ea3a4d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:21.870101 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-81685a6c-a964-4d8b-8909-01b268ea3a4d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:21.870902 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-81685a6c-a964-4d8b-8909-01b268ea3a4d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:21.871336 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-81685a6c-a964-4d8b-8909-01b268ea3a4d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:21.901856 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-81685a6c-a964-4d8b-8909-01b268ea3a4d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043478 Oct 29 01:21:21.902449 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 674/1333] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:21 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:21:21.993273 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-fd36f383-ede5-453f-9b15-04b66266099c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:22.000776 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-fd36f383-ede5-453f-9b15-04b66266099c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.145139 Oct 29 01:21:22.001348 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 660/1334] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:21 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:22.422149 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-6ff8c965-3424-4851-89ed-55bfb90014c2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:22.422773 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-6ff8c965-3424-4851-89ed-55bfb90014c2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:22.428793 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6ff8c965-3424-4851-89ed-55bfb90014c2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:22.429235 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6ff8c965-3424-4851-89ed-55bfb90014c2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:22.429991 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6ff8c965-3424-4851-89ed-55bfb90014c2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:22.430447 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6ff8c965-3424-4851-89ed-55bfb90014c2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:22.490604 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-6ff8c965-3424-4851-89ed-55bfb90014c2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:22.498454 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-6ff8c965-3424-4851-89ed-55bfb90014c2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.080098 Oct 29 01:21:22.499028 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 675/1335] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:22 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:22.912820 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b0bff16f-4e57-4bb1-a0d1-43f3293be23c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:22.913730 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b0bff16f-4e57-4bb1-a0d1-43f3293be23c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:22.920082 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b0bff16f-4e57-4bb1-a0d1-43f3293be23c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:22.920525 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b0bff16f-4e57-4bb1-a0d1-43f3293be23c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:22.921287 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b0bff16f-4e57-4bb1-a0d1-43f3293be23c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:22.921715 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b0bff16f-4e57-4bb1-a0d1-43f3293be23c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:22.951869 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b0bff16f-4e57-4bb1-a0d1-43f3293be23c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042770 Oct 29 01:21:22.952436 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 661/1336] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:22 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:23.018360 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e96eb3e2-73b8-4a9c-a87e-6dd6344e2154 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:23.019071 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-e96eb3e2-73b8-4a9c-a87e-6dd6344e2154 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:23.026413 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e96eb3e2-73b8-4a9c-a87e-6dd6344e2154 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:23.027068 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e96eb3e2-73b8-4a9c-a87e-6dd6344e2154 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:23.027924 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e96eb3e2-73b8-4a9c-a87e-6dd6344e2154 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:23.028360 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e96eb3e2-73b8-4a9c-a87e-6dd6344e2154 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:23.154748 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-e96eb3e2-73b8-4a9c-a87e-6dd6344e2154 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:23.162329 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-e96eb3e2-73b8-4a9c-a87e-6dd6344e2154 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.147570 Oct 29 01:21:23.162982 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 676/1337] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:23 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:23.515170 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-0f14513a-1e7d-48c1-95c2-aaddbd8b27ed tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:23.515688 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-0f14513a-1e7d-48c1-95c2-aaddbd8b27ed tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:23.521557 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0f14513a-1e7d-48c1-95c2-aaddbd8b27ed tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:23.522004 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0f14513a-1e7d-48c1-95c2-aaddbd8b27ed tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:23.522798 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0f14513a-1e7d-48c1-95c2-aaddbd8b27ed tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:23.523230 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0f14513a-1e7d-48c1-95c2-aaddbd8b27ed tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:23.584700 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-0f14513a-1e7d-48c1-95c2-aaddbd8b27ed tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:23.592426 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-0f14513a-1e7d-48c1-95c2-aaddbd8b27ed tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.080970 Oct 29 01:21:23.593014 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 662/1338] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:23 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:23.963573 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-84080fcc-c006-49b6-898b-c7f811c54b95 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:23.964507 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-84080fcc-c006-49b6-898b-c7f811c54b95 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:23.970306 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-84080fcc-c006-49b6-898b-c7f811c54b95 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:23.970779 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-84080fcc-c006-49b6-898b-c7f811c54b95 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:23.971539 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-84080fcc-c006-49b6-898b-c7f811c54b95 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:23.971969 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-84080fcc-c006-49b6-898b-c7f811c54b95 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:24.001067 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-84080fcc-c006-49b6-898b-c7f811c54b95 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041490 Oct 29 01:21:24.001618 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 677/1339] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:23 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:24.179645 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-86bafb95-42a9-4d0a-b8b2-939fc7e766b6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:24.180329 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-86bafb95-42a9-4d0a-b8b2-939fc7e766b6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:24.186818 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-86bafb95-42a9-4d0a-b8b2-939fc7e766b6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:24.187266 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-86bafb95-42a9-4d0a-b8b2-939fc7e766b6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:24.188044 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-86bafb95-42a9-4d0a-b8b2-939fc7e766b6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:24.188458 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-86bafb95-42a9-4d0a-b8b2-939fc7e766b6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:24.307310 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-86bafb95-42a9-4d0a-b8b2-939fc7e766b6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:24.314570 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-86bafb95-42a9-4d0a-b8b2-939fc7e766b6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.138613 Oct 29 01:21:24.315131 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 663/1340] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:24 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:24.609096 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d2eac333-6430-4fc5-bc25-7805baab8ba3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:24.609694 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d2eac333-6430-4fc5-bc25-7805baab8ba3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:24.617071 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d2eac333-6430-4fc5-bc25-7805baab8ba3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:24.617517 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d2eac333-6430-4fc5-bc25-7805baab8ba3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:24.618277 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d2eac333-6430-4fc5-bc25-7805baab8ba3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:24.618731 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d2eac333-6430-4fc5-bc25-7805baab8ba3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:24.677433 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-d2eac333-6430-4fc5-bc25-7805baab8ba3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:24.684991 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d2eac333-6430-4fc5-bc25-7805baab8ba3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.079541 Oct 29 01:21:24.685541 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 678/1341] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:24 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:25.013056 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9a06cf18-c6ce-4756-a5b1-57504bb85062 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:25.013975 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9a06cf18-c6ce-4756-a5b1-57504bb85062 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:25.020475 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9a06cf18-c6ce-4756-a5b1-57504bb85062 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:25.020920 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9a06cf18-c6ce-4756-a5b1-57504bb85062 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:25.021675 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9a06cf18-c6ce-4756-a5b1-57504bb85062 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:25.022106 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9a06cf18-c6ce-4756-a5b1-57504bb85062 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:25.053670 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9a06cf18-c6ce-4756-a5b1-57504bb85062 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044312 Oct 29 01:21:25.054251 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 664/1342] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:25 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:25.331687 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-de8f49bf-e8c8-4ff6-b0c0-7eb888ebc0e6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:25.332232 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-de8f49bf-e8c8-4ff6-b0c0-7eb888ebc0e6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:25.338238 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-de8f49bf-e8c8-4ff6-b0c0-7eb888ebc0e6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:25.338711 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-de8f49bf-e8c8-4ff6-b0c0-7eb888ebc0e6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:25.339472 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-de8f49bf-e8c8-4ff6-b0c0-7eb888ebc0e6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:25.339898 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-de8f49bf-e8c8-4ff6-b0c0-7eb888ebc0e6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:25.462988 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-de8f49bf-e8c8-4ff6-b0c0-7eb888ebc0e6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:25.470133 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-de8f49bf-e8c8-4ff6-b0c0-7eb888ebc0e6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.142330 Oct 29 01:21:25.470717 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 679/1343] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:25 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:25.702137 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a8fa3090-aaa1-46ed-a4b6-f3a878dc0991 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:25.702752 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a8fa3090-aaa1-46ed-a4b6-f3a878dc0991 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:25.709429 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a8fa3090-aaa1-46ed-a4b6-f3a878dc0991 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:25.709879 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a8fa3090-aaa1-46ed-a4b6-f3a878dc0991 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:25.710672 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a8fa3090-aaa1-46ed-a4b6-f3a878dc0991 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:25.711103 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a8fa3090-aaa1-46ed-a4b6-f3a878dc0991 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:25.770979 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-a8fa3090-aaa1-46ed-a4b6-f3a878dc0991 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:25.778169 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a8fa3090-aaa1-46ed-a4b6-f3a878dc0991 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.079715 Oct 29 01:21:25.778757 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 665/1344] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:25 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:26.067077 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-89449131-2941-4afd-b0bc-ea6415ad1e55 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:26.068004 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-89449131-2941-4afd-b0bc-ea6415ad1e55 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:26.075742 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-89449131-2941-4afd-b0bc-ea6415ad1e55 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:26.076190 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-89449131-2941-4afd-b0bc-ea6415ad1e55 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:26.076962 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-89449131-2941-4afd-b0bc-ea6415ad1e55 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:26.077400 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-89449131-2941-4afd-b0bc-ea6415ad1e55 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:26.106806 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-89449131-2941-4afd-b0bc-ea6415ad1e55 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043993 Oct 29 01:21:26.107359 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 680/1345] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:26 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:26.487804 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f6e1eb9b-9e49-4bb2-ac4e-a865162a0e89 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:26.488419 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f6e1eb9b-9e49-4bb2-ac4e-a865162a0e89 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:26.494177 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f6e1eb9b-9e49-4bb2-ac4e-a865162a0e89 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:26.494653 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f6e1eb9b-9e49-4bb2-ac4e-a865162a0e89 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:26.495403 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f6e1eb9b-9e49-4bb2-ac4e-a865162a0e89 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:26.495832 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f6e1eb9b-9e49-4bb2-ac4e-a865162a0e89 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:26.616879 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-f6e1eb9b-9e49-4bb2-ac4e-a865162a0e89 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:26.624256 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f6e1eb9b-9e49-4bb2-ac4e-a865162a0e89 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.140267 Oct 29 01:21:26.624819 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 666/1346] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:26 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:26.794692 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-927d975a-46c3-4e67-92db-e9dec8dd13c4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:26.795214 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-927d975a-46c3-4e67-92db-e9dec8dd13c4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:26.801041 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-927d975a-46c3-4e67-92db-e9dec8dd13c4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:26.801488 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-927d975a-46c3-4e67-92db-e9dec8dd13c4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:26.802244 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-927d975a-46c3-4e67-92db-e9dec8dd13c4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:26.802698 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-927d975a-46c3-4e67-92db-e9dec8dd13c4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:26.861338 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-927d975a-46c3-4e67-92db-e9dec8dd13c4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:26.868798 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-927d975a-46c3-4e67-92db-e9dec8dd13c4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.077797 Oct 29 01:21:26.869363 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 681/1347] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:26 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:27.118611 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-7107d8a7-bdc4-41d6-b1d3-5ca04ee9fddd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:27.119547 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-7107d8a7-bdc4-41d6-b1d3-5ca04ee9fddd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:27.125756 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7107d8a7-bdc4-41d6-b1d3-5ca04ee9fddd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:27.126207 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7107d8a7-bdc4-41d6-b1d3-5ca04ee9fddd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:27.127077 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7107d8a7-bdc4-41d6-b1d3-5ca04ee9fddd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:27.127518 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7107d8a7-bdc4-41d6-b1d3-5ca04ee9fddd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:27.156481 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-7107d8a7-bdc4-41d6-b1d3-5ca04ee9fddd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041620 Oct 29 01:21:27.157037 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 667/1348] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:27 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:27.644838 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-a9c0ff34-b779-4f8a-9ae5-87d49b8f1ee9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:27.645441 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-a9c0ff34-b779-4f8a-9ae5-87d49b8f1ee9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:27.651771 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a9c0ff34-b779-4f8a-9ae5-87d49b8f1ee9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:27.652218 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a9c0ff34-b779-4f8a-9ae5-87d49b8f1ee9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:27.652975 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a9c0ff34-b779-4f8a-9ae5-87d49b8f1ee9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:27.653399 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a9c0ff34-b779-4f8a-9ae5-87d49b8f1ee9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:27.775535 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-a9c0ff34-b779-4f8a-9ae5-87d49b8f1ee9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:27.782829 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-a9c0ff34-b779-4f8a-9ae5-87d49b8f1ee9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.142150 Oct 29 01:21:27.783393 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 682/1349] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:27 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:27.885714 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-5e17510a-b129-46b9-a804-534c3cc6c0a6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:27.886333 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-5e17510a-b129-46b9-a804-534c3cc6c0a6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:27.892902 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5e17510a-b129-46b9-a804-534c3cc6c0a6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:27.893824 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5e17510a-b129-46b9-a804-534c3cc6c0a6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:27.894635 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5e17510a-b129-46b9-a804-534c3cc6c0a6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:27.895145 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5e17510a-b129-46b9-a804-534c3cc6c0a6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:27.954225 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-5e17510a-b129-46b9-a804-534c3cc6c0a6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:27.962590 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-5e17510a-b129-46b9-a804-534c3cc6c0a6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.080227 Oct 29 01:21:27.963161 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 668/1350] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:27 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:28.168217 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-418f71c3-954e-4701-9bb7-07e77e7bb246 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:28.169058 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-418f71c3-954e-4701-9bb7-07e77e7bb246 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:28.174953 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-418f71c3-954e-4701-9bb7-07e77e7bb246 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:28.175400 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-418f71c3-954e-4701-9bb7-07e77e7bb246 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:28.176158 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-418f71c3-954e-4701-9bb7-07e77e7bb246 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:28.176591 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-418f71c3-954e-4701-9bb7-07e77e7bb246 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:28.205503 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-418f71c3-954e-4701-9bb7-07e77e7bb246 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041223 Oct 29 01:21:28.206659 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 683/1351] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:28 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:28.800122 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-3aa558f7-8824-4190-a328-06f73b158e9e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:28.800739 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-3aa558f7-8824-4190-a328-06f73b158e9e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:28.807919 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3aa558f7-8824-4190-a328-06f73b158e9e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:28.808361 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3aa558f7-8824-4190-a328-06f73b158e9e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:28.809125 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3aa558f7-8824-4190-a328-06f73b158e9e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:28.809556 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3aa558f7-8824-4190-a328-06f73b158e9e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:28.930367 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-3aa558f7-8824-4190-a328-06f73b158e9e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:28.937667 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-3aa558f7-8824-4190-a328-06f73b158e9e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.141845 Oct 29 01:21:28.938214 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 669/1352] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:28 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:28.980286 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f8fcab50-9448-4262-9227-27ae8fd395e1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:28.980924 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f8fcab50-9448-4262-9227-27ae8fd395e1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:28.987745 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f8fcab50-9448-4262-9227-27ae8fd395e1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:28.988198 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f8fcab50-9448-4262-9227-27ae8fd395e1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:28.988963 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f8fcab50-9448-4262-9227-27ae8fd395e1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:28.989396 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f8fcab50-9448-4262-9227-27ae8fd395e1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:29.051513 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-f8fcab50-9448-4262-9227-27ae8fd395e1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:29.058959 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f8fcab50-9448-4262-9227-27ae8fd395e1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.082635 Oct 29 01:21:29.059514 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 684/1353] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:28 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:29.218090 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-8147753c-365a-41fb-b0a2-d95c91d366cf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:29.219036 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-8147753c-365a-41fb-b0a2-d95c91d366cf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:29.225573 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8147753c-365a-41fb-b0a2-d95c91d366cf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:29.226025 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8147753c-365a-41fb-b0a2-d95c91d366cf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:29.226834 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8147753c-365a-41fb-b0a2-d95c91d366cf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:29.227271 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8147753c-365a-41fb-b0a2-d95c91d366cf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:29.255741 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-8147753c-365a-41fb-b0a2-d95c91d366cf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041393 Oct 29 01:21:29.256295 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 670/1354] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:29 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:29.954287 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-403f1b61-4ee4-4de8-9478-e80f0cbf5d39 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:29.954938 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-403f1b61-4ee4-4de8-9478-e80f0cbf5d39 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:29.961381 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-403f1b61-4ee4-4de8-9478-e80f0cbf5d39 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:29.961831 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-403f1b61-4ee4-4de8-9478-e80f0cbf5d39 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:29.962882 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-403f1b61-4ee4-4de8-9478-e80f0cbf5d39 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:29.963318 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-403f1b61-4ee4-4de8-9478-e80f0cbf5d39 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:30.075287 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b98df27c-fcf6-4230-9f26-15b505d621fc tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:30.075973 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b98df27c-fcf6-4230-9f26-15b505d621fc tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:30.082692 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b98df27c-fcf6-4230-9f26-15b505d621fc tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:30.083151 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b98df27c-fcf6-4230-9f26-15b505d621fc tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:30.083878 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-403f1b61-4ee4-4de8-9478-e80f0cbf5d39 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:30.084286 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b98df27c-fcf6-4230-9f26-15b505d621fc tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:30.084400 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b98df27c-fcf6-4230-9f26-15b505d621fc tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:30.091994 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-403f1b61-4ee4-4de8-9478-e80f0cbf5d39 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.141345 Oct 29 01:21:30.092816 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 685/1355] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:29 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:30.146207 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-b98df27c-fcf6-4230-9f26-15b505d621fc tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:30.153617 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b98df27c-fcf6-4230-9f26-15b505d621fc tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.081989 Oct 29 01:21:30.154180 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 671/1356] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:30 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:30.267068 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-bad462a8-a928-422d-90bc-e764aea51f1c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:30.267978 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-bad462a8-a928-422d-90bc-e764aea51f1c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:30.274453 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bad462a8-a928-422d-90bc-e764aea51f1c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:30.274936 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bad462a8-a928-422d-90bc-e764aea51f1c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:30.275655 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bad462a8-a928-422d-90bc-e764aea51f1c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:30.276082 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bad462a8-a928-422d-90bc-e764aea51f1c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:30.303725 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-bad462a8-a928-422d-90bc-e764aea51f1c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040380 Oct 29 01:21:30.304265 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 686/1357] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:30 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:31.108918 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-e34962c9-754f-4b4f-aa05-c06403be4e49 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:31.109509 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-e34962c9-754f-4b4f-aa05-c06403be4e49 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:31.115833 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e34962c9-754f-4b4f-aa05-c06403be4e49 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:31.116287 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e34962c9-754f-4b4f-aa05-c06403be4e49 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:31.117049 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e34962c9-754f-4b4f-aa05-c06403be4e49 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:31.117662 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e34962c9-754f-4b4f-aa05-c06403be4e49 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:31.170812 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-ab98d89a-40ff-4893-8eda-4ec295da3fd9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:31.171587 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-ab98d89a-40ff-4893-8eda-4ec295da3fd9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:31.177716 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ab98d89a-40ff-4893-8eda-4ec295da3fd9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:31.178257 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ab98d89a-40ff-4893-8eda-4ec295da3fd9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:31.179765 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ab98d89a-40ff-4893-8eda-4ec295da3fd9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:31.180318 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ab98d89a-40ff-4893-8eda-4ec295da3fd9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:31.260794 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-ab98d89a-40ff-4893-8eda-4ec295da3fd9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:31.267513 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-e34962c9-754f-4b4f-aa05-c06403be4e49 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:31.270029 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-ab98d89a-40ff-4893-8eda-4ec295da3fd9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.102718 Oct 29 01:21:31.270861 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 687/1358] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:31 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:31.276191 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-e34962c9-754f-4b4f-aa05-c06403be4e49 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.170935 Oct 29 01:21:31.276953 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 672/1359] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:31 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:31.315886 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-7f7e93d1-bfce-4f11-8e95-599ae0e647c1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:31.317586 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-7f7e93d1-bfce-4f11-8e95-599ae0e647c1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:31.323748 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7f7e93d1-bfce-4f11-8e95-599ae0e647c1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:31.324199 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7f7e93d1-bfce-4f11-8e95-599ae0e647c1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:31.325131 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7f7e93d1-bfce-4f11-8e95-599ae0e647c1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:31.325575 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7f7e93d1-bfce-4f11-8e95-599ae0e647c1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:31.355345 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-7f7e93d1-bfce-4f11-8e95-599ae0e647c1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043966 Oct 29 01:21:31.355902 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 688/1360] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:31 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:32.287159 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-8f6ff52e-013b-409b-a65c-b37b90dd027b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:32.287712 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-8f6ff52e-013b-409b-a65c-b37b90dd027b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:32.293144 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c559c110-6b9a-4e5b-9490-cff9e7913133 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:32.293883 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c559c110-6b9a-4e5b-9490-cff9e7913133 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:32.294215 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8f6ff52e-013b-409b-a65c-b37b90dd027b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:32.294718 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8f6ff52e-013b-409b-a65c-b37b90dd027b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:32.295484 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8f6ff52e-013b-409b-a65c-b37b90dd027b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:32.295915 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8f6ff52e-013b-409b-a65c-b37b90dd027b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:32.300329 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c559c110-6b9a-4e5b-9490-cff9e7913133 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:32.300834 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c559c110-6b9a-4e5b-9490-cff9e7913133 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:32.301597 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c559c110-6b9a-4e5b-9490-cff9e7913133 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:32.302029 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c559c110-6b9a-4e5b-9490-cff9e7913133 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:32.374862 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-8f6ff52e-013b-409b-a65c-b37b90dd027b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:32.382043 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-8f6ff52e-013b-409b-a65c-b37b90dd027b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.099229 Oct 29 01:21:32.382634 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 673/1361] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:32 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:32.387039 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-4c2212d1-5a8b-40af-8e2d-d531f5b05b22 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:32.387963 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-4c2212d1-5a8b-40af-8e2d-d531f5b05b22 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:32.394005 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4c2212d1-5a8b-40af-8e2d-d531f5b05b22 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:32.394467 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4c2212d1-5a8b-40af-8e2d-d531f5b05b22 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:32.395232 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4c2212d1-5a8b-40af-8e2d-d531f5b05b22 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:32.395660 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4c2212d1-5a8b-40af-8e2d-d531f5b05b22 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:32.425238 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-4c2212d1-5a8b-40af-8e2d-d531f5b05b22 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041563 Oct 29 01:21:32.426016 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 674/1362] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:32 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:32.442323 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-c559c110-6b9a-4e5b-9490-cff9e7913133 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:32.449641 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c559c110-6b9a-4e5b-9490-cff9e7913133 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.160381 Oct 29 01:21:32.450199 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 689/1363] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:32 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:21:33.399251 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-2a724338-6b74-4bb4-b523-fd275ebae82f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:33.399846 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-2a724338-6b74-4bb4-b523-fd275ebae82f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:33.405810 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2a724338-6b74-4bb4-b523-fd275ebae82f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:33.406257 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2a724338-6b74-4bb4-b523-fd275ebae82f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:33.407067 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2a724338-6b74-4bb4-b523-fd275ebae82f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:33.407504 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2a724338-6b74-4bb4-b523-fd275ebae82f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:33.435991 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d8418e1b-7a41-495a-b789-7e8c75d8899f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:33.436914 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d8418e1b-7a41-495a-b789-7e8c75d8899f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:33.443785 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d8418e1b-7a41-495a-b789-7e8c75d8899f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:33.444239 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d8418e1b-7a41-495a-b789-7e8c75d8899f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:33.445034 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d8418e1b-7a41-495a-b789-7e8c75d8899f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:33.445478 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d8418e1b-7a41-495a-b789-7e8c75d8899f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:33.472082 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-2a724338-6b74-4bb4-b523-fd275ebae82f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:33.477344 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d8418e1b-7a41-495a-b789-7e8c75d8899f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044990 Oct 29 01:21:33.477919 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 690/1364] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:33 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:21:33.479746 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-2a724338-6b74-4bb4-b523-fd275ebae82f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.084147 Oct 29 01:21:33.480459 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 675/1365] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:33 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:33.482667 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-38ff1542-bd57-48ca-a6d9-c4f3c24293a4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:33.483275 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-38ff1542-bd57-48ca-a6d9-c4f3c24293a4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:33.489099 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-38ff1542-bd57-48ca-a6d9-c4f3c24293a4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:33.489550 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-38ff1542-bd57-48ca-a6d9-c4f3c24293a4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:33.490315 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-38ff1542-bd57-48ca-a6d9-c4f3c24293a4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:33.490780 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-38ff1542-bd57-48ca-a6d9-c4f3c24293a4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:33.609322 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-38ff1542-bd57-48ca-a6d9-c4f3c24293a4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:33.616626 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-38ff1542-bd57-48ca-a6d9-c4f3c24293a4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.137731 Oct 29 01:21:33.617199 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 691/1366] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:33 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:34.489670 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d83133c1-d4eb-4416-981d-9084118331bd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:34.490651 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d83133c1-d4eb-4416-981d-9084118331bd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:34.496099 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-b9175044-9b31-41e9-a933-08c940ed1835 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:34.496751 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-b9175044-9b31-41e9-a933-08c940ed1835 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:34.497168 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d83133c1-d4eb-4416-981d-9084118331bd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:34.497620 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d83133c1-d4eb-4416-981d-9084118331bd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:34.498419 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d83133c1-d4eb-4416-981d-9084118331bd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:34.498866 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d83133c1-d4eb-4416-981d-9084118331bd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:34.504670 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b9175044-9b31-41e9-a933-08c940ed1835 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:34.505662 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b9175044-9b31-41e9-a933-08c940ed1835 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:34.506539 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b9175044-9b31-41e9-a933-08c940ed1835 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:34.506972 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b9175044-9b31-41e9-a933-08c940ed1835 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:34.530942 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d83133c1-d4eb-4416-981d-9084118331bd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045569 Oct 29 01:21:34.531527 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 676/1367] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:34 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:34.570894 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-b9175044-9b31-41e9-a933-08c940ed1835 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:34.578811 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-b9175044-9b31-41e9-a933-08c940ed1835 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.086281 Oct 29 01:21:34.579407 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 692/1368] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:34 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:21:34.633564 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-2570a8da-69a3-49ca-b2bc-499aa01dda0d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:34.634187 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-2570a8da-69a3-49ca-b2bc-499aa01dda0d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:34.640588 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2570a8da-69a3-49ca-b2bc-499aa01dda0d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:34.641040 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2570a8da-69a3-49ca-b2bc-499aa01dda0d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:34.641832 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2570a8da-69a3-49ca-b2bc-499aa01dda0d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:34.642320 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2570a8da-69a3-49ca-b2bc-499aa01dda0d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:34.769931 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-2570a8da-69a3-49ca-b2bc-499aa01dda0d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:34.777663 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-2570a8da-69a3-49ca-b2bc-499aa01dda0d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.147886 Oct 29 01:21:34.778221 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 677/1369] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:34 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:35.542469 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-68bbbfa7-569a-4fef-aee6-84b5aece6ed4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:35.543377 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-68bbbfa7-569a-4fef-aee6-84b5aece6ed4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:35.550156 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-68bbbfa7-569a-4fef-aee6-84b5aece6ed4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:35.550630 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-68bbbfa7-569a-4fef-aee6-84b5aece6ed4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:35.551389 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-68bbbfa7-569a-4fef-aee6-84b5aece6ed4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:35.551821 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-68bbbfa7-569a-4fef-aee6-84b5aece6ed4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:35.584968 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-68bbbfa7-569a-4fef-aee6-84b5aece6ed4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046331 Oct 29 01:21:35.585512 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 693/1370] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:35 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:35.645244 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-3ba61fdf-ab0d-4c90-b286-5287a34e53ea tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:35.645854 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-3ba61fdf-ab0d-4c90-b286-5287a34e53ea tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:35.651940 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3ba61fdf-ab0d-4c90-b286-5287a34e53ea tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:35.652384 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3ba61fdf-ab0d-4c90-b286-5287a34e53ea tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:35.653144 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3ba61fdf-ab0d-4c90-b286-5287a34e53ea tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:35.653570 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3ba61fdf-ab0d-4c90-b286-5287a34e53ea tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:35.717253 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-3ba61fdf-ab0d-4c90-b286-5287a34e53ea tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:35.725131 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-3ba61fdf-ab0d-4c90-b286-5287a34e53ea tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.132143 Oct 29 01:21:35.725687 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 678/1371] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:35 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:35.794727 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-9af3b9ed-8cbd-4b3b-8044-31682ab0ed6f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:35.795262 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-9af3b9ed-8cbd-4b3b-8044-31682ab0ed6f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:35.801664 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9af3b9ed-8cbd-4b3b-8044-31682ab0ed6f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:35.802103 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9af3b9ed-8cbd-4b3b-8044-31682ab0ed6f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:35.802884 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9af3b9ed-8cbd-4b3b-8044-31682ab0ed6f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:35.803309 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9af3b9ed-8cbd-4b3b-8044-31682ab0ed6f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:35.923240 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-9af3b9ed-8cbd-4b3b-8044-31682ab0ed6f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:35.930545 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-9af3b9ed-8cbd-4b3b-8044-31682ab0ed6f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.139483 Oct 29 01:21:35.931115 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 694/1372] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:35 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:36.596803 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-5a2f5002-32df-4d6c-a6f3-39f5da05b826 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:36.597792 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-5a2f5002-32df-4d6c-a6f3-39f5da05b826 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:36.604310 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5a2f5002-32df-4d6c-a6f3-39f5da05b826 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:36.604783 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5a2f5002-32df-4d6c-a6f3-39f5da05b826 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:36.605560 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5a2f5002-32df-4d6c-a6f3-39f5da05b826 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:36.605994 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5a2f5002-32df-4d6c-a6f3-39f5da05b826 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:36.635073 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-5a2f5002-32df-4d6c-a6f3-39f5da05b826 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042070 Oct 29 01:21:36.635645 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 679/1373] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:36 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:36.742124 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-be922ede-0c8d-493e-b9a4-2b088dfed0af tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:36.742899 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-be922ede-0c8d-493e-b9a4-2b088dfed0af tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:36.749448 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-be922ede-0c8d-493e-b9a4-2b088dfed0af tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:36.749891 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-be922ede-0c8d-493e-b9a4-2b088dfed0af tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:36.750693 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-be922ede-0c8d-493e-b9a4-2b088dfed0af tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:36.751125 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-be922ede-0c8d-493e-b9a4-2b088dfed0af tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:36.811268 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-be922ede-0c8d-493e-b9a4-2b088dfed0af tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:36.819333 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-be922ede-0c8d-493e-b9a4-2b088dfed0af tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.080977 Oct 29 01:21:36.819909 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 695/1374] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:36 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:36.947711 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-135bb0cb-7d95-4001-a28d-b27e00fecea0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:36.948235 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-135bb0cb-7d95-4001-a28d-b27e00fecea0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:36.954127 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-135bb0cb-7d95-4001-a28d-b27e00fecea0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:36.954633 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-135bb0cb-7d95-4001-a28d-b27e00fecea0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:36.955419 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-135bb0cb-7d95-4001-a28d-b27e00fecea0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:36.955848 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-135bb0cb-7d95-4001-a28d-b27e00fecea0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:37.079320 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-135bb0cb-7d95-4001-a28d-b27e00fecea0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:37.086953 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-135bb0cb-7d95-4001-a28d-b27e00fecea0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.142926 Oct 29 01:21:37.088205 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 680/1375] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:36 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:37.646996 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-88c0c921-bbf7-4517-99aa-a55e4f8f9291 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:37.647911 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-88c0c921-bbf7-4517-99aa-a55e4f8f9291 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:37.653737 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-88c0c921-bbf7-4517-99aa-a55e4f8f9291 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:37.654184 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-88c0c921-bbf7-4517-99aa-a55e4f8f9291 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:37.654978 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-88c0c921-bbf7-4517-99aa-a55e4f8f9291 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:37.655412 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-88c0c921-bbf7-4517-99aa-a55e4f8f9291 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:37.684565 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-88c0c921-bbf7-4517-99aa-a55e4f8f9291 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041885 Oct 29 01:21:37.685125 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 696/1376] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:37 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:37.838552 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-4583499c-59a3-4aa3-b4d2-4a42c708c185 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:37.839164 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-4583499c-59a3-4aa3-b4d2-4a42c708c185 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:37.845794 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4583499c-59a3-4aa3-b4d2-4a42c708c185 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:37.846262 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4583499c-59a3-4aa3-b4d2-4a42c708c185 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:37.847056 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4583499c-59a3-4aa3-b4d2-4a42c708c185 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:37.847526 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4583499c-59a3-4aa3-b4d2-4a42c708c185 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:37.910509 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-4583499c-59a3-4aa3-b4d2-4a42c708c185 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:37.917956 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-4583499c-59a3-4aa3-b4d2-4a42c708c185 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.084715 Oct 29 01:21:37.918532 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 681/1377] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:37 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:38.104179 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-0c1cbeb8-a4d5-4679-a853-48dc7aeb4338 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:38.104821 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-0c1cbeb8-a4d5-4679-a853-48dc7aeb4338 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:38.111030 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0c1cbeb8-a4d5-4679-a853-48dc7aeb4338 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:38.111474 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0c1cbeb8-a4d5-4679-a853-48dc7aeb4338 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:38.112534 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0c1cbeb8-a4d5-4679-a853-48dc7aeb4338 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:38.113128 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0c1cbeb8-a4d5-4679-a853-48dc7aeb4338 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:38.246841 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-0c1cbeb8-a4d5-4679-a853-48dc7aeb4338 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:38.254786 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-0c1cbeb8-a4d5-4679-a853-48dc7aeb4338 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.154350 Oct 29 01:21:38.255352 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 697/1378] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:38 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:38.695970 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-4778e52b-d494-45d5-be89-51cff333b9c1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:38.697038 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-4778e52b-d494-45d5-be89-51cff333b9c1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:38.703111 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4778e52b-d494-45d5-be89-51cff333b9c1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:38.703562 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4778e52b-d494-45d5-be89-51cff333b9c1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:38.704326 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4778e52b-d494-45d5-be89-51cff333b9c1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:38.704788 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4778e52b-d494-45d5-be89-51cff333b9c1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:38.736203 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-4778e52b-d494-45d5-be89-51cff333b9c1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043942 Oct 29 01:21:38.737331 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 682/1379] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:38 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:38.934675 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-6ebc80d8-5d20-4568-a4aa-356f16982626 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:38.935292 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-6ebc80d8-5d20-4568-a4aa-356f16982626 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:38.941165 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6ebc80d8-5d20-4568-a4aa-356f16982626 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:38.941617 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6ebc80d8-5d20-4568-a4aa-356f16982626 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:38.942404 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6ebc80d8-5d20-4568-a4aa-356f16982626 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:38.942851 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6ebc80d8-5d20-4568-a4aa-356f16982626 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:39.003478 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-6ebc80d8-5d20-4568-a4aa-356f16982626 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:39.010987 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-6ebc80d8-5d20-4568-a4aa-356f16982626 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.080145 Oct 29 01:21:39.011556 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 698/1380] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:38 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:39.272668 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a9616ab7-1bb2-4e86-93b9-383b1d0a99d3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:39.273196 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a9616ab7-1bb2-4e86-93b9-383b1d0a99d3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:39.279661 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a9616ab7-1bb2-4e86-93b9-383b1d0a99d3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:39.280120 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a9616ab7-1bb2-4e86-93b9-383b1d0a99d3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:39.280920 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a9616ab7-1bb2-4e86-93b9-383b1d0a99d3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:39.281355 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a9616ab7-1bb2-4e86-93b9-383b1d0a99d3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:39.406824 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-a9616ab7-1bb2-4e86-93b9-383b1d0a99d3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:39.414076 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a9616ab7-1bb2-4e86-93b9-383b1d0a99d3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.145985 Oct 29 01:21:39.414683 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 683/1381] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:39 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:39.747864 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2f23b670-71ae-4c3c-b47b-463f37a1b943 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:39.748808 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2f23b670-71ae-4c3c-b47b-463f37a1b943 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:39.755634 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2f23b670-71ae-4c3c-b47b-463f37a1b943 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:39.756077 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2f23b670-71ae-4c3c-b47b-463f37a1b943 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:39.756828 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2f23b670-71ae-4c3c-b47b-463f37a1b943 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:39.757258 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2f23b670-71ae-4c3c-b47b-463f37a1b943 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:39.787871 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2f23b670-71ae-4c3c-b47b-463f37a1b943 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043909 Oct 29 01:21:39.788423 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 699/1382] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:39 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:40.028456 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b4eba188-883c-407c-b52f-d86dbbc76a19 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:40.029032 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b4eba188-883c-407c-b52f-d86dbbc76a19 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:40.035695 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b4eba188-883c-407c-b52f-d86dbbc76a19 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:40.036145 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b4eba188-883c-407c-b52f-d86dbbc76a19 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:40.036921 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b4eba188-883c-407c-b52f-d86dbbc76a19 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:40.037359 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b4eba188-883c-407c-b52f-d86dbbc76a19 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:40.098123 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-b4eba188-883c-407c-b52f-d86dbbc76a19 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:40.105685 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b4eba188-883c-407c-b52f-d86dbbc76a19 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.081106 Oct 29 01:21:40.106384 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 684/1383] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:40 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:21:40.431223 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-daa1d668-ede1-4fad-bd36-bf4b402617e1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:40.432477 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-daa1d668-ede1-4fad-bd36-bf4b402617e1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:40.438836 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-daa1d668-ede1-4fad-bd36-bf4b402617e1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:40.439290 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-daa1d668-ede1-4fad-bd36-bf4b402617e1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:40.440078 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-daa1d668-ede1-4fad-bd36-bf4b402617e1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:40.440517 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-daa1d668-ede1-4fad-bd36-bf4b402617e1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:40.563895 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-daa1d668-ede1-4fad-bd36-bf4b402617e1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:40.571484 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-daa1d668-ede1-4fad-bd36-bf4b402617e1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.143972 Oct 29 01:21:40.572046 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 700/1384] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:40 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:40.799274 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-77fab439-4fb4-4d80-8e71-543a883c3e57 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:40.801423 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-77fab439-4fb4-4d80-8e71-543a883c3e57 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:40.807445 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-77fab439-4fb4-4d80-8e71-543a883c3e57 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:40.807899 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-77fab439-4fb4-4d80-8e71-543a883c3e57 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:40.808674 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-77fab439-4fb4-4d80-8e71-543a883c3e57 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:40.809107 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-77fab439-4fb4-4d80-8e71-543a883c3e57 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:40.839861 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-77fab439-4fb4-4d80-8e71-543a883c3e57 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044396 Oct 29 01:21:40.840418 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 685/1385] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:40 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:41.123015 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-3597de29-de52-4539-8b74-f5f55904a6e4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:41.123657 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-3597de29-de52-4539-8b74-f5f55904a6e4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:41.129901 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3597de29-de52-4539-8b74-f5f55904a6e4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:41.130347 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3597de29-de52-4539-8b74-f5f55904a6e4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:41.131141 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3597de29-de52-4539-8b74-f5f55904a6e4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:41.131572 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3597de29-de52-4539-8b74-f5f55904a6e4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:41.190812 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-3597de29-de52-4539-8b74-f5f55904a6e4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:41.198128 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-3597de29-de52-4539-8b74-f5f55904a6e4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.078886 Oct 29 01:21:41.198882 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 701/1386] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:41 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:41.589225 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a278421c-762c-4bb2-b0b3-88cc6b7d531b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:41.589767 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a278421c-762c-4bb2-b0b3-88cc6b7d531b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:41.595570 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a278421c-762c-4bb2-b0b3-88cc6b7d531b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:41.596047 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a278421c-762c-4bb2-b0b3-88cc6b7d531b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:41.596855 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a278421c-762c-4bb2-b0b3-88cc6b7d531b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:41.597294 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a278421c-762c-4bb2-b0b3-88cc6b7d531b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:41.720539 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-a278421c-762c-4bb2-b0b3-88cc6b7d531b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:41.728000 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a278421c-762c-4bb2-b0b3-88cc6b7d531b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.142925 Oct 29 01:21:41.728558 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 686/1387] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:41 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:41.851245 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-32951969-0fcc-4fb1-af19-7c5848e6911a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:41.852169 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-32951969-0fcc-4fb1-af19-7c5848e6911a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:41.858230 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-32951969-0fcc-4fb1-af19-7c5848e6911a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:41.858712 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-32951969-0fcc-4fb1-af19-7c5848e6911a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:41.859477 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-32951969-0fcc-4fb1-af19-7c5848e6911a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:41.859911 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-32951969-0fcc-4fb1-af19-7c5848e6911a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:41.888348 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-32951969-0fcc-4fb1-af19-7c5848e6911a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040855 Oct 29 01:21:41.888897 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 702/1388] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:41 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:42.215014 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-71e874bb-8bc5-45cf-812d-8ffc75ae855e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:42.215726 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-71e874bb-8bc5-45cf-812d-8ffc75ae855e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:42.222562 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-71e874bb-8bc5-45cf-812d-8ffc75ae855e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:42.223009 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-71e874bb-8bc5-45cf-812d-8ffc75ae855e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:42.223780 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-71e874bb-8bc5-45cf-812d-8ffc75ae855e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:42.224214 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-71e874bb-8bc5-45cf-812d-8ffc75ae855e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:42.287078 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-71e874bb-8bc5-45cf-812d-8ffc75ae855e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:42.295029 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-71e874bb-8bc5-45cf-812d-8ffc75ae855e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.083996 Oct 29 01:21:42.295826 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 687/1389] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:42 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:21:42.744499 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e9aec9ad-912f-42bb-9e70-2d52c1e65db4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:42.745294 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-e9aec9ad-912f-42bb-9e70-2d52c1e65db4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:42.751631 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e9aec9ad-912f-42bb-9e70-2d52c1e65db4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:42.752076 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e9aec9ad-912f-42bb-9e70-2d52c1e65db4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:42.752840 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e9aec9ad-912f-42bb-9e70-2d52c1e65db4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:42.753273 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e9aec9ad-912f-42bb-9e70-2d52c1e65db4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:42.877719 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-e9aec9ad-912f-42bb-9e70-2d52c1e65db4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:42.885318 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-e9aec9ad-912f-42bb-9e70-2d52c1e65db4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.144175 Oct 29 01:21:42.885822 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 703/1390] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:42 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:42.899754 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-153f9ad1-b729-4560-b527-02c0c3f4a470 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:42.900727 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-153f9ad1-b729-4560-b527-02c0c3f4a470 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:42.906545 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-153f9ad1-b729-4560-b527-02c0c3f4a470 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:42.906997 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-153f9ad1-b729-4560-b527-02c0c3f4a470 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:42.907761 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-153f9ad1-b729-4560-b527-02c0c3f4a470 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:42.908193 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-153f9ad1-b729-4560-b527-02c0c3f4a470 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:42.938435 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-153f9ad1-b729-4560-b527-02c0c3f4a470 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042384 Oct 29 01:21:42.938989 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 688/1391] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:42 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:43.313378 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-a172cbd2-80da-4ec1-8f6f-bf323db80e5f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:43.313996 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-a172cbd2-80da-4ec1-8f6f-bf323db80e5f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:43.319839 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a172cbd2-80da-4ec1-8f6f-bf323db80e5f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:43.320388 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a172cbd2-80da-4ec1-8f6f-bf323db80e5f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:43.321041 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a172cbd2-80da-4ec1-8f6f-bf323db80e5f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:43.321492 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a172cbd2-80da-4ec1-8f6f-bf323db80e5f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:43.384968 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-a172cbd2-80da-4ec1-8f6f-bf323db80e5f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:43.392386 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-a172cbd2-80da-4ec1-8f6f-bf323db80e5f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.082885 Oct 29 01:21:43.392951 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 704/1392] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:43 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:43.901747 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a525f290-4a43-4195-a4da-63635aeb2d87 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:43.902370 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a525f290-4a43-4195-a4da-63635aeb2d87 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:43.908643 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a525f290-4a43-4195-a4da-63635aeb2d87 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:43.909094 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a525f290-4a43-4195-a4da-63635aeb2d87 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:43.909862 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a525f290-4a43-4195-a4da-63635aeb2d87 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:43.910300 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a525f290-4a43-4195-a4da-63635aeb2d87 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:43.949741 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-7d0591f5-0148-45b0-aec4-2774e8bff095 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:43.950694 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-7d0591f5-0148-45b0-aec4-2774e8bff095 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:43.956785 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7d0591f5-0148-45b0-aec4-2774e8bff095 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:43.958079 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7d0591f5-0148-45b0-aec4-2774e8bff095 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:43.958710 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7d0591f5-0148-45b0-aec4-2774e8bff095 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:43.959152 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7d0591f5-0148-45b0-aec4-2774e8bff095 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:43.989396 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-7d0591f5-0148-45b0-aec4-2774e8bff095 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043300 Oct 29 01:21:43.989954 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 705/1393] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:43 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:21:44.033731 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-a525f290-4a43-4195-a4da-63635aeb2d87 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:44.041525 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a525f290-4a43-4195-a4da-63635aeb2d87 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.143486 Oct 29 01:21:44.042091 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 689/1394] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:43 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:44.408712 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d5b6a7d0-7ae8-4e34-ba65-49b605a6a28d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:44.409318 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d5b6a7d0-7ae8-4e34-ba65-49b605a6a28d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:44.415145 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d5b6a7d0-7ae8-4e34-ba65-49b605a6a28d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:44.415586 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d5b6a7d0-7ae8-4e34-ba65-49b605a6a28d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:44.416342 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d5b6a7d0-7ae8-4e34-ba65-49b605a6a28d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:44.416768 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d5b6a7d0-7ae8-4e34-ba65-49b605a6a28d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:44.476659 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-d5b6a7d0-7ae8-4e34-ba65-49b605a6a28d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:44.483979 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d5b6a7d0-7ae8-4e34-ba65-49b605a6a28d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.078924 Oct 29 01:21:44.484535 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 706/1395] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:44 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:45.001059 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b3ba436b-342e-4be6-af3f-0320a0864dcf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:45.001972 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b3ba436b-342e-4be6-af3f-0320a0864dcf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:45.008221 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b3ba436b-342e-4be6-af3f-0320a0864dcf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:45.008659 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b3ba436b-342e-4be6-af3f-0320a0864dcf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:45.009410 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b3ba436b-342e-4be6-af3f-0320a0864dcf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:45.009840 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b3ba436b-342e-4be6-af3f-0320a0864dcf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:45.039491 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b3ba436b-342e-4be6-af3f-0320a0864dcf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042150 Oct 29 01:21:45.040033 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 690/1396] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:44 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:45.058001 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-297963d0-5f2d-4f0a-8e4c-2c9d5f29a00e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:45.058648 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-297963d0-5f2d-4f0a-8e4c-2c9d5f29a00e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:45.064887 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-297963d0-5f2d-4f0a-8e4c-2c9d5f29a00e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:45.065341 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-297963d0-5f2d-4f0a-8e4c-2c9d5f29a00e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:45.066117 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-297963d0-5f2d-4f0a-8e4c-2c9d5f29a00e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:45.066677 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-297963d0-5f2d-4f0a-8e4c-2c9d5f29a00e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:45.185663 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-297963d0-5f2d-4f0a-8e4c-2c9d5f29a00e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:45.193283 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-297963d0-5f2d-4f0a-8e4c-2c9d5f29a00e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.138921 Oct 29 01:21:45.193832 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 707/1397] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:45 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:45.501127 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b1b7406e-1f2f-46ab-b1c4-cc9a2878ebe2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:45.501730 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b1b7406e-1f2f-46ab-b1c4-cc9a2878ebe2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:45.508057 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b1b7406e-1f2f-46ab-b1c4-cc9a2878ebe2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:45.508500 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b1b7406e-1f2f-46ab-b1c4-cc9a2878ebe2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:45.509255 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b1b7406e-1f2f-46ab-b1c4-cc9a2878ebe2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:45.509691 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b1b7406e-1f2f-46ab-b1c4-cc9a2878ebe2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:45.571793 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-b1b7406e-1f2f-46ab-b1c4-cc9a2878ebe2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:45.579058 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b1b7406e-1f2f-46ab-b1c4-cc9a2878ebe2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.081658 Oct 29 01:21:45.579613 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 691/1398] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:45 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:46.050419 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-b40b4ce2-d2fc-4593-a75c-cb8f1644002c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:46.051891 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-b40b4ce2-d2fc-4593-a75c-cb8f1644002c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:46.057832 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b40b4ce2-d2fc-4593-a75c-cb8f1644002c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:46.058286 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b40b4ce2-d2fc-4593-a75c-cb8f1644002c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:46.059085 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b40b4ce2-d2fc-4593-a75c-cb8f1644002c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:46.059524 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b40b4ce2-d2fc-4593-a75c-cb8f1644002c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:46.088499 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-b40b4ce2-d2fc-4593-a75c-cb8f1644002c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041968 Oct 29 01:21:46.089048 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 708/1399] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:46 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:46.209358 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-645ef7b5-0c68-4f40-a523-e727b4735aad tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:46.209897 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-645ef7b5-0c68-4f40-a523-e727b4735aad tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:46.216401 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-645ef7b5-0c68-4f40-a523-e727b4735aad tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:46.216852 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-645ef7b5-0c68-4f40-a523-e727b4735aad tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:46.217618 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-645ef7b5-0c68-4f40-a523-e727b4735aad tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:46.218055 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-645ef7b5-0c68-4f40-a523-e727b4735aad tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:46.345635 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-645ef7b5-0c68-4f40-a523-e727b4735aad tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:46.353757 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-645ef7b5-0c68-4f40-a523-e727b4735aad tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.148172 Oct 29 01:21:46.354348 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 692/1400] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:46 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:46.596226 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-fb7885ac-4025-430c-9694-f1625b36e40f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:46.596836 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-fb7885ac-4025-430c-9694-f1625b36e40f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:46.603237 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fb7885ac-4025-430c-9694-f1625b36e40f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:46.603683 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fb7885ac-4025-430c-9694-f1625b36e40f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:46.604451 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fb7885ac-4025-430c-9694-f1625b36e40f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:46.604888 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fb7885ac-4025-430c-9694-f1625b36e40f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:46.667250 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-fb7885ac-4025-430c-9694-f1625b36e40f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:46.674452 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-fb7885ac-4025-430c-9694-f1625b36e40f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.082067 Oct 29 01:21:46.675007 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 709/1401] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:46 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:47.099784 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-72459535-cff6-423a-a886-7a4f5bcaa381 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:47.100697 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-72459535-cff6-423a-a886-7a4f5bcaa381 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:47.106605 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-72459535-cff6-423a-a886-7a4f5bcaa381 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:47.107053 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-72459535-cff6-423a-a886-7a4f5bcaa381 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:47.107835 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-72459535-cff6-423a-a886-7a4f5bcaa381 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:47.108262 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-72459535-cff6-423a-a886-7a4f5bcaa381 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:47.137419 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-72459535-cff6-423a-a886-7a4f5bcaa381 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041339 Oct 29 01:21:47.137963 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 693/1402] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:47 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:47.370584 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-1e34dcf3-5919-42ea-bf54-6c8181eddf57 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:47.371228 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-1e34dcf3-5919-42ea-bf54-6c8181eddf57 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:47.377390 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1e34dcf3-5919-42ea-bf54-6c8181eddf57 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:47.377835 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1e34dcf3-5919-42ea-bf54-6c8181eddf57 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:47.379240 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1e34dcf3-5919-42ea-bf54-6c8181eddf57 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:47.379806 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1e34dcf3-5919-42ea-bf54-6c8181eddf57 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:47.506694 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-1e34dcf3-5919-42ea-bf54-6c8181eddf57 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:47.514830 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-1e34dcf3-5919-42ea-bf54-6c8181eddf57 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.147820 Oct 29 01:21:47.515408 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 710/1403] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:47 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:47.691976 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-98060595-1745-43e3-9745-465fefa79ce7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:47.692535 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-98060595-1745-43e3-9745-465fefa79ce7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:47.698691 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-98060595-1745-43e3-9745-465fefa79ce7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:47.699137 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-98060595-1745-43e3-9745-465fefa79ce7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:47.699884 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-98060595-1745-43e3-9745-465fefa79ce7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:47.700313 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-98060595-1745-43e3-9745-465fefa79ce7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:47.758880 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-98060595-1745-43e3-9745-465fefa79ce7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:47.766090 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-98060595-1745-43e3-9745-465fefa79ce7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.077868 Oct 29 01:21:47.766676 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 694/1404] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:47 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:48.149222 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-dd4d9302-2f85-4813-a402-951965959876 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:48.150120 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-dd4d9302-2f85-4813-a402-951965959876 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:48.156099 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dd4d9302-2f85-4813-a402-951965959876 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:48.156542 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dd4d9302-2f85-4813-a402-951965959876 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:48.157304 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dd4d9302-2f85-4813-a402-951965959876 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:48.157734 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dd4d9302-2f85-4813-a402-951965959876 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:48.186715 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-dd4d9302-2f85-4813-a402-951965959876 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041180 Oct 29 01:21:48.187270 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 711/1405] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:48 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:48.531604 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b57f31f5-66b1-4415-b92b-314f3d82ee8c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:48.532229 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b57f31f5-66b1-4415-b92b-314f3d82ee8c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:48.538380 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b57f31f5-66b1-4415-b92b-314f3d82ee8c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:48.538967 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b57f31f5-66b1-4415-b92b-314f3d82ee8c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:48.539706 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b57f31f5-66b1-4415-b92b-314f3d82ee8c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:48.540143 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b57f31f5-66b1-4415-b92b-314f3d82ee8c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:48.671550 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-b57f31f5-66b1-4415-b92b-314f3d82ee8c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:48.679780 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b57f31f5-66b1-4415-b92b-314f3d82ee8c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.151833 Oct 29 01:21:48.680357 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 695/1406] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:48 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:48.782894 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-b8621405-a755-4431-bdd6-47aa1bf7506a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:48.783474 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-b8621405-a755-4431-bdd6-47aa1bf7506a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:48.790991 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b8621405-a755-4431-bdd6-47aa1bf7506a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:48.794957 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b8621405-a755-4431-bdd6-47aa1bf7506a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:48.795744 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b8621405-a755-4431-bdd6-47aa1bf7506a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:48.796182 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b8621405-a755-4431-bdd6-47aa1bf7506a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:48.861478 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-b8621405-a755-4431-bdd6-47aa1bf7506a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:48.869810 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-b8621405-a755-4431-bdd6-47aa1bf7506a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.090617 Oct 29 01:21:48.870415 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 712/1407] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:48 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:49.197426 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-807c7795-df0e-4cee-9209-ad6c621fff26 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:49.198347 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-807c7795-df0e-4cee-9209-ad6c621fff26 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:49.204597 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-807c7795-df0e-4cee-9209-ad6c621fff26 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:49.205044 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-807c7795-df0e-4cee-9209-ad6c621fff26 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:49.205810 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-807c7795-df0e-4cee-9209-ad6c621fff26 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:49.206245 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-807c7795-df0e-4cee-9209-ad6c621fff26 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:49.238817 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-807c7795-df0e-4cee-9209-ad6c621fff26 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044431 Oct 29 01:21:49.239398 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 696/1408] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:49 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:49.697423 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-4aead6fd-d384-45ce-a75b-c15b825560d6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:49.698026 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-4aead6fd-d384-45ce-a75b-c15b825560d6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:49.703887 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4aead6fd-d384-45ce-a75b-c15b825560d6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:49.704335 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4aead6fd-d384-45ce-a75b-c15b825560d6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:49.705098 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4aead6fd-d384-45ce-a75b-c15b825560d6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:49.705533 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4aead6fd-d384-45ce-a75b-c15b825560d6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:49.829095 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-4aead6fd-d384-45ce-a75b-c15b825560d6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:49.836747 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-4aead6fd-d384-45ce-a75b-c15b825560d6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.143082 Oct 29 01:21:49.837568 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 713/1409] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:49 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:49.887080 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b4f15d17-0b61-4d20-a639-42e4e184ccd1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:49.887707 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b4f15d17-0b61-4d20-a639-42e4e184ccd1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:49.893520 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b4f15d17-0b61-4d20-a639-42e4e184ccd1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:49.893976 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b4f15d17-0b61-4d20-a639-42e4e184ccd1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:49.895445 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b4f15d17-0b61-4d20-a639-42e4e184ccd1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:49.895881 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b4f15d17-0b61-4d20-a639-42e4e184ccd1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:49.954556 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-b4f15d17-0b61-4d20-a639-42e4e184ccd1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:49.963406 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b4f15d17-0b61-4d20-a639-42e4e184ccd1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.079965 Oct 29 01:21:49.963999 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 697/1410] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:49 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:50.250312 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-30dab5b6-e72d-4fde-8f9a-756e17f221b3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:50.251195 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-30dab5b6-e72d-4fde-8f9a-756e17f221b3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:50.257668 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-30dab5b6-e72d-4fde-8f9a-756e17f221b3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:50.258751 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-30dab5b6-e72d-4fde-8f9a-756e17f221b3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:50.259752 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-30dab5b6-e72d-4fde-8f9a-756e17f221b3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:50.260202 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-30dab5b6-e72d-4fde-8f9a-756e17f221b3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:50.289876 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-30dab5b6-e72d-4fde-8f9a-756e17f221b3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043381 Oct 29 01:21:50.290467 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 714/1411] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:50 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:50.853973 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-3a970523-c13c-4a1e-9dfd-444aa3a38a72 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:50.854634 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-3a970523-c13c-4a1e-9dfd-444aa3a38a72 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:50.861034 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3a970523-c13c-4a1e-9dfd-444aa3a38a72 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:50.861485 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3a970523-c13c-4a1e-9dfd-444aa3a38a72 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:50.862258 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3a970523-c13c-4a1e-9dfd-444aa3a38a72 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:50.862722 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3a970523-c13c-4a1e-9dfd-444aa3a38a72 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:50.979839 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d3060793-fcd2-45ab-86b3-0523914b2daf tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:50.980534 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d3060793-fcd2-45ab-86b3-0523914b2daf tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:50.986815 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d3060793-fcd2-45ab-86b3-0523914b2daf tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:50.987340 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d3060793-fcd2-45ab-86b3-0523914b2daf tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:50.988770 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d3060793-fcd2-45ab-86b3-0523914b2daf tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:50.989255 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d3060793-fcd2-45ab-86b3-0523914b2daf tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:50.990916 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-3a970523-c13c-4a1e-9dfd-444aa3a38a72 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:50.998313 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-3a970523-c13c-4a1e-9dfd-444aa3a38a72 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.148107 Oct 29 01:21:50.998906 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 698/1412] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:50 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:51.052748 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-d3060793-fcd2-45ab-86b3-0523914b2daf tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:51.060042 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d3060793-fcd2-45ab-86b3-0523914b2daf tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.083978 Oct 29 01:21:51.060596 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 715/1413] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:50 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:21:51.301721 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a710089b-1f7d-4f56-ba68-76bc0f2d224f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:51.302580 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a710089b-1f7d-4f56-ba68-76bc0f2d224f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:51.308347 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a710089b-1f7d-4f56-ba68-76bc0f2d224f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:51.308790 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a710089b-1f7d-4f56-ba68-76bc0f2d224f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:51.309540 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a710089b-1f7d-4f56-ba68-76bc0f2d224f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:51.309968 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a710089b-1f7d-4f56-ba68-76bc0f2d224f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:51.337703 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a710089b-1f7d-4f56-ba68-76bc0f2d224f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040180 Oct 29 01:21:51.338248 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 699/1414] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:51 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:52.014715 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-b5691820-56ed-4310-b9b2-b403d6a5a5fd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:52.015322 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-b5691820-56ed-4310-b9b2-b403d6a5a5fd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:52.022311 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b5691820-56ed-4310-b9b2-b403d6a5a5fd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:52.022776 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b5691820-56ed-4310-b9b2-b403d6a5a5fd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:52.023538 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b5691820-56ed-4310-b9b2-b403d6a5a5fd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:52.023964 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b5691820-56ed-4310-b9b2-b403d6a5a5fd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:52.076777 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-3f410869-d098-462d-ad18-33d3f05c044c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:52.077376 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-3f410869-d098-462d-ad18-33d3f05c044c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:52.084004 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3f410869-d098-462d-ad18-33d3f05c044c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:52.084458 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3f410869-d098-462d-ad18-33d3f05c044c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:52.085241 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3f410869-d098-462d-ad18-33d3f05c044c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:52.085684 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3f410869-d098-462d-ad18-33d3f05c044c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:52.154444 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-3f410869-d098-462d-ad18-33d3f05c044c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:52.162329 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-3f410869-d098-462d-ad18-33d3f05c044c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.089244 Oct 29 01:21:52.162933 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 700/1415] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:52 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:21:52.168689 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-b5691820-56ed-4310-b9b2-b403d6a5a5fd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:52.176827 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-b5691820-56ed-4310-b9b2-b403d6a5a5fd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.165712 Oct 29 01:21:52.177385 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 716/1416] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:52 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:52.349686 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b33b83a0-16d2-48c0-acf5-e4a07332c0c0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:52.350636 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b33b83a0-16d2-48c0-acf5-e4a07332c0c0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:52.356579 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b33b83a0-16d2-48c0-acf5-e4a07332c0c0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:52.357022 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b33b83a0-16d2-48c0-acf5-e4a07332c0c0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:52.357783 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b33b83a0-16d2-48c0-acf5-e4a07332c0c0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:52.358216 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b33b83a0-16d2-48c0-acf5-e4a07332c0c0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:52.386322 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b33b83a0-16d2-48c0-acf5-e4a07332c0c0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041025 Oct 29 01:21:52.386904 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 701/1417] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:52 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:53.179028 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f60dbb45-0542-4648-8719-38e93c44f424 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:53.179627 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f60dbb45-0542-4648-8719-38e93c44f424 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:53.186145 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f60dbb45-0542-4648-8719-38e93c44f424 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:53.186651 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f60dbb45-0542-4648-8719-38e93c44f424 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:53.187424 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f60dbb45-0542-4648-8719-38e93c44f424 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:53.187854 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f60dbb45-0542-4648-8719-38e93c44f424 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:53.192816 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-30bf14ea-67ce-43c2-9d9a-214ea5a2ee77 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:53.193438 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-30bf14ea-67ce-43c2-9d9a-214ea5a2ee77 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:53.200172 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-30bf14ea-67ce-43c2-9d9a-214ea5a2ee77 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:53.200621 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-30bf14ea-67ce-43c2-9d9a-214ea5a2ee77 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:53.201414 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-30bf14ea-67ce-43c2-9d9a-214ea5a2ee77 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:53.201856 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-30bf14ea-67ce-43c2-9d9a-214ea5a2ee77 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:53.251742 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-f60dbb45-0542-4648-8719-38e93c44f424 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:53.259600 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f60dbb45-0542-4648-8719-38e93c44f424 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.084240 Oct 29 01:21:53.260189 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 717/1418] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:53 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:53.348054 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-30bf14ea-67ce-43c2-9d9a-214ea5a2ee77 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:53.355671 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-30bf14ea-67ce-43c2-9d9a-214ea5a2ee77 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.166437 Oct 29 01:21:53.356236 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 702/1419] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:53 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:21:53.397603 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-b81d985a-d342-4499-b14f-10de3922a3ef tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:53.398558 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-b81d985a-d342-4499-b14f-10de3922a3ef tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:53.404386 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b81d985a-d342-4499-b14f-10de3922a3ef tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:53.404833 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b81d985a-d342-4499-b14f-10de3922a3ef tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:53.405601 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b81d985a-d342-4499-b14f-10de3922a3ef tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:53.406041 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b81d985a-d342-4499-b14f-10de3922a3ef tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:53.434852 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-b81d985a-d342-4499-b14f-10de3922a3ef tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041512 Oct 29 01:21:53.435421 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 718/1420] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:53 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:54.275361 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-e0f59d54-da4a-40c0-ab33-9d839e9918b5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:54.275938 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-e0f59d54-da4a-40c0-ab33-9d839e9918b5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:54.282195 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e0f59d54-da4a-40c0-ab33-9d839e9918b5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:54.282699 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e0f59d54-da4a-40c0-ab33-9d839e9918b5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:54.283472 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e0f59d54-da4a-40c0-ab33-9d839e9918b5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:54.283904 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e0f59d54-da4a-40c0-ab33-9d839e9918b5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:54.346127 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-e0f59d54-da4a-40c0-ab33-9d839e9918b5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:54.354029 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-e0f59d54-da4a-40c0-ab33-9d839e9918b5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.082530 Oct 29 01:21:54.354612 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 703/1421] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:54 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:54.372676 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d7690dfa-ffe1-4f72-b25d-40db2c693919 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:54.373308 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d7690dfa-ffe1-4f72-b25d-40db2c693919 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:54.379918 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d7690dfa-ffe1-4f72-b25d-40db2c693919 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:54.380369 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d7690dfa-ffe1-4f72-b25d-40db2c693919 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:54.381129 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d7690dfa-ffe1-4f72-b25d-40db2c693919 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:54.381562 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d7690dfa-ffe1-4f72-b25d-40db2c693919 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:54.445708 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-023026c3-7025-42b6-b52e-b620945c1684 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:54.446720 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-023026c3-7025-42b6-b52e-b620945c1684 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:54.452617 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-023026c3-7025-42b6-b52e-b620945c1684 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:54.453067 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-023026c3-7025-42b6-b52e-b620945c1684 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:54.453847 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-023026c3-7025-42b6-b52e-b620945c1684 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:54.454286 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-023026c3-7025-42b6-b52e-b620945c1684 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:54.484779 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-023026c3-7025-42b6-b52e-b620945c1684 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043059 Oct 29 01:21:54.485355 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 704/1422] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:54 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:21:54.506088 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-d7690dfa-ffe1-4f72-b25d-40db2c693919 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:54.516786 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d7690dfa-ffe1-4f72-b25d-40db2c693919 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.148063 Oct 29 01:21:54.517488 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 719/1423] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:54 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:55.370948 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-439dd1bc-804d-438a-9538-78813edffc45 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:55.371899 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-439dd1bc-804d-438a-9538-78813edffc45 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:55.378249 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-439dd1bc-804d-438a-9538-78813edffc45 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:55.378729 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-439dd1bc-804d-438a-9538-78813edffc45 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:55.379519 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-439dd1bc-804d-438a-9538-78813edffc45 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:55.379949 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-439dd1bc-804d-438a-9538-78813edffc45 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:55.444474 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-439dd1bc-804d-438a-9538-78813edffc45 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:55.451966 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-439dd1bc-804d-438a-9538-78813edffc45 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.084762 Oct 29 01:21:55.452552 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 705/1424] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:55 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:55.496514 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-cb149f9c-1a5c-42f2-8e89-8307607eca80 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:55.497429 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-cb149f9c-1a5c-42f2-8e89-8307607eca80 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:55.503711 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cb149f9c-1a5c-42f2-8e89-8307607eca80 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:55.504160 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cb149f9c-1a5c-42f2-8e89-8307607eca80 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:55.504922 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cb149f9c-1a5c-42f2-8e89-8307607eca80 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:55.505356 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cb149f9c-1a5c-42f2-8e89-8307607eca80 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:55.533882 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f028a1df-925e-44a1-8dc3-751b181edcef tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:55.534527 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f028a1df-925e-44a1-8dc3-751b181edcef tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:55.537704 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-cb149f9c-1a5c-42f2-8e89-8307607eca80 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044908 Oct 29 01:21:55.538279 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 720/1425] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:55 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:55.541336 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f028a1df-925e-44a1-8dc3-751b181edcef tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:55.542427 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f028a1df-925e-44a1-8dc3-751b181edcef tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:55.543223 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f028a1df-925e-44a1-8dc3-751b181edcef tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:55.543656 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f028a1df-925e-44a1-8dc3-751b181edcef tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:55.672561 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-f028a1df-925e-44a1-8dc3-751b181edcef tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:55.681613 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f028a1df-925e-44a1-8dc3-751b181edcef tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.151262 Oct 29 01:21:55.682261 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 706/1426] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:55 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:21:56.469019 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-897e610e-f695-48e7-b0e1-de6cc5bc04ac tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:56.469630 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-897e610e-f695-48e7-b0e1-de6cc5bc04ac tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:56.476069 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-897e610e-f695-48e7-b0e1-de6cc5bc04ac tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:56.476517 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-897e610e-f695-48e7-b0e1-de6cc5bc04ac tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:56.477374 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-897e610e-f695-48e7-b0e1-de6cc5bc04ac tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:56.477809 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-897e610e-f695-48e7-b0e1-de6cc5bc04ac tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:56.540145 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-897e610e-f695-48e7-b0e1-de6cc5bc04ac tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:56.548306 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-897e610e-f695-48e7-b0e1-de6cc5bc04ac tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.082927 Oct 29 01:21:56.548960 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 721/1427] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:56 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:56.549352 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-0b941cf7-d163-4ae5-b19f-f0501be34ab7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:56.551135 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-0b941cf7-d163-4ae5-b19f-f0501be34ab7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:56.557618 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0b941cf7-d163-4ae5-b19f-f0501be34ab7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:56.558067 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0b941cf7-d163-4ae5-b19f-f0501be34ab7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:56.558895 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0b941cf7-d163-4ae5-b19f-f0501be34ab7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:56.559333 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0b941cf7-d163-4ae5-b19f-f0501be34ab7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:56.589230 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-0b941cf7-d163-4ae5-b19f-f0501be34ab7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043646 Oct 29 01:21:56.589868 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 707/1428] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:56 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:56.699938 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-938f9c47-1650-40f5-afdd-6b310f6e8b21 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:56.700541 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-938f9c47-1650-40f5-afdd-6b310f6e8b21 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:56.706329 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-938f9c47-1650-40f5-afdd-6b310f6e8b21 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:56.706829 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-938f9c47-1650-40f5-afdd-6b310f6e8b21 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:56.707583 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-938f9c47-1650-40f5-afdd-6b310f6e8b21 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:56.708013 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-938f9c47-1650-40f5-afdd-6b310f6e8b21 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:56.831012 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-938f9c47-1650-40f5-afdd-6b310f6e8b21 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:56.839265 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-938f9c47-1650-40f5-afdd-6b310f6e8b21 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.143183 Oct 29 01:21:56.839826 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 722/1429] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:56 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:57.564936 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-50cca819-39f7-42e5-b72f-3980c61a5ec5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:57.565555 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-50cca819-39f7-42e5-b72f-3980c61a5ec5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:57.572569 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-50cca819-39f7-42e5-b72f-3980c61a5ec5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:57.573031 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-50cca819-39f7-42e5-b72f-3980c61a5ec5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:57.573793 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-50cca819-39f7-42e5-b72f-3980c61a5ec5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:57.574222 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-50cca819-39f7-42e5-b72f-3980c61a5ec5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:57.600675 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-01b097e7-22eb-4e8f-9a6a-02608cf0622c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:57.601605 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-01b097e7-22eb-4e8f-9a6a-02608cf0622c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:57.607969 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-01b097e7-22eb-4e8f-9a6a-02608cf0622c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:57.608419 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-01b097e7-22eb-4e8f-9a6a-02608cf0622c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:57.609212 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-01b097e7-22eb-4e8f-9a6a-02608cf0622c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:57.609644 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-01b097e7-22eb-4e8f-9a6a-02608cf0622c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:57.639957 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-50cca819-39f7-42e5-b72f-3980c61a5ec5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:57.642809 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-01b097e7-22eb-4e8f-9a6a-02608cf0622c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045946 Oct 29 01:21:57.643398 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 723/1430] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:57 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:21:57.648365 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-50cca819-39f7-42e5-b72f-3980c61a5ec5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.087048 Oct 29 01:21:57.650980 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 708/1431] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:57 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:57.857008 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-6083c3d7-68dc-432c-88bd-adf34dd4d61f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:57.857613 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-6083c3d7-68dc-432c-88bd-adf34dd4d61f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:57.864298 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6083c3d7-68dc-432c-88bd-adf34dd4d61f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:57.864745 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6083c3d7-68dc-432c-88bd-adf34dd4d61f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:57.865514 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6083c3d7-68dc-432c-88bd-adf34dd4d61f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:57.865946 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6083c3d7-68dc-432c-88bd-adf34dd4d61f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:57.992956 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-6083c3d7-68dc-432c-88bd-adf34dd4d61f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:58.004180 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-6083c3d7-68dc-432c-88bd-adf34dd4d61f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.150837 Oct 29 01:21:58.004788 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 724/1432] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:57 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:58.654254 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-5062f663-470c-40fb-bb43-0e9db17ad4fb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:58.655208 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-5062f663-470c-40fb-bb43-0e9db17ad4fb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:58.662097 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5062f663-470c-40fb-bb43-0e9db17ad4fb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:58.662599 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5062f663-470c-40fb-bb43-0e9db17ad4fb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:58.663367 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5062f663-470c-40fb-bb43-0e9db17ad4fb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:58.663805 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5062f663-470c-40fb-bb43-0e9db17ad4fb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:58.665204 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-5c3445fc-cf87-4c90-9178-9d1edd6154ab tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:58.665815 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-5c3445fc-cf87-4c90-9178-9d1edd6154ab tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:58.671960 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5c3445fc-cf87-4c90-9178-9d1edd6154ab tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:58.672403 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5c3445fc-cf87-4c90-9178-9d1edd6154ab tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:58.673164 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5c3445fc-cf87-4c90-9178-9d1edd6154ab tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:58.673594 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5c3445fc-cf87-4c90-9178-9d1edd6154ab tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:58.692790 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-5062f663-470c-40fb-bb43-0e9db17ad4fb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042285 Oct 29 01:21:58.693363 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 709/1433] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:58 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:58.735755 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-5c3445fc-cf87-4c90-9178-9d1edd6154ab tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:58.743326 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-5c3445fc-cf87-4c90-9178-9d1edd6154ab tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.081850 Oct 29 01:21:58.743902 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 725/1434] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:58 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:21:59.021857 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-478032d1-9e88-49d2-bc1a-f6ed186ea371 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:59.022490 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-478032d1-9e88-49d2-bc1a-f6ed186ea371 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:59.028651 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-478032d1-9e88-49d2-bc1a-f6ed186ea371 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:59.029153 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-478032d1-9e88-49d2-bc1a-f6ed186ea371 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:59.029872 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-478032d1-9e88-49d2-bc1a-f6ed186ea371 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:59.030302 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-478032d1-9e88-49d2-bc1a-f6ed186ea371 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:59.154730 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-478032d1-9e88-49d2-bc1a-f6ed186ea371 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:59.162991 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-478032d1-9e88-49d2-bc1a-f6ed186ea371 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.145350 Oct 29 01:21:59.163567 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 710/1435] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:59 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:59.704688 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-5b35cbbc-c281-43c2-b2fd-b90b38a5ff80 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:59.705638 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-5b35cbbc-c281-43c2-b2fd-b90b38a5ff80 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:59.712919 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5b35cbbc-c281-43c2-b2fd-b90b38a5ff80 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:59.713369 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5b35cbbc-c281-43c2-b2fd-b90b38a5ff80 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:59.714157 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5b35cbbc-c281-43c2-b2fd-b90b38a5ff80 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:59.714636 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5b35cbbc-c281-43c2-b2fd-b90b38a5ff80 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:59.743460 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-5b35cbbc-c281-43c2-b2fd-b90b38a5ff80 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042639 Oct 29 01:21:59.744018 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 726/1436] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:21:59 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:59.760175 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-3511c797-da79-4d2c-a657-6feb50293195 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:59.760775 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-3511c797-da79-4d2c-a657-6feb50293195 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:21:59.767161 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3511c797-da79-4d2c-a657-6feb50293195 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:59.767602 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3511c797-da79-4d2c-a657-6feb50293195 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:59.768369 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3511c797-da79-4d2c-a657-6feb50293195 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:21:59.768795 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3511c797-da79-4d2c-a657-6feb50293195 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:21:59.835200 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-3511c797-da79-4d2c-a657-6feb50293195 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:59.843158 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-3511c797-da79-4d2c-a657-6feb50293195 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.086591 Oct 29 01:21:59.843724 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 711/1437] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:21:59 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:00.180732 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-3cdfb298-312d-48aa-9ea5-637008c360b3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:00.181340 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-3cdfb298-312d-48aa-9ea5-637008c360b3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:00.187252 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3cdfb298-312d-48aa-9ea5-637008c360b3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:00.187698 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3cdfb298-312d-48aa-9ea5-637008c360b3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:00.188469 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3cdfb298-312d-48aa-9ea5-637008c360b3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:00.188904 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3cdfb298-312d-48aa-9ea5-637008c360b3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:00.322893 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-3cdfb298-312d-48aa-9ea5-637008c360b3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:00.330375 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-3cdfb298-312d-48aa-9ea5-637008c360b3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.153445 Oct 29 01:22:00.330966 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 727/1438] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:00 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:00.755157 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-55c31307-01b5-4d79-96ea-921e463ac92c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:00.756078 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-55c31307-01b5-4d79-96ea-921e463ac92c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:00.762000 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-55c31307-01b5-4d79-96ea-921e463ac92c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:00.762607 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-55c31307-01b5-4d79-96ea-921e463ac92c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:00.763253 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-55c31307-01b5-4d79-96ea-921e463ac92c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:00.763690 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-55c31307-01b5-4d79-96ea-921e463ac92c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:00.793409 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-55c31307-01b5-4d79-96ea-921e463ac92c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042106 Oct 29 01:22:00.793976 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 712/1439] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:00 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:00.859910 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-a3e65eb4-01dc-43ab-993f-130ab048f43f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:00.860514 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-a3e65eb4-01dc-43ab-993f-130ab048f43f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:00.867409 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a3e65eb4-01dc-43ab-993f-130ab048f43f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:00.867849 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a3e65eb4-01dc-43ab-993f-130ab048f43f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:00.868615 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a3e65eb4-01dc-43ab-993f-130ab048f43f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:00.869045 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a3e65eb4-01dc-43ab-993f-130ab048f43f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:00.928720 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-a3e65eb4-01dc-43ab-993f-130ab048f43f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:00.936169 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-a3e65eb4-01dc-43ab-993f-130ab048f43f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.079971 Oct 29 01:22:00.936729 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 728/1440] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:00 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:01.347972 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a3f82dc8-a3fc-4a2b-b961-e908dbcf4327 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:01.349882 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a3f82dc8-a3fc-4a2b-b961-e908dbcf4327 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:01.355771 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a3f82dc8-a3fc-4a2b-b961-e908dbcf4327 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:01.356218 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a3f82dc8-a3fc-4a2b-b961-e908dbcf4327 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:01.356985 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a3f82dc8-a3fc-4a2b-b961-e908dbcf4327 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:01.357423 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a3f82dc8-a3fc-4a2b-b961-e908dbcf4327 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:01.483379 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-a3f82dc8-a3fc-4a2b-b961-e908dbcf4327 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:01.493356 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a3f82dc8-a3fc-4a2b-b961-e908dbcf4327 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.149131 Oct 29 01:22:01.493929 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 713/1441] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:01 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:01.805656 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-336195ab-4bb9-4dc4-8c57-eff2eea5b893 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:01.806516 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-336195ab-4bb9-4dc4-8c57-eff2eea5b893 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:01.812666 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-336195ab-4bb9-4dc4-8c57-eff2eea5b893 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:01.813119 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-336195ab-4bb9-4dc4-8c57-eff2eea5b893 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:01.813886 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-336195ab-4bb9-4dc4-8c57-eff2eea5b893 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:01.814323 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-336195ab-4bb9-4dc4-8c57-eff2eea5b893 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:01.843468 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-336195ab-4bb9-4dc4-8c57-eff2eea5b893 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041599 Oct 29 01:22:01.844044 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 729/1442] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:01 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:01.952760 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a3987b4b-8ade-4813-9fa6-bfd7071be89b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:01.953374 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a3987b4b-8ade-4813-9fa6-bfd7071be89b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:01.960051 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a3987b4b-8ade-4813-9fa6-bfd7071be89b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:01.960497 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a3987b4b-8ade-4813-9fa6-bfd7071be89b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:01.961272 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a3987b4b-8ade-4813-9fa6-bfd7071be89b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:01.961708 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a3987b4b-8ade-4813-9fa6-bfd7071be89b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:02.024209 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-a3987b4b-8ade-4813-9fa6-bfd7071be89b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:02.032895 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a3987b4b-8ade-4813-9fa6-bfd7071be89b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.083748 Oct 29 01:22:02.033567 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 714/1443] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:01 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:02.509948 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-10637bf5-8fc2-4be7-bb2c-9d2da3ba98e5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:02.510595 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-10637bf5-8fc2-4be7-bb2c-9d2da3ba98e5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:02.517401 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-10637bf5-8fc2-4be7-bb2c-9d2da3ba98e5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:02.517877 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-10637bf5-8fc2-4be7-bb2c-9d2da3ba98e5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:02.518696 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-10637bf5-8fc2-4be7-bb2c-9d2da3ba98e5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:02.519757 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-10637bf5-8fc2-4be7-bb2c-9d2da3ba98e5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:02.644881 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-10637bf5-8fc2-4be7-bb2c-9d2da3ba98e5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:02.652792 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-10637bf5-8fc2-4be7-bb2c-9d2da3ba98e5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.146652 Oct 29 01:22:02.653367 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 730/1444] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:02 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:02.855636 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-4983921e-0f2b-46f3-98af-358ac0422dea tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:02.856553 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-4983921e-0f2b-46f3-98af-358ac0422dea tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:02.862421 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4983921e-0f2b-46f3-98af-358ac0422dea tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:02.863380 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4983921e-0f2b-46f3-98af-358ac0422dea tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:02.864143 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4983921e-0f2b-46f3-98af-358ac0422dea tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:02.864579 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4983921e-0f2b-46f3-98af-358ac0422dea tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:02.897487 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-4983921e-0f2b-46f3-98af-358ac0422dea tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045521 Oct 29 01:22:02.898064 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 715/1445] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:02 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:03.052456 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-1557ba93-5a3a-4f83-bfce-3bcccc42092b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:03.054662 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-1557ba93-5a3a-4f83-bfce-3bcccc42092b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:03.060971 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1557ba93-5a3a-4f83-bfce-3bcccc42092b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:03.061437 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1557ba93-5a3a-4f83-bfce-3bcccc42092b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:03.062227 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1557ba93-5a3a-4f83-bfce-3bcccc42092b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:03.062702 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1557ba93-5a3a-4f83-bfce-3bcccc42092b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:03.125055 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-1557ba93-5a3a-4f83-bfce-3bcccc42092b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:03.133478 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-1557ba93-5a3a-4f83-bfce-3bcccc42092b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.085252 Oct 29 01:22:03.134067 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 731/1446] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:03 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:03.669113 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a49605d4-b4e7-4f70-90ef-929cd2318ed0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:03.669733 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a49605d4-b4e7-4f70-90ef-929cd2318ed0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:03.675784 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a49605d4-b4e7-4f70-90ef-929cd2318ed0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:03.676239 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a49605d4-b4e7-4f70-90ef-929cd2318ed0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:03.677021 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a49605d4-b4e7-4f70-90ef-929cd2318ed0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:03.677463 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a49605d4-b4e7-4f70-90ef-929cd2318ed0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:03.808015 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-a49605d4-b4e7-4f70-90ef-929cd2318ed0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:03.815496 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a49605d4-b4e7-4f70-90ef-929cd2318ed0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.150275 Oct 29 01:22:03.816077 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 716/1447] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:03 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:03.909018 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f60e778a-f80a-4f63-8564-9678847c1add tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:03.910637 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f60e778a-f80a-4f63-8564-9678847c1add tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:03.917073 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f60e778a-f80a-4f63-8564-9678847c1add tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:03.917518 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f60e778a-f80a-4f63-8564-9678847c1add tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:03.918291 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f60e778a-f80a-4f63-8564-9678847c1add tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:03.918759 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f60e778a-f80a-4f63-8564-9678847c1add tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:03.948891 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f60e778a-f80a-4f63-8564-9678847c1add tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043489 Oct 29 01:22:03.949380 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 732/1448] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:03 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:04.151139 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-975f967c-888e-4aaa-94c8-647b997f63eb tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:04.151766 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-975f967c-888e-4aaa-94c8-647b997f63eb tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:04.158052 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-975f967c-888e-4aaa-94c8-647b997f63eb tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:04.158541 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-975f967c-888e-4aaa-94c8-647b997f63eb tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:04.159342 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-975f967c-888e-4aaa-94c8-647b997f63eb tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:04.160272 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-975f967c-888e-4aaa-94c8-647b997f63eb tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:04.221392 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-975f967c-888e-4aaa-94c8-647b997f63eb tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:04.229420 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-975f967c-888e-4aaa-94c8-647b997f63eb tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.082151 Oct 29 01:22:04.229980 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 717/1449] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:04 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:04.832941 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-7da3a28a-5556-4bcd-9779-13086e36b072 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:04.833541 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-7da3a28a-5556-4bcd-9779-13086e36b072 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:04.839903 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7da3a28a-5556-4bcd-9779-13086e36b072 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:04.840343 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7da3a28a-5556-4bcd-9779-13086e36b072 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:04.841150 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7da3a28a-5556-4bcd-9779-13086e36b072 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:04.841577 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7da3a28a-5556-4bcd-9779-13086e36b072 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:04.960892 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-18b27cc1-93e9-4c5a-baaa-7daa3d433e43 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:04.961859 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-18b27cc1-93e9-4c5a-baaa-7daa3d433e43 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:04.968680 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-18b27cc1-93e9-4c5a-baaa-7daa3d433e43 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:04.969136 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-18b27cc1-93e9-4c5a-baaa-7daa3d433e43 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:04.969414 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-7da3a28a-5556-4bcd-9779-13086e36b072 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:04.969916 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-18b27cc1-93e9-4c5a-baaa-7daa3d433e43 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:04.970354 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-18b27cc1-93e9-4c5a-baaa-7daa3d433e43 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:04.977740 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-7da3a28a-5556-4bcd-9779-13086e36b072 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.149155 Oct 29 01:22:04.978338 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 733/1450] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:04 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:05.000764 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-18b27cc1-93e9-4c5a-baaa-7daa3d433e43 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044251 Oct 29 01:22:05.001344 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 718/1451] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:04 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:22:05.247090 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-7df66983-1e7b-4998-a577-57a31435b34a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:05.247712 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-7df66983-1e7b-4998-a577-57a31435b34a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:05.254717 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7df66983-1e7b-4998-a577-57a31435b34a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:05.255183 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7df66983-1e7b-4998-a577-57a31435b34a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:05.255997 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7df66983-1e7b-4998-a577-57a31435b34a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:05.256447 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7df66983-1e7b-4998-a577-57a31435b34a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:05.322819 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-7df66983-1e7b-4998-a577-57a31435b34a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:05.330998 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-7df66983-1e7b-4998-a577-57a31435b34a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.087699 Oct 29 01:22:05.331647 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 734/1452] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:05 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:05.994102 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-1a028260-55e0-409c-bdc2-1f93b2f992a7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:05.994726 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-1a028260-55e0-409c-bdc2-1f93b2f992a7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:06.001205 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1a028260-55e0-409c-bdc2-1f93b2f992a7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:06.001658 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1a028260-55e0-409c-bdc2-1f93b2f992a7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:06.002486 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1a028260-55e0-409c-bdc2-1f93b2f992a7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:06.002927 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1a028260-55e0-409c-bdc2-1f93b2f992a7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:06.012929 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-ac2fe63a-cf23-4f05-93f0-1bce67937b3c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:06.013846 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-ac2fe63a-cf23-4f05-93f0-1bce67937b3c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:06.020941 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ac2fe63a-cf23-4f05-93f0-1bce67937b3c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:06.021386 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ac2fe63a-cf23-4f05-93f0-1bce67937b3c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:06.022173 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ac2fe63a-cf23-4f05-93f0-1bce67937b3c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:06.022835 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ac2fe63a-cf23-4f05-93f0-1bce67937b3c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:06.054195 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-ac2fe63a-cf23-4f05-93f0-1bce67937b3c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045019 Oct 29 01:22:06.054820 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 735/1453] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:06 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:22:06.127224 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-1a028260-55e0-409c-bdc2-1f93b2f992a7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:06.134771 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-1a028260-55e0-409c-bdc2-1f93b2f992a7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.144306 Oct 29 01:22:06.135338 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 719/1454] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:05 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:06.348316 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-0c6b775a-bf85-4c4d-9fdc-899c5aeab9c2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:06.348934 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-0c6b775a-bf85-4c4d-9fdc-899c5aeab9c2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:06.354748 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0c6b775a-bf85-4c4d-9fdc-899c5aeab9c2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:06.355197 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0c6b775a-bf85-4c4d-9fdc-899c5aeab9c2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:06.355965 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0c6b775a-bf85-4c4d-9fdc-899c5aeab9c2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:06.356398 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0c6b775a-bf85-4c4d-9fdc-899c5aeab9c2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:06.417520 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-0c6b775a-bf85-4c4d-9fdc-899c5aeab9c2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:06.425295 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-0c6b775a-bf85-4c4d-9fdc-899c5aeab9c2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.080629 Oct 29 01:22:06.425869 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 736/1455] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:06 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:07.065207 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-cadce506-da6f-4a23-893c-88cb9ff73d8e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:07.066125 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-cadce506-da6f-4a23-893c-88cb9ff73d8e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:07.072459 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cadce506-da6f-4a23-893c-88cb9ff73d8e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:07.072912 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cadce506-da6f-4a23-893c-88cb9ff73d8e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:07.073681 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cadce506-da6f-4a23-893c-88cb9ff73d8e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:07.074118 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cadce506-da6f-4a23-893c-88cb9ff73d8e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:07.106135 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-cadce506-da6f-4a23-893c-88cb9ff73d8e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044649 Oct 29 01:22:07.106732 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 720/1456] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:07 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:07.151575 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-caa58d78-392e-4ea4-99bb-def0abda1aac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:07.152178 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-caa58d78-392e-4ea4-99bb-def0abda1aac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:07.158012 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-caa58d78-392e-4ea4-99bb-def0abda1aac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:07.158548 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-caa58d78-392e-4ea4-99bb-def0abda1aac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:07.159312 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-caa58d78-392e-4ea4-99bb-def0abda1aac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:07.160237 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-caa58d78-392e-4ea4-99bb-def0abda1aac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:07.284287 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-caa58d78-392e-4ea4-99bb-def0abda1aac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:07.292953 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-caa58d78-392e-4ea4-99bb-def0abda1aac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.144962 Oct 29 01:22:07.293527 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 737/1457] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:07 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:07.441845 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-587f5581-2215-4abd-b028-141d57927e86 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:07.442464 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-587f5581-2215-4abd-b028-141d57927e86 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:07.448597 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-587f5581-2215-4abd-b028-141d57927e86 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:07.449127 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-587f5581-2215-4abd-b028-141d57927e86 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:07.449821 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-587f5581-2215-4abd-b028-141d57927e86 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:07.450259 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-587f5581-2215-4abd-b028-141d57927e86 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:07.516541 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-587f5581-2215-4abd-b028-141d57927e86 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:07.524799 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-587f5581-2215-4abd-b028-141d57927e86 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.086547 Oct 29 01:22:07.525373 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 721/1458] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:07 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:08.117822 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-646877f0-bd70-4fce-901d-addd3c8ef9cf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:08.118804 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-646877f0-bd70-4fce-901d-addd3c8ef9cf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:08.125044 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-646877f0-bd70-4fce-901d-addd3c8ef9cf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:08.125494 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-646877f0-bd70-4fce-901d-addd3c8ef9cf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:08.126255 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-646877f0-bd70-4fce-901d-addd3c8ef9cf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:08.126721 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-646877f0-bd70-4fce-901d-addd3c8ef9cf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:08.155633 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-646877f0-bd70-4fce-901d-addd3c8ef9cf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041463 Oct 29 01:22:08.156258 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 738/1459] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:08 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:08.310082 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-fdac3156-bf42-442e-8bd9-e1bf6f2a53ce tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:08.310724 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-fdac3156-bf42-442e-8bd9-e1bf6f2a53ce tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:08.317679 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fdac3156-bf42-442e-8bd9-e1bf6f2a53ce tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:08.318129 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fdac3156-bf42-442e-8bd9-e1bf6f2a53ce tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:08.318923 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fdac3156-bf42-442e-8bd9-e1bf6f2a53ce tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:08.319353 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fdac3156-bf42-442e-8bd9-e1bf6f2a53ce tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:08.436662 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-fdac3156-bf42-442e-8bd9-e1bf6f2a53ce tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:08.445654 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-fdac3156-bf42-442e-8bd9-e1bf6f2a53ce tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.139045 Oct 29 01:22:08.446741 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 722/1460] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:08 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:08.544787 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-8a692f1d-a892-458e-88e2-d5b5dcd9eb4c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:08.545398 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-8a692f1d-a892-458e-88e2-d5b5dcd9eb4c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:08.551930 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8a692f1d-a892-458e-88e2-d5b5dcd9eb4c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:08.552378 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8a692f1d-a892-458e-88e2-d5b5dcd9eb4c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:08.553141 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8a692f1d-a892-458e-88e2-d5b5dcd9eb4c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:08.553572 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8a692f1d-a892-458e-88e2-d5b5dcd9eb4c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:08.613341 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-8a692f1d-a892-458e-88e2-d5b5dcd9eb4c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:08.620614 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-8a692f1d-a892-458e-88e2-d5b5dcd9eb4c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.079510 Oct 29 01:22:08.621184 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 739/1461] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:08 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:09.167032 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f143d97b-23ee-4837-97ec-0d3e9cf7931f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:09.168272 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f143d97b-23ee-4837-97ec-0d3e9cf7931f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:09.174047 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f143d97b-23ee-4837-97ec-0d3e9cf7931f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:09.174534 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f143d97b-23ee-4837-97ec-0d3e9cf7931f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:09.175383 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f143d97b-23ee-4837-97ec-0d3e9cf7931f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:09.175845 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f143d97b-23ee-4837-97ec-0d3e9cf7931f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:09.208241 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f143d97b-23ee-4837-97ec-0d3e9cf7931f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044946 Oct 29 01:22:09.208860 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 723/1462] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:09 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:09.465573 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-94821f5a-cbfb-447c-8cf8-a40a1630538c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:09.466174 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-94821f5a-cbfb-447c-8cf8-a40a1630538c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:09.472935 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-94821f5a-cbfb-447c-8cf8-a40a1630538c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:09.473377 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-94821f5a-cbfb-447c-8cf8-a40a1630538c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:09.474154 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-94821f5a-cbfb-447c-8cf8-a40a1630538c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:09.474642 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-94821f5a-cbfb-447c-8cf8-a40a1630538c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:09.612963 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-94821f5a-cbfb-447c-8cf8-a40a1630538c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:09.622050 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-94821f5a-cbfb-447c-8cf8-a40a1630538c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.160421 Oct 29 01:22:09.622777 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 740/1463] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:09 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:09.637158 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f8ccf84c-9c1f-427d-ab42-f6a405d397e5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:09.637765 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f8ccf84c-9c1f-427d-ab42-f6a405d397e5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:09.644383 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f8ccf84c-9c1f-427d-ab42-f6a405d397e5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:09.644842 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f8ccf84c-9c1f-427d-ab42-f6a405d397e5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:09.645616 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f8ccf84c-9c1f-427d-ab42-f6a405d397e5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:09.646051 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f8ccf84c-9c1f-427d-ab42-f6a405d397e5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:09.707923 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-f8ccf84c-9c1f-427d-ab42-f6a405d397e5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:09.715571 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f8ccf84c-9c1f-427d-ab42-f6a405d397e5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.082307 Oct 29 01:22:09.716207 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 724/1464] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:09 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:10.219668 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-347e8b68-59d3-4cb2-acae-ecd4bbba7f23 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:10.220679 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-347e8b68-59d3-4cb2-acae-ecd4bbba7f23 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:10.227113 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-347e8b68-59d3-4cb2-acae-ecd4bbba7f23 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:10.227561 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-347e8b68-59d3-4cb2-acae-ecd4bbba7f23 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:10.228339 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-347e8b68-59d3-4cb2-acae-ecd4bbba7f23 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:10.228766 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-347e8b68-59d3-4cb2-acae-ecd4bbba7f23 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:10.258955 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-347e8b68-59d3-4cb2-acae-ecd4bbba7f23 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042961 Oct 29 01:22:10.259549 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 741/1465] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:10 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:10.639907 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-87df3c33-14de-4bea-b939-c130b361723e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:10.640628 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-87df3c33-14de-4bea-b939-c130b361723e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:10.647585 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-87df3c33-14de-4bea-b939-c130b361723e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:10.648030 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-87df3c33-14de-4bea-b939-c130b361723e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:10.648810 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-87df3c33-14de-4bea-b939-c130b361723e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:10.649222 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-87df3c33-14de-4bea-b939-c130b361723e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:10.732208 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-da8ba33f-98fb-4596-a0e4-ef709334597f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:10.732826 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-da8ba33f-98fb-4596-a0e4-ef709334597f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:10.739289 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-da8ba33f-98fb-4596-a0e4-ef709334597f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:10.739744 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-da8ba33f-98fb-4596-a0e4-ef709334597f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:10.740517 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-da8ba33f-98fb-4596-a0e4-ef709334597f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:10.740994 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-da8ba33f-98fb-4596-a0e4-ef709334597f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:10.769918 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-87df3c33-14de-4bea-b939-c130b361723e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:10.777525 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-87df3c33-14de-4bea-b939-c130b361723e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.141238 Oct 29 01:22:10.778103 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 725/1466] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:10 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:10.799749 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-da8ba33f-98fb-4596-a0e4-ef709334597f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:10.807120 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-da8ba33f-98fb-4596-a0e4-ef709334597f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.078637 Oct 29 01:22:10.807685 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 742/1467] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:10 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:22:11.271144 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-e27ab3ec-5d6c-42e5-a600-04fb8726bce3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:11.271977 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-e27ab3ec-5d6c-42e5-a600-04fb8726bce3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:11.277815 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e27ab3ec-5d6c-42e5-a600-04fb8726bce3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:11.278260 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e27ab3ec-5d6c-42e5-a600-04fb8726bce3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:11.279060 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e27ab3ec-5d6c-42e5-a600-04fb8726bce3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:11.279496 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e27ab3ec-5d6c-42e5-a600-04fb8726bce3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:11.309654 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-e27ab3ec-5d6c-42e5-a600-04fb8726bce3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042884 Oct 29 01:22:11.310245 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 726/1468] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:11 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:11.794609 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-77c0ee48-4feb-43c8-b3c9-37b204895068 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:11.795211 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-77c0ee48-4feb-43c8-b3c9-37b204895068 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:11.801559 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-77c0ee48-4feb-43c8-b3c9-37b204895068 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:11.802012 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-77c0ee48-4feb-43c8-b3c9-37b204895068 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:11.802822 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-77c0ee48-4feb-43c8-b3c9-37b204895068 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:11.803261 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-77c0ee48-4feb-43c8-b3c9-37b204895068 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:11.823986 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-51c98db3-063a-403c-acb1-6b313e7f8db8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:11.824594 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-51c98db3-063a-403c-acb1-6b313e7f8db8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:11.830848 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-51c98db3-063a-403c-acb1-6b313e7f8db8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:11.831975 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-51c98db3-063a-403c-acb1-6b313e7f8db8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:11.832747 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-51c98db3-063a-403c-acb1-6b313e7f8db8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:11.833172 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-51c98db3-063a-403c-acb1-6b313e7f8db8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:11.898365 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-51c98db3-063a-403c-acb1-6b313e7f8db8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:11.905648 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-51c98db3-063a-403c-acb1-6b313e7f8db8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.085182 Oct 29 01:22:11.906225 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 727/1469] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:11 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:22:11.956271 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-77c0ee48-4feb-43c8-b3c9-37b204895068 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:11.964062 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-77c0ee48-4feb-43c8-b3c9-37b204895068 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.173146 Oct 29 01:22:11.964633 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 743/1470] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:11 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:12.321288 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-56864d70-f74f-4ccf-9355-ff5fb1f2b39c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:12.322195 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-56864d70-f74f-4ccf-9355-ff5fb1f2b39c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:12.327945 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-56864d70-f74f-4ccf-9355-ff5fb1f2b39c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:12.328393 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-56864d70-f74f-4ccf-9355-ff5fb1f2b39c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:12.329143 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-56864d70-f74f-4ccf-9355-ff5fb1f2b39c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:12.329572 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-56864d70-f74f-4ccf-9355-ff5fb1f2b39c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:12.358468 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-56864d70-f74f-4ccf-9355-ff5fb1f2b39c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041017 Oct 29 01:22:12.359013 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 728/1471] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:12 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:12.921778 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d7a82c40-858c-481d-9f73-e54c7b2146b8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:12.922435 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d7a82c40-858c-481d-9f73-e54c7b2146b8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:12.929205 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d7a82c40-858c-481d-9f73-e54c7b2146b8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:12.929643 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d7a82c40-858c-481d-9f73-e54c7b2146b8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:12.930426 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d7a82c40-858c-481d-9f73-e54c7b2146b8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:12.930861 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d7a82c40-858c-481d-9f73-e54c7b2146b8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:12.981046 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-e79ce9c8-0a63-4c8f-9e3f-cb9c4b96cae1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:12.981821 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-e79ce9c8-0a63-4c8f-9e3f-cb9c4b96cae1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:12.988959 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e79ce9c8-0a63-4c8f-9e3f-cb9c4b96cae1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:12.989778 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e79ce9c8-0a63-4c8f-9e3f-cb9c4b96cae1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:12.990439 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e79ce9c8-0a63-4c8f-9e3f-cb9c4b96cae1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:12.990949 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e79ce9c8-0a63-4c8f-9e3f-cb9c4b96cae1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:12.992027 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-d7a82c40-858c-481d-9f73-e54c7b2146b8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:12.999394 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d7a82c40-858c-481d-9f73-e54c7b2146b8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.081228 Oct 29 01:22:12.999963 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 744/1472] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:12 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:13.116661 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-e79ce9c8-0a63-4c8f-9e3f-cb9c4b96cae1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:13.124243 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-e79ce9c8-0a63-4c8f-9e3f-cb9c4b96cae1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.146853 Oct 29 01:22:13.124844 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 729/1473] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:12 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:22:13.369018 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-9af071bf-8c56-42f0-b48d-a4389bf70e50 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:13.369941 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-9af071bf-8c56-42f0-b48d-a4389bf70e50 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:13.375856 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9af071bf-8c56-42f0-b48d-a4389bf70e50 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:13.376300 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9af071bf-8c56-42f0-b48d-a4389bf70e50 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:13.377064 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9af071bf-8c56-42f0-b48d-a4389bf70e50 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:13.377490 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9af071bf-8c56-42f0-b48d-a4389bf70e50 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:13.406909 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-9af071bf-8c56-42f0-b48d-a4389bf70e50 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041506 Oct 29 01:22:13.407481 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 745/1474] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:13 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:14.016259 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-0ffeae93-7f62-4b3d-90ca-cb5e5eb45844 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:14.016865 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-0ffeae93-7f62-4b3d-90ca-cb5e5eb45844 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:14.023334 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0ffeae93-7f62-4b3d-90ca-cb5e5eb45844 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:14.023784 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0ffeae93-7f62-4b3d-90ca-cb5e5eb45844 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:14.024602 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0ffeae93-7f62-4b3d-90ca-cb5e5eb45844 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:14.025031 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0ffeae93-7f62-4b3d-90ca-cb5e5eb45844 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:14.085258 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-0ffeae93-7f62-4b3d-90ca-cb5e5eb45844 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:14.092950 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-0ffeae93-7f62-4b3d-90ca-cb5e5eb45844 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.080352 Oct 29 01:22:14.093514 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 730/1475] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:14 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:14.140689 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-3760f8ce-ff45-4b5a-bb7d-f5a8b87427d2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:14.141324 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-3760f8ce-ff45-4b5a-bb7d-f5a8b87427d2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:14.148100 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3760f8ce-ff45-4b5a-bb7d-f5a8b87427d2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:14.148545 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3760f8ce-ff45-4b5a-bb7d-f5a8b87427d2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:14.149297 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3760f8ce-ff45-4b5a-bb7d-f5a8b87427d2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:14.149726 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3760f8ce-ff45-4b5a-bb7d-f5a8b87427d2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:14.267197 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-3760f8ce-ff45-4b5a-bb7d-f5a8b87427d2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:14.275044 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-3760f8ce-ff45-4b5a-bb7d-f5a8b87427d2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.137967 Oct 29 01:22:14.275604 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 746/1476] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:14 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:14.418947 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-25aaec10-63ec-4a83-b7d4-423564f5a90c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:14.419853 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-25aaec10-63ec-4a83-b7d4-423564f5a90c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:14.425607 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-25aaec10-63ec-4a83-b7d4-423564f5a90c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:14.426035 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-25aaec10-63ec-4a83-b7d4-423564f5a90c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:14.426814 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-25aaec10-63ec-4a83-b7d4-423564f5a90c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:14.427246 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-25aaec10-63ec-4a83-b7d4-423564f5a90c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:14.455157 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-25aaec10-63ec-4a83-b7d4-423564f5a90c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039944 Oct 29 01:22:14.455702 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 731/1477] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:14 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:15.110314 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-213b7e3e-1c2c-4653-ace6-9a1f4a5300f3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:15.110937 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-213b7e3e-1c2c-4653-ace6-9a1f4a5300f3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:15.116787 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-213b7e3e-1c2c-4653-ace6-9a1f4a5300f3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:15.117235 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-213b7e3e-1c2c-4653-ace6-9a1f4a5300f3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:15.118244 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-213b7e3e-1c2c-4653-ace6-9a1f4a5300f3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:15.118244 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-213b7e3e-1c2c-4653-ace6-9a1f4a5300f3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:15.179175 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-213b7e3e-1c2c-4653-ace6-9a1f4a5300f3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:15.186469 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-213b7e3e-1c2c-4653-ace6-9a1f4a5300f3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.079851 Oct 29 01:22:15.187037 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 747/1478] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:15 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:15.292981 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c528eab3-4d6a-45bd-af7d-a3e379a569af tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:15.293525 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c528eab3-4d6a-45bd-af7d-a3e379a569af tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:15.299698 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c528eab3-4d6a-45bd-af7d-a3e379a569af tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:15.300630 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c528eab3-4d6a-45bd-af7d-a3e379a569af tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:15.301384 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c528eab3-4d6a-45bd-af7d-a3e379a569af tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:15.301818 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c528eab3-4d6a-45bd-af7d-a3e379a569af tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:15.425730 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c528eab3-4d6a-45bd-af7d-a3e379a569af tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:15.433250 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c528eab3-4d6a-45bd-af7d-a3e379a569af tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.144038 Oct 29 01:22:15.433812 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 732/1479] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:15 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:15.467371 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-283d88e1-57b8-487c-83a6-ec33161f575a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:15.468295 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-283d88e1-57b8-487c-83a6-ec33161f575a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:15.474211 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-283d88e1-57b8-487c-83a6-ec33161f575a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:15.474695 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-283d88e1-57b8-487c-83a6-ec33161f575a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:15.475467 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-283d88e1-57b8-487c-83a6-ec33161f575a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:15.475904 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-283d88e1-57b8-487c-83a6-ec33161f575a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:15.507630 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-283d88e1-57b8-487c-83a6-ec33161f575a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044061 Oct 29 01:22:15.508205 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 748/1480] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:15 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:16.204366 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-1fa16c7a-6d58-4f6c-a309-369db4778802 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:16.204881 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-1fa16c7a-6d58-4f6c-a309-369db4778802 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:16.211242 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1fa16c7a-6d58-4f6c-a309-369db4778802 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:16.211684 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1fa16c7a-6d58-4f6c-a309-369db4778802 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:16.212692 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1fa16c7a-6d58-4f6c-a309-369db4778802 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:16.213117 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1fa16c7a-6d58-4f6c-a309-369db4778802 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:16.270375 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-1fa16c7a-6d58-4f6c-a309-369db4778802 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:16.277588 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-1fa16c7a-6d58-4f6c-a309-369db4778802 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.077019 Oct 29 01:22:16.278138 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 733/1481] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:16 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:16.451297 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f715b7b2-5241-44c9-9d2d-44050226edac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:16.452118 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f715b7b2-5241-44c9-9d2d-44050226edac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:16.459021 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f715b7b2-5241-44c9-9d2d-44050226edac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:16.459398 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f715b7b2-5241-44c9-9d2d-44050226edac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:16.460189 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f715b7b2-5241-44c9-9d2d-44050226edac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:16.460621 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f715b7b2-5241-44c9-9d2d-44050226edac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:16.525117 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-518a9379-1b10-4a20-a724-bc17249b3b1f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:16.527274 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-518a9379-1b10-4a20-a724-bc17249b3b1f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:16.535599 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-518a9379-1b10-4a20-a724-bc17249b3b1f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:16.536048 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-518a9379-1b10-4a20-a724-bc17249b3b1f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:16.536840 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-518a9379-1b10-4a20-a724-bc17249b3b1f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:16.537291 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-518a9379-1b10-4a20-a724-bc17249b3b1f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:16.571942 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-518a9379-1b10-4a20-a724-bc17249b3b1f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055453 Oct 29 01:22:16.572512 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 734/1482] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:16 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:22:16.591354 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-f715b7b2-5241-44c9-9d2d-44050226edac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:16.599163 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f715b7b2-5241-44c9-9d2d-44050226edac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.152050 Oct 29 01:22:16.599745 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 749/1483] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:16 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:22:17.295095 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ebeadf91-539f-4bce-9c89-239cfe2fa188 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:17.295637 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ebeadf91-539f-4bce-9c89-239cfe2fa188 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:17.302047 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ebeadf91-539f-4bce-9c89-239cfe2fa188 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:17.302528 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ebeadf91-539f-4bce-9c89-239cfe2fa188 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:17.303289 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ebeadf91-539f-4bce-9c89-239cfe2fa188 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:17.303724 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ebeadf91-539f-4bce-9c89-239cfe2fa188 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:17.369344 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-ebeadf91-539f-4bce-9c89-239cfe2fa188 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:17.376699 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ebeadf91-539f-4bce-9c89-239cfe2fa188 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.085401 Oct 29 01:22:17.377251 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 735/1484] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:17 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:17.583910 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-3ba0d0db-e6b7-4400-b6ae-7b0d7b351992 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:17.584748 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-3ba0d0db-e6b7-4400-b6ae-7b0d7b351992 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:17.591301 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3ba0d0db-e6b7-4400-b6ae-7b0d7b351992 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:17.591752 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3ba0d0db-e6b7-4400-b6ae-7b0d7b351992 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:17.592513 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3ba0d0db-e6b7-4400-b6ae-7b0d7b351992 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:17.592950 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3ba0d0db-e6b7-4400-b6ae-7b0d7b351992 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:17.615693 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-cbbf4ccd-094e-471e-b97a-314072bbfd1f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:17.616339 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-cbbf4ccd-094e-471e-b97a-314072bbfd1f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:17.622327 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-3ba0d0db-e6b7-4400-b6ae-7b0d7b351992 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042734 Oct 29 01:22:17.622724 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cbbf4ccd-094e-471e-b97a-314072bbfd1f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:17.623704 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 750/1485] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:17 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:17.623858 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cbbf4ccd-094e-471e-b97a-314072bbfd1f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:17.624169 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cbbf4ccd-094e-471e-b97a-314072bbfd1f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:17.624960 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cbbf4ccd-094e-471e-b97a-314072bbfd1f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:17.751266 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-cbbf4ccd-094e-471e-b97a-314072bbfd1f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:17.758558 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-cbbf4ccd-094e-471e-b97a-314072bbfd1f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.146474 Oct 29 01:22:17.759118 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 736/1486] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:17 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:22:18.393285 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-45184528-5d72-43c4-9cef-31b2a0c09442 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:18.393892 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-45184528-5d72-43c4-9cef-31b2a0c09442 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:18.400192 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-45184528-5d72-43c4-9cef-31b2a0c09442 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:18.400636 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-45184528-5d72-43c4-9cef-31b2a0c09442 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:18.401433 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-45184528-5d72-43c4-9cef-31b2a0c09442 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:18.401863 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-45184528-5d72-43c4-9cef-31b2a0c09442 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:18.461795 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-45184528-5d72-43c4-9cef-31b2a0c09442 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:18.469555 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-45184528-5d72-43c4-9cef-31b2a0c09442 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.079972 Oct 29 01:22:18.470116 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 751/1487] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:18 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:18.633132 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-be7e4e49-b06c-4f77-a254-d567b13f0fb9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:18.634053 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-be7e4e49-b06c-4f77-a254-d567b13f0fb9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:18.640315 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-be7e4e49-b06c-4f77-a254-d567b13f0fb9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:18.640764 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-be7e4e49-b06c-4f77-a254-d567b13f0fb9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:18.641524 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-be7e4e49-b06c-4f77-a254-d567b13f0fb9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:18.641958 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-be7e4e49-b06c-4f77-a254-d567b13f0fb9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:18.670872 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-be7e4e49-b06c-4f77-a254-d567b13f0fb9 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041525 Oct 29 01:22:18.671349 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 737/1488] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:18 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:18.775317 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-07927fe0-4389-4e2b-bb2f-3a3635bcd898 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:18.775966 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-07927fe0-4389-4e2b-bb2f-3a3635bcd898 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:18.782311 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-07927fe0-4389-4e2b-bb2f-3a3635bcd898 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:18.782794 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-07927fe0-4389-4e2b-bb2f-3a3635bcd898 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:18.783567 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-07927fe0-4389-4e2b-bb2f-3a3635bcd898 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:18.784015 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-07927fe0-4389-4e2b-bb2f-3a3635bcd898 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:18.905654 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-07927fe0-4389-4e2b-bb2f-3a3635bcd898 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:18.913643 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-07927fe0-4389-4e2b-bb2f-3a3635bcd898 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.142043 Oct 29 01:22:18.914212 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 752/1489] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:18 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:19.486195 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-8f7c1fd4-e459-424e-a344-b3fdb2ff39e4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:19.486812 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-8f7c1fd4-e459-424e-a344-b3fdb2ff39e4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:19.492940 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8f7c1fd4-e459-424e-a344-b3fdb2ff39e4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:19.493383 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8f7c1fd4-e459-424e-a344-b3fdb2ff39e4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:19.494150 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8f7c1fd4-e459-424e-a344-b3fdb2ff39e4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:19.494611 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8f7c1fd4-e459-424e-a344-b3fdb2ff39e4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:19.554076 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-8f7c1fd4-e459-424e-a344-b3fdb2ff39e4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:19.561467 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-8f7c1fd4-e459-424e-a344-b3fdb2ff39e4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.079114 Oct 29 01:22:19.562025 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 738/1490] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:19 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:19.681581 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-b2c03421-6b26-4ffc-aa7b-39074a951cda tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:19.682562 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-b2c03421-6b26-4ffc-aa7b-39074a951cda tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:19.688434 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b2c03421-6b26-4ffc-aa7b-39074a951cda tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:19.688880 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b2c03421-6b26-4ffc-aa7b-39074a951cda tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:19.689680 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b2c03421-6b26-4ffc-aa7b-39074a951cda tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:19.690140 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b2c03421-6b26-4ffc-aa7b-39074a951cda tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:19.720936 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-b2c03421-6b26-4ffc-aa7b-39074a951cda tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043093 Oct 29 01:22:19.721508 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 753/1491] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:19 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:19.931118 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-51d899db-a5ac-4be9-86b9-bf35dce122ac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:19.931707 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-51d899db-a5ac-4be9-86b9-bf35dce122ac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:19.939797 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-51d899db-a5ac-4be9-86b9-bf35dce122ac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:19.940564 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-51d899db-a5ac-4be9-86b9-bf35dce122ac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:19.942482 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-51d899db-a5ac-4be9-86b9-bf35dce122ac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:19.943242 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-51d899db-a5ac-4be9-86b9-bf35dce122ac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:20.083549 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-51d899db-a5ac-4be9-86b9-bf35dce122ac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:20.091528 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-51d899db-a5ac-4be9-86b9-bf35dce122ac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.164071 Oct 29 01:22:20.092114 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 739/1492] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:19 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:20.578353 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-1d903bbb-704b-42b5-9854-a6208c19f6ad tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:20.579128 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-1d903bbb-704b-42b5-9854-a6208c19f6ad tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:20.585984 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1d903bbb-704b-42b5-9854-a6208c19f6ad tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:20.586579 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1d903bbb-704b-42b5-9854-a6208c19f6ad tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:20.587596 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1d903bbb-704b-42b5-9854-a6208c19f6ad tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:20.588033 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1d903bbb-704b-42b5-9854-a6208c19f6ad tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:20.648040 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-1d903bbb-704b-42b5-9854-a6208c19f6ad tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:20.655784 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-1d903bbb-704b-42b5-9854-a6208c19f6ad tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.081033 Oct 29 01:22:20.656350 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 754/1493] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:20 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:20.731922 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-4b6e4261-857c-41d2-a148-a6a2865c4c1f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:20.732852 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-4b6e4261-857c-41d2-a148-a6a2865c4c1f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:20.738857 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4b6e4261-857c-41d2-a148-a6a2865c4c1f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:20.739306 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4b6e4261-857c-41d2-a148-a6a2865c4c1f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:20.740072 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4b6e4261-857c-41d2-a148-a6a2865c4c1f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:20.740506 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4b6e4261-857c-41d2-a148-a6a2865c4c1f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:20.769979 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-4b6e4261-857c-41d2-a148-a6a2865c4c1f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041338 Oct 29 01:22:20.770577 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 740/1494] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:20 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:21.108868 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c9ad8ec3-0da0-4e24-8161-faa5055eab2c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:21.109513 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c9ad8ec3-0da0-4e24-8161-faa5055eab2c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:21.115315 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c9ad8ec3-0da0-4e24-8161-faa5055eab2c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:21.115756 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c9ad8ec3-0da0-4e24-8161-faa5055eab2c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:21.116507 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c9ad8ec3-0da0-4e24-8161-faa5055eab2c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:21.116935 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c9ad8ec3-0da0-4e24-8161-faa5055eab2c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:21.240287 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-c9ad8ec3-0da0-4e24-8161-faa5055eab2c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:21.247888 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c9ad8ec3-0da0-4e24-8161-faa5055eab2c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.142702 Oct 29 01:22:21.248451 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 755/1495] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:21 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:21.672979 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-2b1d7f07-8b20-4b13-99f5-da9237f8f8f7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:21.673591 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-2b1d7f07-8b20-4b13-99f5-da9237f8f8f7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:21.680422 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2b1d7f07-8b20-4b13-99f5-da9237f8f8f7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:21.680866 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2b1d7f07-8b20-4b13-99f5-da9237f8f8f7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:21.681621 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2b1d7f07-8b20-4b13-99f5-da9237f8f8f7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:21.682051 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2b1d7f07-8b20-4b13-99f5-da9237f8f8f7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:21.747021 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-2b1d7f07-8b20-4b13-99f5-da9237f8f8f7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:21.754725 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-2b1d7f07-8b20-4b13-99f5-da9237f8f8f7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.084914 Oct 29 01:22:21.755282 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 741/1496] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:21 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:21.781295 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-875f1714-f4f3-4687-84ce-bb15ef69a2f0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:21.782206 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-875f1714-f4f3-4687-84ce-bb15ef69a2f0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:21.788460 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-875f1714-f4f3-4687-84ce-bb15ef69a2f0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:21.788904 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-875f1714-f4f3-4687-84ce-bb15ef69a2f0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:21.789664 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-875f1714-f4f3-4687-84ce-bb15ef69a2f0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:21.790095 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-875f1714-f4f3-4687-84ce-bb15ef69a2f0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:21.819281 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-875f1714-f4f3-4687-84ce-bb15ef69a2f0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041616 Oct 29 01:22:21.819837 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 756/1497] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:21 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:22.264664 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-3e6ff97e-9d3e-481b-afbf-62230a9b05ce tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:22.265562 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-3e6ff97e-9d3e-481b-afbf-62230a9b05ce tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:22.272193 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3e6ff97e-9d3e-481b-afbf-62230a9b05ce tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:22.272784 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3e6ff97e-9d3e-481b-afbf-62230a9b05ce tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:22.273559 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3e6ff97e-9d3e-481b-afbf-62230a9b05ce tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:22.273995 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3e6ff97e-9d3e-481b-afbf-62230a9b05ce tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:22.394357 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-3e6ff97e-9d3e-481b-afbf-62230a9b05ce tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:22.402009 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-3e6ff97e-9d3e-481b-afbf-62230a9b05ce tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.141173 Oct 29 01:22:22.402610 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 742/1498] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:22 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:22.771106 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-3801536c-5c97-42af-886e-ee42f48cb674 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:22.771843 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-3801536c-5c97-42af-886e-ee42f48cb674 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:22.777555 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3801536c-5c97-42af-886e-ee42f48cb674 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:22.778005 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3801536c-5c97-42af-886e-ee42f48cb674 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:22.778796 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3801536c-5c97-42af-886e-ee42f48cb674 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:22.779234 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3801536c-5c97-42af-886e-ee42f48cb674 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:22.830702 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-0413fbd4-8cfb-42e2-98da-9b2d39176284 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:22.831621 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-0413fbd4-8cfb-42e2-98da-9b2d39176284 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:22.838441 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0413fbd4-8cfb-42e2-98da-9b2d39176284 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:22.838691 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0413fbd4-8cfb-42e2-98da-9b2d39176284 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:22.839495 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0413fbd4-8cfb-42e2-98da-9b2d39176284 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:22.839930 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0413fbd4-8cfb-42e2-98da-9b2d39176284 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:22.841022 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-3801536c-5c97-42af-886e-ee42f48cb674 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:22.848757 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-3801536c-5c97-42af-886e-ee42f48cb674 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.081205 Oct 29 01:22:22.849306 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 757/1499] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:22 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:22.870702 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-0413fbd4-8cfb-42e2-98da-9b2d39176284 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043684 Oct 29 01:22:22.871292 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 743/1500] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:22 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:22:23.419440 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-4f958031-8a74-4eaa-b278-980dac09ff9f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:23.420040 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-4f958031-8a74-4eaa-b278-980dac09ff9f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:23.425938 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4f958031-8a74-4eaa-b278-980dac09ff9f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:23.426909 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4f958031-8a74-4eaa-b278-980dac09ff9f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:23.427677 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4f958031-8a74-4eaa-b278-980dac09ff9f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:23.428105 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4f958031-8a74-4eaa-b278-980dac09ff9f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:23.548422 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-4f958031-8a74-4eaa-b278-980dac09ff9f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:23.555926 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-4f958031-8a74-4eaa-b278-980dac09ff9f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.140136 Oct 29 01:22:23.556497 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 758/1501] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:23 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:23.865545 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-905c534b-057f-4fbb-ac26-1613716c27d9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:23.866158 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-905c534b-057f-4fbb-ac26-1613716c27d9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:23.872681 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-905c534b-057f-4fbb-ac26-1613716c27d9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:23.873137 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-905c534b-057f-4fbb-ac26-1613716c27d9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:23.873902 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-905c534b-057f-4fbb-ac26-1613716c27d9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:23.874331 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-905c534b-057f-4fbb-ac26-1613716c27d9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:23.882668 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-946a3566-989b-44d2-94e7-1b22b901b756 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:23.883728 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-946a3566-989b-44d2-94e7-1b22b901b756 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:23.890216 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-946a3566-989b-44d2-94e7-1b22b901b756 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:23.890699 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-946a3566-989b-44d2-94e7-1b22b901b756 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:23.891476 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-946a3566-989b-44d2-94e7-1b22b901b756 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:23.891913 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-946a3566-989b-44d2-94e7-1b22b901b756 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:23.922127 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-946a3566-989b-44d2-94e7-1b22b901b756 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043727 Oct 29 01:22:23.922734 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 759/1502] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:23 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:22:23.937806 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-905c534b-057f-4fbb-ac26-1613716c27d9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:23.945854 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-905c534b-057f-4fbb-ac26-1613716c27d9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.083999 Oct 29 01:22:23.946573 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 744/1503] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:23 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:24.573135 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-57fad91c-db9c-48bf-b129-1d1a94bf98b8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:24.573738 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-57fad91c-db9c-48bf-b129-1d1a94bf98b8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:24.580442 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-57fad91c-db9c-48bf-b129-1d1a94bf98b8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:24.580889 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-57fad91c-db9c-48bf-b129-1d1a94bf98b8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:24.581671 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-57fad91c-db9c-48bf-b129-1d1a94bf98b8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:24.582153 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-57fad91c-db9c-48bf-b129-1d1a94bf98b8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:24.707321 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-57fad91c-db9c-48bf-b129-1d1a94bf98b8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:24.715801 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-57fad91c-db9c-48bf-b129-1d1a94bf98b8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.146322 Oct 29 01:22:24.716391 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 760/1504] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:24 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:24.933638 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-42807a68-4de2-4c10-b5f8-41362d3cc4ec tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:24.934613 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-42807a68-4de2-4c10-b5f8-41362d3cc4ec tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:24.940865 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-42807a68-4de2-4c10-b5f8-41362d3cc4ec tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:24.941832 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-42807a68-4de2-4c10-b5f8-41362d3cc4ec tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:24.942662 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-42807a68-4de2-4c10-b5f8-41362d3cc4ec tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:24.943091 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-42807a68-4de2-4c10-b5f8-41362d3cc4ec tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:24.964222 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-ea5777d3-e316-486c-ad90-46df5a68cf08 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:24.965003 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-ea5777d3-e316-486c-ad90-46df5a68cf08 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:24.970944 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ea5777d3-e316-486c-ad90-46df5a68cf08 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:24.971404 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ea5777d3-e316-486c-ad90-46df5a68cf08 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:24.972152 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ea5777d3-e316-486c-ad90-46df5a68cf08 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:24.972600 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ea5777d3-e316-486c-ad90-46df5a68cf08 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:24.973843 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-42807a68-4de2-4c10-b5f8-41362d3cc4ec tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044075 Oct 29 01:22:24.974440 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 745/1505] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:24 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:25.032725 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-ea5777d3-e316-486c-ad90-46df5a68cf08 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:25.040219 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-ea5777d3-e316-486c-ad90-46df5a68cf08 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.079977 Oct 29 01:22:25.040794 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 761/1506] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:24 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:25.732791 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-6014a915-1491-4f02-b9a8-54feae6855dc tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:25.733425 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-6014a915-1491-4f02-b9a8-54feae6855dc tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:25.739793 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6014a915-1491-4f02-b9a8-54feae6855dc tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:25.740244 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6014a915-1491-4f02-b9a8-54feae6855dc tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:25.741091 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6014a915-1491-4f02-b9a8-54feae6855dc tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:25.741533 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6014a915-1491-4f02-b9a8-54feae6855dc tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:25.865072 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-6014a915-1491-4f02-b9a8-54feae6855dc tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:25.872882 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-6014a915-1491-4f02-b9a8-54feae6855dc tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.143846 Oct 29 01:22:25.873446 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 746/1507] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:25 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:25.985671 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-16226599-747c-46af-a565-a70c55ea18fb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:25.986528 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-16226599-747c-46af-a565-a70c55ea18fb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:25.993509 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-16226599-747c-46af-a565-a70c55ea18fb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:25.993950 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-16226599-747c-46af-a565-a70c55ea18fb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:25.994745 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-16226599-747c-46af-a565-a70c55ea18fb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:25.995174 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-16226599-747c-46af-a565-a70c55ea18fb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:26.025874 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-16226599-747c-46af-a565-a70c55ea18fb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044001 Oct 29 01:22:26.026474 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 762/1508] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:25 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:26.057333 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-5ec03e52-17b9-4380-9b35-17dffe19151c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:26.057938 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-5ec03e52-17b9-4380-9b35-17dffe19151c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:26.064308 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5ec03e52-17b9-4380-9b35-17dffe19151c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:26.064756 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5ec03e52-17b9-4380-9b35-17dffe19151c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:26.065520 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5ec03e52-17b9-4380-9b35-17dffe19151c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:26.065953 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5ec03e52-17b9-4380-9b35-17dffe19151c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:26.128052 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-5ec03e52-17b9-4380-9b35-17dffe19151c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:26.135761 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-5ec03e52-17b9-4380-9b35-17dffe19151c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.082164 Oct 29 01:22:26.136336 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 747/1509] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:26 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:26.890477 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-bbbad98c-af01-40c1-b49b-927450222073 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:26.891094 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-bbbad98c-af01-40c1-b49b-927450222073 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:26.897528 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bbbad98c-af01-40c1-b49b-927450222073 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:26.897969 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bbbad98c-af01-40c1-b49b-927450222073 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:26.898779 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bbbad98c-af01-40c1-b49b-927450222073 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:26.899224 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bbbad98c-af01-40c1-b49b-927450222073 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:27.021747 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-bbbad98c-af01-40c1-b49b-927450222073 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:27.029417 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-bbbad98c-af01-40c1-b49b-927450222073 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.142616 Oct 29 01:22:27.029879 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 763/1510] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:26 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:27.036925 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b4b03e63-cfdd-45b9-b184-2e7aaf5f06e8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:27.038073 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b4b03e63-cfdd-45b9-b184-2e7aaf5f06e8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:27.043974 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b4b03e63-cfdd-45b9-b184-2e7aaf5f06e8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:27.044417 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b4b03e63-cfdd-45b9-b184-2e7aaf5f06e8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:27.045177 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b4b03e63-cfdd-45b9-b184-2e7aaf5f06e8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:27.045608 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b4b03e63-cfdd-45b9-b184-2e7aaf5f06e8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:27.074382 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b4b03e63-cfdd-45b9-b184-2e7aaf5f06e8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041179 Oct 29 01:22:27.075073 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 748/1511] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:27 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:27.152551 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-0e09468e-b6a6-4ec8-b40c-aae303c9d845 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:27.153075 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-0e09468e-b6a6-4ec8-b40c-aae303c9d845 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:27.159067 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0e09468e-b6a6-4ec8-b40c-aae303c9d845 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:27.159521 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0e09468e-b6a6-4ec8-b40c-aae303c9d845 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:27.160439 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0e09468e-b6a6-4ec8-b40c-aae303c9d845 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:27.160873 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0e09468e-b6a6-4ec8-b40c-aae303c9d845 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:27.220953 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-0e09468e-b6a6-4ec8-b40c-aae303c9d845 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:27.228407 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-0e09468e-b6a6-4ec8-b40c-aae303c9d845 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.079802 Oct 29 01:22:27.228971 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 764/1512] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:27 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:22:28.046664 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-1b4d9cf5-40c6-4cbc-aa80-568bb3fe1713 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:28.047268 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-1b4d9cf5-40c6-4cbc-aa80-568bb3fe1713 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:28.053098 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1b4d9cf5-40c6-4cbc-aa80-568bb3fe1713 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:28.053540 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1b4d9cf5-40c6-4cbc-aa80-568bb3fe1713 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:28.054304 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1b4d9cf5-40c6-4cbc-aa80-568bb3fe1713 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:28.054790 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1b4d9cf5-40c6-4cbc-aa80-568bb3fe1713 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:28.085688 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-bf2288dc-e307-49f6-b5fa-d1f5992016b5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:28.086857 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-bf2288dc-e307-49f6-b5fa-d1f5992016b5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:28.093590 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bf2288dc-e307-49f6-b5fa-d1f5992016b5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:28.094041 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bf2288dc-e307-49f6-b5fa-d1f5992016b5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:28.094888 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bf2288dc-e307-49f6-b5fa-d1f5992016b5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:28.095330 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bf2288dc-e307-49f6-b5fa-d1f5992016b5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:28.126165 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-bf2288dc-e307-49f6-b5fa-d1f5992016b5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044809 Oct 29 01:22:28.126983 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 765/1513] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:28 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:22:28.177931 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-1b4d9cf5-40c6-4cbc-aa80-568bb3fe1713 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:28.185358 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-1b4d9cf5-40c6-4cbc-aa80-568bb3fe1713 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.142355 Oct 29 01:22:28.185924 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 749/1514] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:28 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:28.244761 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-578459b4-4561-43ba-a18c-f63ff67c5802 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:28.245364 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-578459b4-4561-43ba-a18c-f63ff67c5802 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:28.251352 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-578459b4-4561-43ba-a18c-f63ff67c5802 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:28.251789 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-578459b4-4561-43ba-a18c-f63ff67c5802 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:28.252556 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-578459b4-4561-43ba-a18c-f63ff67c5802 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:28.252985 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-578459b4-4561-43ba-a18c-f63ff67c5802 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:28.312989 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-578459b4-4561-43ba-a18c-f63ff67c5802 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:28.321025 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-578459b4-4561-43ba-a18c-f63ff67c5802 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.079847 Oct 29 01:22:28.321606 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 766/1515] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:28 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:29.138718 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-3f6c62c0-5bf1-45ac-9277-8be7007e0b10 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:29.139655 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-3f6c62c0-5bf1-45ac-9277-8be7007e0b10 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:29.145531 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3f6c62c0-5bf1-45ac-9277-8be7007e0b10 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:29.145963 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3f6c62c0-5bf1-45ac-9277-8be7007e0b10 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:29.146739 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3f6c62c0-5bf1-45ac-9277-8be7007e0b10 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:29.147168 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3f6c62c0-5bf1-45ac-9277-8be7007e0b10 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:29.183513 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-3f6c62c0-5bf1-45ac-9277-8be7007e0b10 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049844 Oct 29 01:22:29.184218 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 750/1516] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:29 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:29.201312 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-1a5c998a-b488-4309-9205-c055b2c81b99 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:29.201923 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-1a5c998a-b488-4309-9205-c055b2c81b99 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:29.209051 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1a5c998a-b488-4309-9205-c055b2c81b99 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:29.209410 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1a5c998a-b488-4309-9205-c055b2c81b99 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:29.210189 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1a5c998a-b488-4309-9205-c055b2c81b99 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:29.210658 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1a5c998a-b488-4309-9205-c055b2c81b99 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:29.337880 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-61098896-3863-4d1b-95cf-627f189b9049 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:29.338695 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-61098896-3863-4d1b-95cf-627f189b9049 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:29.344616 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-1a5c998a-b488-4309-9205-c055b2c81b99 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:29.350328 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-61098896-3863-4d1b-95cf-627f189b9049 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:29.350961 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-61098896-3863-4d1b-95cf-627f189b9049 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:29.351688 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-61098896-3863-4d1b-95cf-627f189b9049 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:29.352121 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-61098896-3863-4d1b-95cf-627f189b9049 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:29.353351 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-1a5c998a-b488-4309-9205-c055b2c81b99 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.155673 Oct 29 01:22:29.353934 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 767/1517] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:29 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:22:29.418109 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-61098896-3863-4d1b-95cf-627f189b9049 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:29.425554 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-61098896-3863-4d1b-95cf-627f189b9049 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.091754 Oct 29 01:22:29.426805 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 751/1518] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:29 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:30.195717 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-bebbd636-7d81-4fc2-8ecc-50577b7e44af tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:30.196555 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-bebbd636-7d81-4fc2-8ecc-50577b7e44af tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:30.202490 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bebbd636-7d81-4fc2-8ecc-50577b7e44af tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:30.203088 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bebbd636-7d81-4fc2-8ecc-50577b7e44af tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:30.203681 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bebbd636-7d81-4fc2-8ecc-50577b7e44af tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:30.204113 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bebbd636-7d81-4fc2-8ecc-50577b7e44af tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:30.234989 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-bebbd636-7d81-4fc2-8ecc-50577b7e44af tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043580 Oct 29 01:22:30.235559 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 768/1519] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:30 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:30.370331 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-0344152c-e7b1-48f2-ba01-a06d80f5ffb8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:30.370959 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-0344152c-e7b1-48f2-ba01-a06d80f5ffb8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:30.377217 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0344152c-e7b1-48f2-ba01-a06d80f5ffb8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:30.377666 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0344152c-e7b1-48f2-ba01-a06d80f5ffb8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:30.378459 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0344152c-e7b1-48f2-ba01-a06d80f5ffb8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:30.379536 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0344152c-e7b1-48f2-ba01-a06d80f5ffb8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:30.443256 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-71056ca6-0578-409c-ae7f-9e325a513406 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:30.443856 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-71056ca6-0578-409c-ae7f-9e325a513406 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:30.449734 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-71056ca6-0578-409c-ae7f-9e325a513406 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:30.450108 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-71056ca6-0578-409c-ae7f-9e325a513406 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:30.450998 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-71056ca6-0578-409c-ae7f-9e325a513406 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:30.451464 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-71056ca6-0578-409c-ae7f-9e325a513406 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:30.519357 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-71056ca6-0578-409c-ae7f-9e325a513406 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:30.524423 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-0344152c-e7b1-48f2-ba01-a06d80f5ffb8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:30.527229 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-71056ca6-0578-409c-ae7f-9e325a513406 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.088244 Oct 29 01:22:30.527813 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 769/1520] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:30 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:22:30.531904 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-0344152c-e7b1-48f2-ba01-a06d80f5ffb8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.165234 Oct 29 01:22:30.532471 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 752/1521] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:30 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:31.247032 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-b4b51ec6-4f1a-4d16-908d-bdbc6334b816 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:31.247871 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-b4b51ec6-4f1a-4d16-908d-bdbc6334b816 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:31.254102 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b4b51ec6-4f1a-4d16-908d-bdbc6334b816 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:31.254650 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b4b51ec6-4f1a-4d16-908d-bdbc6334b816 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:31.255424 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b4b51ec6-4f1a-4d16-908d-bdbc6334b816 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:31.255860 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b4b51ec6-4f1a-4d16-908d-bdbc6334b816 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:31.285866 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-b4b51ec6-4f1a-4d16-908d-bdbc6334b816 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041912 Oct 29 01:22:31.286461 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 770/1522] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:31 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:31.544026 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-385d5cdb-4bd0-4f80-8f37-6dbb21071f13 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:31.544576 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-385d5cdb-4bd0-4f80-8f37-6dbb21071f13 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:31.548578 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-b3b0fdb1-16da-4184-a96c-036e1625ccb2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:31.549304 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-b3b0fdb1-16da-4184-a96c-036e1625ccb2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:31.551160 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-385d5cdb-4bd0-4f80-8f37-6dbb21071f13 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:31.551620 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-385d5cdb-4bd0-4f80-8f37-6dbb21071f13 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:31.552429 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-385d5cdb-4bd0-4f80-8f37-6dbb21071f13 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:31.552867 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-385d5cdb-4bd0-4f80-8f37-6dbb21071f13 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:31.555117 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b3b0fdb1-16da-4184-a96c-036e1625ccb2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:31.555562 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b3b0fdb1-16da-4184-a96c-036e1625ccb2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:31.556330 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b3b0fdb1-16da-4184-a96c-036e1625ccb2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:31.556764 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b3b0fdb1-16da-4184-a96c-036e1625ccb2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:31.645769 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-385d5cdb-4bd0-4f80-8f37-6dbb21071f13 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:31.653174 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-385d5cdb-4bd0-4f80-8f37-6dbb21071f13 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.112931 Oct 29 01:22:31.653750 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 753/1523] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:31 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:31.702805 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-b3b0fdb1-16da-4184-a96c-036e1625ccb2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:31.710933 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-b3b0fdb1-16da-4184-a96c-036e1625ccb2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.166163 Oct 29 01:22:31.711505 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 771/1524] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:31 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:22:32.297332 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9ca15b96-2e99-4f06-9781-e1336275f21c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:32.298147 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9ca15b96-2e99-4f06-9781-e1336275f21c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:32.304985 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9ca15b96-2e99-4f06-9781-e1336275f21c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:32.305429 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9ca15b96-2e99-4f06-9781-e1336275f21c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:32.306210 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9ca15b96-2e99-4f06-9781-e1336275f21c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:32.306677 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9ca15b96-2e99-4f06-9781-e1336275f21c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:32.338182 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9ca15b96-2e99-4f06-9781-e1336275f21c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044701 Oct 29 01:22:32.338788 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 754/1525] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:32 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:22:32.668918 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-713cd4d1-45c0-4f85-b77d-b30807cfdc3e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:32.669566 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-713cd4d1-45c0-4f85-b77d-b30807cfdc3e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:32.676387 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-713cd4d1-45c0-4f85-b77d-b30807cfdc3e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:32.676840 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-713cd4d1-45c0-4f85-b77d-b30807cfdc3e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:32.677659 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-713cd4d1-45c0-4f85-b77d-b30807cfdc3e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:32.678100 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-713cd4d1-45c0-4f85-b77d-b30807cfdc3e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:32.728560 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-164ccac6-8bbc-4540-8a91-6e58a2f1e6a7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:32.729164 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-164ccac6-8bbc-4540-8a91-6e58a2f1e6a7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:32.735446 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-164ccac6-8bbc-4540-8a91-6e58a2f1e6a7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:32.736285 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-164ccac6-8bbc-4540-8a91-6e58a2f1e6a7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:32.736676 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-164ccac6-8bbc-4540-8a91-6e58a2f1e6a7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:32.737110 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-164ccac6-8bbc-4540-8a91-6e58a2f1e6a7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:32.738762 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-713cd4d1-45c0-4f85-b77d-b30807cfdc3e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:32.746243 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-713cd4d1-45c0-4f85-b77d-b30807cfdc3e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.080983 Oct 29 01:22:32.746853 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 772/1526] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:32 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:32.858954 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-164ccac6-8bbc-4540-8a91-6e58a2f1e6a7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:32.867021 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-164ccac6-8bbc-4540-8a91-6e58a2f1e6a7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.142208 Oct 29 01:22:32.867592 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 755/1527] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:32 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:22:33.350374 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-cf203a34-7af7-4581-8e9d-5a4fe829e76c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:33.351387 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-cf203a34-7af7-4581-8e9d-5a4fe829e76c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:33.358346 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cf203a34-7af7-4581-8e9d-5a4fe829e76c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:33.358638 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cf203a34-7af7-4581-8e9d-5a4fe829e76c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:33.359415 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cf203a34-7af7-4581-8e9d-5a4fe829e76c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:33.359853 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cf203a34-7af7-4581-8e9d-5a4fe829e76c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:33.389565 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-cf203a34-7af7-4581-8e9d-5a4fe829e76c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044148 Oct 29 01:22:33.390130 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 773/1528] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:33 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:33.763892 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-5f29bfd3-a11d-45bd-a46b-188f461ded04 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:33.764484 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-5f29bfd3-a11d-45bd-a46b-188f461ded04 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:33.770267 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5f29bfd3-a11d-45bd-a46b-188f461ded04 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:33.770737 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5f29bfd3-a11d-45bd-a46b-188f461ded04 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:33.771491 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5f29bfd3-a11d-45bd-a46b-188f461ded04 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:33.771923 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5f29bfd3-a11d-45bd-a46b-188f461ded04 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:33.832354 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-5f29bfd3-a11d-45bd-a46b-188f461ded04 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:33.839808 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-5f29bfd3-a11d-45bd-a46b-188f461ded04 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.080133 Oct 29 01:22:33.840360 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 756/1529] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:33 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:33.884147 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d7bca1d7-500f-46b8-8096-8d8aa97bb16e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:33.884744 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d7bca1d7-500f-46b8-8096-8d8aa97bb16e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:33.891010 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d7bca1d7-500f-46b8-8096-8d8aa97bb16e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:33.891452 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d7bca1d7-500f-46b8-8096-8d8aa97bb16e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:33.892199 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d7bca1d7-500f-46b8-8096-8d8aa97bb16e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:33.892707 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d7bca1d7-500f-46b8-8096-8d8aa97bb16e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:34.012991 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-d7bca1d7-500f-46b8-8096-8d8aa97bb16e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:34.020928 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d7bca1d7-500f-46b8-8096-8d8aa97bb16e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.140754 Oct 29 01:22:34.021454 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 774/1530] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:33 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:34.401264 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-03457f1e-0a84-4d34-b1ef-6fc89d2eea59 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:34.402176 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-03457f1e-0a84-4d34-b1ef-6fc89d2eea59 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:34.408047 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-03457f1e-0a84-4d34-b1ef-6fc89d2eea59 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:34.408492 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-03457f1e-0a84-4d34-b1ef-6fc89d2eea59 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:34.409248 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-03457f1e-0a84-4d34-b1ef-6fc89d2eea59 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:34.409677 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-03457f1e-0a84-4d34-b1ef-6fc89d2eea59 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:34.438045 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-03457f1e-0a84-4d34-b1ef-6fc89d2eea59 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040466 Oct 29 01:22:34.438648 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 757/1531] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:34 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:34.856305 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f542efc3-042f-49c2-8af6-46dc6fb64d0d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:34.856913 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f542efc3-042f-49c2-8af6-46dc6fb64d0d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:34.863256 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f542efc3-042f-49c2-8af6-46dc6fb64d0d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:34.863713 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f542efc3-042f-49c2-8af6-46dc6fb64d0d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:34.864486 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f542efc3-042f-49c2-8af6-46dc6fb64d0d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:34.864917 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f542efc3-042f-49c2-8af6-46dc6fb64d0d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:34.926438 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-f542efc3-042f-49c2-8af6-46dc6fb64d0d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:34.933761 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f542efc3-042f-49c2-8af6-46dc6fb64d0d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.081244 Oct 29 01:22:34.934335 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 775/1532] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:34 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:35.036768 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-69cfb5b6-9435-4c88-bcf4-df345888e358 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:35.037415 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-69cfb5b6-9435-4c88-bcf4-df345888e358 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:35.043734 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-69cfb5b6-9435-4c88-bcf4-df345888e358 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:35.044186 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-69cfb5b6-9435-4c88-bcf4-df345888e358 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:35.044953 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-69cfb5b6-9435-4c88-bcf4-df345888e358 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:35.045388 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-69cfb5b6-9435-4c88-bcf4-df345888e358 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:35.167693 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-69cfb5b6-9435-4c88-bcf4-df345888e358 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:35.175199 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-69cfb5b6-9435-4c88-bcf4-df345888e358 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.142036 Oct 29 01:22:35.176347 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 758/1533] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:35 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:35.451520 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e41198b0-76b3-42c2-9734-6b6311a625b1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:35.452351 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-e41198b0-76b3-42c2-9734-6b6311a625b1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:35.458963 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e41198b0-76b3-42c2-9734-6b6311a625b1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:35.459439 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e41198b0-76b3-42c2-9734-6b6311a625b1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:35.460292 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e41198b0-76b3-42c2-9734-6b6311a625b1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:35.460730 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e41198b0-76b3-42c2-9734-6b6311a625b1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:35.493180 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-e41198b0-76b3-42c2-9734-6b6311a625b1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046441 Oct 29 01:22:35.493776 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 776/1534] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:35 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:35.950061 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-7476e1bc-f2af-428f-80aa-dd9f530f8b57 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:35.950694 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-7476e1bc-f2af-428f-80aa-dd9f530f8b57 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:35.957432 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7476e1bc-f2af-428f-80aa-dd9f530f8b57 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:35.958017 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7476e1bc-f2af-428f-80aa-dd9f530f8b57 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:35.959121 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7476e1bc-f2af-428f-80aa-dd9f530f8b57 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:35.959260 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7476e1bc-f2af-428f-80aa-dd9f530f8b57 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:36.022480 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-7476e1bc-f2af-428f-80aa-dd9f530f8b57 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:36.029926 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-7476e1bc-f2af-428f-80aa-dd9f530f8b57 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.083543 Oct 29 01:22:36.030502 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 759/1535] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:35 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:36.193333 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f4080d10-3c2b-41be-a3bd-a97e6bc0c4f5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:36.193890 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f4080d10-3c2b-41be-a3bd-a97e6bc0c4f5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:36.200371 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f4080d10-3c2b-41be-a3bd-a97e6bc0c4f5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:36.200819 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f4080d10-3c2b-41be-a3bd-a97e6bc0c4f5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:36.201595 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f4080d10-3c2b-41be-a3bd-a97e6bc0c4f5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:36.202027 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f4080d10-3c2b-41be-a3bd-a97e6bc0c4f5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:36.323304 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-f4080d10-3c2b-41be-a3bd-a97e6bc0c4f5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:36.330641 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f4080d10-3c2b-41be-a3bd-a97e6bc0c4f5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.141537 Oct 29 01:22:36.331292 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 777/1536] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:36 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:36.506825 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-be963f94-e8b3-469f-ba8e-9c62deed8533 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:36.507667 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-be963f94-e8b3-469f-ba8e-9c62deed8533 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:36.513908 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-be963f94-e8b3-469f-ba8e-9c62deed8533 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:36.514360 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-be963f94-e8b3-469f-ba8e-9c62deed8533 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:36.515166 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-be963f94-e8b3-469f-ba8e-9c62deed8533 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:36.515605 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-be963f94-e8b3-469f-ba8e-9c62deed8533 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:36.544998 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-be963f94-e8b3-469f-ba8e-9c62deed8533 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042543 Oct 29 01:22:36.545555 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 760/1537] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:36 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:37.046799 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-aa9100a3-534e-4b2a-b235-eb99b5aae3bc tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:37.047416 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-aa9100a3-534e-4b2a-b235-eb99b5aae3bc tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:37.053480 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-aa9100a3-534e-4b2a-b235-eb99b5aae3bc tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:37.053934 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-aa9100a3-534e-4b2a-b235-eb99b5aae3bc tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:37.054871 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-aa9100a3-534e-4b2a-b235-eb99b5aae3bc tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:37.055312 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-aa9100a3-534e-4b2a-b235-eb99b5aae3bc tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:37.162182 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-aa9100a3-534e-4b2a-b235-eb99b5aae3bc tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:37.169541 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-aa9100a3-534e-4b2a-b235-eb99b5aae3bc tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.126744 Oct 29 01:22:37.170125 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 778/1538] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:37 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:37.347891 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b6e9ad71-5a63-401b-bc65-218506f49130 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:37.348500 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b6e9ad71-5a63-401b-bc65-218506f49130 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:37.354335 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b6e9ad71-5a63-401b-bc65-218506f49130 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:37.354810 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b6e9ad71-5a63-401b-bc65-218506f49130 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:37.355574 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b6e9ad71-5a63-401b-bc65-218506f49130 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:37.356006 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b6e9ad71-5a63-401b-bc65-218506f49130 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:37.525214 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-b6e9ad71-5a63-401b-bc65-218506f49130 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:37.532552 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b6e9ad71-5a63-401b-bc65-218506f49130 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.188375 Oct 29 01:22:37.533102 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 761/1539] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:37 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:37.555530 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-b3cc7446-33d6-4da8-87d7-914eda7f82e3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:37.556448 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-b3cc7446-33d6-4da8-87d7-914eda7f82e3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:37.562241 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b3cc7446-33d6-4da8-87d7-914eda7f82e3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:37.562712 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b3cc7446-33d6-4da8-87d7-914eda7f82e3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:37.563488 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b3cc7446-33d6-4da8-87d7-914eda7f82e3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:37.563916 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b3cc7446-33d6-4da8-87d7-914eda7f82e3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:37.594305 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-b3cc7446-33d6-4da8-87d7-914eda7f82e3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042435 Oct 29 01:22:37.594901 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 779/1540] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:37 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:38.185966 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-43b1feeb-89c6-4182-8bfe-2a4c1052deb7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:38.186613 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-43b1feeb-89c6-4182-8bfe-2a4c1052deb7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:38.192779 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-43b1feeb-89c6-4182-8bfe-2a4c1052deb7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:38.193223 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-43b1feeb-89c6-4182-8bfe-2a4c1052deb7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:38.193995 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-43b1feeb-89c6-4182-8bfe-2a4c1052deb7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:38.194448 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-43b1feeb-89c6-4182-8bfe-2a4c1052deb7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:38.491897 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-43b1feeb-89c6-4182-8bfe-2a4c1052deb7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:38.499382 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-43b1feeb-89c6-4182-8bfe-2a4c1052deb7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.317367 Oct 29 01:22:38.499934 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 762/1541] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:38 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:38.549196 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-dc2e1f2a-f80f-4bfa-a494-883fb47de9c1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:38.549793 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-dc2e1f2a-f80f-4bfa-a494-883fb47de9c1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:38.556020 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dc2e1f2a-f80f-4bfa-a494-883fb47de9c1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:38.556626 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dc2e1f2a-f80f-4bfa-a494-883fb47de9c1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:38.557241 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dc2e1f2a-f80f-4bfa-a494-883fb47de9c1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:38.557670 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dc2e1f2a-f80f-4bfa-a494-883fb47de9c1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:38.605018 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-33e8de7b-5048-49fb-9da6-e489ffced200 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:38.605933 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-33e8de7b-5048-49fb-9da6-e489ffced200 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:38.612642 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-33e8de7b-5048-49fb-9da6-e489ffced200 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:38.613086 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-33e8de7b-5048-49fb-9da6-e489ffced200 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:38.613972 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-33e8de7b-5048-49fb-9da6-e489ffced200 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:38.614419 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-33e8de7b-5048-49fb-9da6-e489ffced200 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:38.645096 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-33e8de7b-5048-49fb-9da6-e489ffced200 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043808 Oct 29 01:22:38.645663 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 763/1542] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:38 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:22:38.676813 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-dc2e1f2a-f80f-4bfa-a494-883fb47de9c1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:38.684280 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-dc2e1f2a-f80f-4bfa-a494-883fb47de9c1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.138773 Oct 29 01:22:38.684848 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 780/1543] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:38 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:39.515789 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b68a7532-2251-4395-a9ff-f459e8c95786 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:39.516395 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b68a7532-2251-4395-a9ff-f459e8c95786 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:39.522234 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b68a7532-2251-4395-a9ff-f459e8c95786 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:39.522714 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b68a7532-2251-4395-a9ff-f459e8c95786 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:39.523475 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b68a7532-2251-4395-a9ff-f459e8c95786 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:39.523911 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b68a7532-2251-4395-a9ff-f459e8c95786 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:39.582253 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-b68a7532-2251-4395-a9ff-f459e8c95786 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:39.590125 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b68a7532-2251-4395-a9ff-f459e8c95786 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.078029 Oct 29 01:22:39.590713 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 764/1544] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:39 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:39.655474 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-5824f07d-4358-4f82-aa67-dab5969f7ab7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:39.656379 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-5824f07d-4358-4f82-aa67-dab5969f7ab7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:39.663023 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5824f07d-4358-4f82-aa67-dab5969f7ab7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:39.663463 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5824f07d-4358-4f82-aa67-dab5969f7ab7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:39.664214 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5824f07d-4358-4f82-aa67-dab5969f7ab7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:39.664643 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5824f07d-4358-4f82-aa67-dab5969f7ab7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:39.692697 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-5824f07d-4358-4f82-aa67-dab5969f7ab7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040930 Oct 29 01:22:39.693234 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 781/1545] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:39 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:39.700897 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d129feda-283e-42a6-96b6-858aa24da810 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:39.701507 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d129feda-283e-42a6-96b6-858aa24da810 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:39.707672 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d129feda-283e-42a6-96b6-858aa24da810 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:39.708125 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d129feda-283e-42a6-96b6-858aa24da810 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:39.708885 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d129feda-283e-42a6-96b6-858aa24da810 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:39.709316 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d129feda-283e-42a6-96b6-858aa24da810 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:39.829181 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-d129feda-283e-42a6-96b6-858aa24da810 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:39.837392 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d129feda-283e-42a6-96b6-858aa24da810 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.139847 Oct 29 01:22:39.837950 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 765/1546] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:39 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:40.607473 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c77d1f84-1ae8-44d6-928f-a6486fbbf54d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:40.608093 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c77d1f84-1ae8-44d6-928f-a6486fbbf54d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:40.614660 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c77d1f84-1ae8-44d6-928f-a6486fbbf54d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:40.615111 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c77d1f84-1ae8-44d6-928f-a6486fbbf54d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:40.615917 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c77d1f84-1ae8-44d6-928f-a6486fbbf54d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:40.616356 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c77d1f84-1ae8-44d6-928f-a6486fbbf54d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:40.676654 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-c77d1f84-1ae8-44d6-928f-a6486fbbf54d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:40.684153 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c77d1f84-1ae8-44d6-928f-a6486fbbf54d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.080434 Oct 29 01:22:40.684718 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 782/1547] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:40 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:40.694762 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:22:40.694975 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: Fri Oct 29 01:22:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 29 01:22:40.712554 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-19bad631-432c-4db1-8b2b-79873bacdb3e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:40.713848 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-19bad631-432c-4db1-8b2b-79873bacdb3e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:40.721423 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-19bad631-432c-4db1-8b2b-79873bacdb3e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:40.721958 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-19bad631-432c-4db1-8b2b-79873bacdb3e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:40.723753 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-19bad631-432c-4db1-8b2b-79873bacdb3e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:40.724190 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-19bad631-432c-4db1-8b2b-79873bacdb3e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:40.754686 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-19bad631-432c-4db1-8b2b-79873bacdb3e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046337 Oct 29 01:22:40.755242 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 766/1548] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:40 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:40.833024 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:22:40.833275 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: Fri Oct 29 01:22:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 29 01:22:40.854336 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2186aa1a-8e03-4759-9f04-711d4821eaa0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:40.855013 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2186aa1a-8e03-4759-9f04-711d4821eaa0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:40.861024 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2186aa1a-8e03-4759-9f04-711d4821eaa0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:40.861433 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2186aa1a-8e03-4759-9f04-711d4821eaa0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:40.862191 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2186aa1a-8e03-4759-9f04-711d4821eaa0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:40.862713 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2186aa1a-8e03-4759-9f04-711d4821eaa0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:40.986561 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-2186aa1a-8e03-4759-9f04-711d4821eaa0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:40.994113 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2186aa1a-8e03-4759-9f04-711d4821eaa0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.143587 Oct 29 01:22:40.994702 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 783/1549] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:40 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:41.700734 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-260325e5-3668-4ce5-92e6-977ed3434f88 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:41.701254 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-260325e5-3668-4ce5-92e6-977ed3434f88 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:41.707157 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-260325e5-3668-4ce5-92e6-977ed3434f88 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:41.707610 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-260325e5-3668-4ce5-92e6-977ed3434f88 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:41.708374 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-260325e5-3668-4ce5-92e6-977ed3434f88 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:41.708987 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-260325e5-3668-4ce5-92e6-977ed3434f88 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:41.767677 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-9ec02d3e-d4d1-4383-9f5b-4bced5806078 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:41.769118 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-9ec02d3e-d4d1-4383-9f5b-4bced5806078 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:41.771830 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-260325e5-3668-4ce5-92e6-977ed3434f88 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:41.775396 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9ec02d3e-d4d1-4383-9f5b-4bced5806078 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:41.775848 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9ec02d3e-d4d1-4383-9f5b-4bced5806078 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:41.776626 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9ec02d3e-d4d1-4383-9f5b-4bced5806078 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:41.777064 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9ec02d3e-d4d1-4383-9f5b-4bced5806078 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:41.779552 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-260325e5-3668-4ce5-92e6-977ed3434f88 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.082537 Oct 29 01:22:41.780127 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 767/1550] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:41 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:41.809780 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-9ec02d3e-d4d1-4383-9f5b-4bced5806078 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045899 Oct 29 01:22:41.810341 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 784/1551] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:41 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:22:42.012216 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d9a05a19-ff2c-4be3-a1e3-5efbc2ebfb30 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:42.012821 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d9a05a19-ff2c-4be3-a1e3-5efbc2ebfb30 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:42.018958 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d9a05a19-ff2c-4be3-a1e3-5efbc2ebfb30 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:42.019192 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d9a05a19-ff2c-4be3-a1e3-5efbc2ebfb30 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:42.020226 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d9a05a19-ff2c-4be3-a1e3-5efbc2ebfb30 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:42.020664 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d9a05a19-ff2c-4be3-a1e3-5efbc2ebfb30 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:42.149755 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-d9a05a19-ff2c-4be3-a1e3-5efbc2ebfb30 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:42.157048 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d9a05a19-ff2c-4be3-a1e3-5efbc2ebfb30 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.148639 Oct 29 01:22:42.157595 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 768/1552] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:42 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:42.796011 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-68f71119-4ade-48d5-b35b-14d41d2833a1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:42.796720 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-68f71119-4ade-48d5-b35b-14d41d2833a1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:42.803088 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-68f71119-4ade-48d5-b35b-14d41d2833a1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:42.803542 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-68f71119-4ade-48d5-b35b-14d41d2833a1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:42.804316 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-68f71119-4ade-48d5-b35b-14d41d2833a1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:42.804756 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-68f71119-4ade-48d5-b35b-14d41d2833a1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:42.821447 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-4933d0f8-3366-495b-8541-56b4230d6984 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:42.822369 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-4933d0f8-3366-495b-8541-56b4230d6984 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:42.828491 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4933d0f8-3366-495b-8541-56b4230d6984 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:42.828938 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4933d0f8-3366-495b-8541-56b4230d6984 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:42.829704 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4933d0f8-3366-495b-8541-56b4230d6984 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:42.830131 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4933d0f8-3366-495b-8541-56b4230d6984 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:42.860796 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-4933d0f8-3366-495b-8541-56b4230d6984 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043070 Oct 29 01:22:42.861363 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 769/1553] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:42 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:22:42.864608 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-68f71119-4ade-48d5-b35b-14d41d2833a1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:42.871980 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-68f71119-4ade-48d5-b35b-14d41d2833a1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.079676 Oct 29 01:22:42.872540 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 785/1554] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:42 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:43.024634 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:22:43.024824 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: Fri Oct 29 01:22:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 29 01:22:43.174481 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-84728e01-101a-4dec-a00e-dc7b2d323a24 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:43.175587 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-84728e01-101a-4dec-a00e-dc7b2d323a24 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:43.181415 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-84728e01-101a-4dec-a00e-dc7b2d323a24 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:43.181863 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-84728e01-101a-4dec-a00e-dc7b2d323a24 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:43.182659 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-84728e01-101a-4dec-a00e-dc7b2d323a24 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:43.183094 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-84728e01-101a-4dec-a00e-dc7b2d323a24 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:43.306673 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-84728e01-101a-4dec-a00e-dc7b2d323a24 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:43.314042 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-84728e01-101a-4dec-a00e-dc7b2d323a24 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.143286 Oct 29 01:22:43.314638 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 770/1555] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:43 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:43.871681 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c8911e3f-a4f7-423b-b9ea-c73ae8ee8358 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:43.872594 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c8911e3f-a4f7-423b-b9ea-c73ae8ee8358 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:43.879054 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c8911e3f-a4f7-423b-b9ea-c73ae8ee8358 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:43.879495 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c8911e3f-a4f7-423b-b9ea-c73ae8ee8358 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:43.880258 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c8911e3f-a4f7-423b-b9ea-c73ae8ee8358 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:43.880695 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c8911e3f-a4f7-423b-b9ea-c73ae8ee8358 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:43.888985 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-1b334e32-0fbe-4114-a8e2-9f9eb5414db3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:43.889598 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-1b334e32-0fbe-4114-a8e2-9f9eb5414db3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:43.896121 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1b334e32-0fbe-4114-a8e2-9f9eb5414db3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:43.896577 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1b334e32-0fbe-4114-a8e2-9f9eb5414db3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:43.897353 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1b334e32-0fbe-4114-a8e2-9f9eb5414db3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:43.897794 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1b334e32-0fbe-4114-a8e2-9f9eb5414db3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:43.912508 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c8911e3f-a4f7-423b-b9ea-c73ae8ee8358 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044585 Oct 29 01:22:43.913261 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 786/1556] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:43 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:43.963345 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-1b334e32-0fbe-4114-a8e2-9f9eb5414db3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:43.970992 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-1b334e32-0fbe-4114-a8e2-9f9eb5414db3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.085798 Oct 29 01:22:43.971580 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 771/1557] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:43 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:44.332275 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-652c3f07-3936-48b1-9d98-dcfafc56b134 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:44.332859 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-652c3f07-3936-48b1-9d98-dcfafc56b134 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:44.338984 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-652c3f07-3936-48b1-9d98-dcfafc56b134 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:44.339437 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-652c3f07-3936-48b1-9d98-dcfafc56b134 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:44.340213 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-652c3f07-3936-48b1-9d98-dcfafc56b134 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:44.340656 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-652c3f07-3936-48b1-9d98-dcfafc56b134 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:44.459657 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-652c3f07-3936-48b1-9d98-dcfafc56b134 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:44.467192 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-652c3f07-3936-48b1-9d98-dcfafc56b134 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.139431 Oct 29 01:22:44.467754 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 787/1558] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:44 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:44.924075 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-28d2f690-ed89-44ce-b335-9cde27ff16a7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:44.925619 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-28d2f690-ed89-44ce-b335-9cde27ff16a7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:44.932048 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-28d2f690-ed89-44ce-b335-9cde27ff16a7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:44.932496 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-28d2f690-ed89-44ce-b335-9cde27ff16a7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:44.933260 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-28d2f690-ed89-44ce-b335-9cde27ff16a7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:44.933704 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-28d2f690-ed89-44ce-b335-9cde27ff16a7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:44.964837 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-28d2f690-ed89-44ce-b335-9cde27ff16a7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044448 Oct 29 01:22:44.965415 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 772/1559] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:44 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:44.988729 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-449456e1-2728-476c-a9d0-473caddc5851 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:44.989339 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-449456e1-2728-476c-a9d0-473caddc5851 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:44.995715 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-449456e1-2728-476c-a9d0-473caddc5851 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:44.996163 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-449456e1-2728-476c-a9d0-473caddc5851 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:44.996969 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-449456e1-2728-476c-a9d0-473caddc5851 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:44.997507 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-449456e1-2728-476c-a9d0-473caddc5851 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:45.060544 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-449456e1-2728-476c-a9d0-473caddc5851 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:45.068251 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-449456e1-2728-476c-a9d0-473caddc5851 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.083739 Oct 29 01:22:45.068825 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 788/1560] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:44 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:45.484455 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-3a59cec6-8fbc-4bbe-9c5f-c6801128745d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:45.485073 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-3a59cec6-8fbc-4bbe-9c5f-c6801128745d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:45.491222 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3a59cec6-8fbc-4bbe-9c5f-c6801128745d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:45.492113 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3a59cec6-8fbc-4bbe-9c5f-c6801128745d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:45.492882 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3a59cec6-8fbc-4bbe-9c5f-c6801128745d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:45.493308 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3a59cec6-8fbc-4bbe-9c5f-c6801128745d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:45.616290 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-3a59cec6-8fbc-4bbe-9c5f-c6801128745d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:45.623836 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-3a59cec6-8fbc-4bbe-9c5f-c6801128745d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.143238 Oct 29 01:22:45.624402 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 773/1561] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:45 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:45.976445 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-216881b5-8418-4f3b-a226-23e785c2c698 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:45.977370 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-216881b5-8418-4f3b-a226-23e785c2c698 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:45.983320 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-216881b5-8418-4f3b-a226-23e785c2c698 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:45.983805 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-216881b5-8418-4f3b-a226-23e785c2c698 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:45.984581 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-216881b5-8418-4f3b-a226-23e785c2c698 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:45.985022 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-216881b5-8418-4f3b-a226-23e785c2c698 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:46.015869 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-216881b5-8418-4f3b-a226-23e785c2c698 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043217 Oct 29 01:22:46.016562 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 789/1562] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:45 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:46.084679 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a3dca014-bb91-4ea8-8327-c8f01536d032 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:46.085292 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a3dca014-bb91-4ea8-8327-c8f01536d032 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:46.091854 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a3dca014-bb91-4ea8-8327-c8f01536d032 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:46.092305 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a3dca014-bb91-4ea8-8327-c8f01536d032 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:46.093067 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a3dca014-bb91-4ea8-8327-c8f01536d032 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:46.093501 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a3dca014-bb91-4ea8-8327-c8f01536d032 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:46.155939 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-a3dca014-bb91-4ea8-8327-c8f01536d032 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:46.163463 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a3dca014-bb91-4ea8-8327-c8f01536d032 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.082570 Oct 29 01:22:46.164028 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 774/1563] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:46 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:46.640808 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e636b188-fbd5-4a1f-9932-26190b521c26 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:46.641409 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-e636b188-fbd5-4a1f-9932-26190b521c26 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:46.647358 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e636b188-fbd5-4a1f-9932-26190b521c26 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:46.647800 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e636b188-fbd5-4a1f-9932-26190b521c26 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:46.648555 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e636b188-fbd5-4a1f-9932-26190b521c26 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:46.648982 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e636b188-fbd5-4a1f-9932-26190b521c26 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:46.767118 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-e636b188-fbd5-4a1f-9932-26190b521c26 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:46.774911 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-e636b188-fbd5-4a1f-9932-26190b521c26 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.137787 Oct 29 01:22:46.775473 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 790/1564] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:46 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:47.028302 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-6d2f6ce1-8fa2-43df-a488-5ed193dd6580 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:47.029417 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-6d2f6ce1-8fa2-43df-a488-5ed193dd6580 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:47.035993 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6d2f6ce1-8fa2-43df-a488-5ed193dd6580 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:47.036443 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6d2f6ce1-8fa2-43df-a488-5ed193dd6580 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:47.037231 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6d2f6ce1-8fa2-43df-a488-5ed193dd6580 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:47.037670 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6d2f6ce1-8fa2-43df-a488-5ed193dd6580 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:47.068232 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-6d2f6ce1-8fa2-43df-a488-5ed193dd6580 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043895 Oct 29 01:22:47.068802 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 775/1565] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:47 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:47.180678 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-7f1f10d8-edcf-4b84-ac1b-5bf5ca92d86b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:47.181356 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-7f1f10d8-edcf-4b84-ac1b-5bf5ca92d86b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:47.188770 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7f1f10d8-edcf-4b84-ac1b-5bf5ca92d86b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:47.189221 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7f1f10d8-edcf-4b84-ac1b-5bf5ca92d86b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:47.190004 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7f1f10d8-edcf-4b84-ac1b-5bf5ca92d86b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:47.191020 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7f1f10d8-edcf-4b84-ac1b-5bf5ca92d86b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:47.251876 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-7f1f10d8-edcf-4b84-ac1b-5bf5ca92d86b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:47.259841 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-7f1f10d8-edcf-4b84-ac1b-5bf5ca92d86b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.083261 Oct 29 01:22:47.260407 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 791/1566] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:47 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:47.791984 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-02d6a698-8956-49e2-9718-c83511a8ea4e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:47.792537 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-02d6a698-8956-49e2-9718-c83511a8ea4e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:47.798820 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-02d6a698-8956-49e2-9718-c83511a8ea4e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:47.799266 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-02d6a698-8956-49e2-9718-c83511a8ea4e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:47.800514 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-02d6a698-8956-49e2-9718-c83511a8ea4e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:47.800946 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-02d6a698-8956-49e2-9718-c83511a8ea4e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:47.924099 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-02d6a698-8956-49e2-9718-c83511a8ea4e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:47.932332 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-02d6a698-8956-49e2-9718-c83511a8ea4e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.144027 Oct 29 01:22:47.932893 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 776/1567] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:47 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:48.080045 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-327dcdb7-0a98-471e-8b5b-eb4c2eb0e330 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:48.080878 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-327dcdb7-0a98-471e-8b5b-eb4c2eb0e330 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:48.087203 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-327dcdb7-0a98-471e-8b5b-eb4c2eb0e330 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:48.087656 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-327dcdb7-0a98-471e-8b5b-eb4c2eb0e330 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:48.088424 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-327dcdb7-0a98-471e-8b5b-eb4c2eb0e330 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:48.088867 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-327dcdb7-0a98-471e-8b5b-eb4c2eb0e330 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:48.118652 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-327dcdb7-0a98-471e-8b5b-eb4c2eb0e330 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042397 Oct 29 01:22:48.119225 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 792/1568] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:48 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:48.276955 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a330d68b-b8ad-4acf-89ef-f648b6730db5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:48.277557 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a330d68b-b8ad-4acf-89ef-f648b6730db5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:48.283659 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a330d68b-b8ad-4acf-89ef-f648b6730db5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:48.284703 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a330d68b-b8ad-4acf-89ef-f648b6730db5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:48.285470 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a330d68b-b8ad-4acf-89ef-f648b6730db5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:48.285902 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a330d68b-b8ad-4acf-89ef-f648b6730db5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:48.345704 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-a330d68b-b8ad-4acf-89ef-f648b6730db5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:48.353851 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a330d68b-b8ad-4acf-89ef-f648b6730db5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.080658 Oct 29 01:22:48.354648 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 777/1569] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:48 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:48.948957 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-0b65065e-e49b-441e-8b77-b13346be0078 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:48.949574 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-0b65065e-e49b-441e-8b77-b13346be0078 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:48.956816 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0b65065e-e49b-441e-8b77-b13346be0078 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:48.957536 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0b65065e-e49b-441e-8b77-b13346be0078 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:48.958904 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0b65065e-e49b-441e-8b77-b13346be0078 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:48.959439 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0b65065e-e49b-441e-8b77-b13346be0078 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:49.081366 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-0b65065e-e49b-441e-8b77-b13346be0078 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:49.089380 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-0b65065e-e49b-441e-8b77-b13346be0078 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.144038 Oct 29 01:22:49.089952 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 793/1570] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:48 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:49.129648 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-81c696c7-3ba3-43f5-a556-92fde207f6d2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:49.130766 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-81c696c7-3ba3-43f5-a556-92fde207f6d2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:49.137313 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-81c696c7-3ba3-43f5-a556-92fde207f6d2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:49.137751 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-81c696c7-3ba3-43f5-a556-92fde207f6d2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:49.138545 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-81c696c7-3ba3-43f5-a556-92fde207f6d2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:49.139220 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-81c696c7-3ba3-43f5-a556-92fde207f6d2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:49.167612 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-81c696c7-3ba3-43f5-a556-92fde207f6d2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042241 Oct 29 01:22:49.168309 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 778/1571] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:49 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:49.370797 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-90f86759-9e3c-4206-b074-b755350aa551 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:49.371411 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-90f86759-9e3c-4206-b074-b755350aa551 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:49.377615 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-90f86759-9e3c-4206-b074-b755350aa551 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:49.378086 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-90f86759-9e3c-4206-b074-b755350aa551 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:49.378952 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-90f86759-9e3c-4206-b074-b755350aa551 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:49.379385 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-90f86759-9e3c-4206-b074-b755350aa551 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:49.440129 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-90f86759-9e3c-4206-b074-b755350aa551 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:49.447721 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-90f86759-9e3c-4206-b074-b755350aa551 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.080582 Oct 29 01:22:49.448303 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 794/1572] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:49 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:50.105911 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-cdb18819-c323-4bb0-861f-df47afc80c4d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:50.106552 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-cdb18819-c323-4bb0-861f-df47afc80c4d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:50.112403 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cdb18819-c323-4bb0-861f-df47afc80c4d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:50.112843 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cdb18819-c323-4bb0-861f-df47afc80c4d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:50.114182 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cdb18819-c323-4bb0-861f-df47afc80c4d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:50.114636 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cdb18819-c323-4bb0-861f-df47afc80c4d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:50.180154 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-db095fa5-8559-4cd1-8ed2-0fd9eb5dc9c4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:50.180981 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-db095fa5-8559-4cd1-8ed2-0fd9eb5dc9c4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:50.186936 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-db095fa5-8559-4cd1-8ed2-0fd9eb5dc9c4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:50.187383 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-db095fa5-8559-4cd1-8ed2-0fd9eb5dc9c4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:50.188159 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-db095fa5-8559-4cd1-8ed2-0fd9eb5dc9c4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:50.188605 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-db095fa5-8559-4cd1-8ed2-0fd9eb5dc9c4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:50.218726 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-db095fa5-8559-4cd1-8ed2-0fd9eb5dc9c4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042825 Oct 29 01:22:50.219310 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 795/1573] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:50 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:22:50.244803 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-cdb18819-c323-4bb0-861f-df47afc80c4d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:50.252316 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-cdb18819-c323-4bb0-861f-df47afc80c4d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.150069 Oct 29 01:22:50.252885 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 779/1574] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:50 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:50.464587 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-af54e1f0-6a70-43ba-a9dd-940c7e1667f6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:50.465097 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-af54e1f0-6a70-43ba-a9dd-940c7e1667f6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:50.471044 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-af54e1f0-6a70-43ba-a9dd-940c7e1667f6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:50.471490 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-af54e1f0-6a70-43ba-a9dd-940c7e1667f6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:50.472240 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-af54e1f0-6a70-43ba-a9dd-940c7e1667f6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:50.473355 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-af54e1f0-6a70-43ba-a9dd-940c7e1667f6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:50.532208 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-af54e1f0-6a70-43ba-a9dd-940c7e1667f6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:50.540165 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-af54e1f0-6a70-43ba-a9dd-940c7e1667f6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.079556 Oct 29 01:22:50.540728 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 796/1575] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:50 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:51.231124 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-48d4fccc-5d2b-454a-90e6-f39f2263311a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:51.232005 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-48d4fccc-5d2b-454a-90e6-f39f2263311a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:51.238838 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-48d4fccc-5d2b-454a-90e6-f39f2263311a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:51.239286 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-48d4fccc-5d2b-454a-90e6-f39f2263311a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:51.240062 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-48d4fccc-5d2b-454a-90e6-f39f2263311a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:51.240488 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-48d4fccc-5d2b-454a-90e6-f39f2263311a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:51.269121 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2b8a3a90-1771-4a54-994f-d0028caf98f9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:51.270194 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2b8a3a90-1771-4a54-994f-d0028caf98f9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:51.271349 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-48d4fccc-5d2b-454a-90e6-f39f2263311a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044035 Oct 29 01:22:51.275398 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 780/1576] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:51 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:51.278188 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2b8a3a90-1771-4a54-994f-d0028caf98f9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:51.278670 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2b8a3a90-1771-4a54-994f-d0028caf98f9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:51.279454 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2b8a3a90-1771-4a54-994f-d0028caf98f9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:51.279889 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2b8a3a90-1771-4a54-994f-d0028caf98f9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:51.404927 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-2b8a3a90-1771-4a54-994f-d0028caf98f9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:51.412284 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2b8a3a90-1771-4a54-994f-d0028caf98f9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.147085 Oct 29 01:22:51.412855 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 797/1577] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:51 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:22:51.557548 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-7b1a94f6-8167-42a5-9e8e-5da3365bfc76 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:51.558041 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-7b1a94f6-8167-42a5-9e8e-5da3365bfc76 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:51.563948 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7b1a94f6-8167-42a5-9e8e-5da3365bfc76 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:51.564391 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7b1a94f6-8167-42a5-9e8e-5da3365bfc76 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:51.565150 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7b1a94f6-8167-42a5-9e8e-5da3365bfc76 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:51.565580 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7b1a94f6-8167-42a5-9e8e-5da3365bfc76 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:51.629034 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-7b1a94f6-8167-42a5-9e8e-5da3365bfc76 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:51.637153 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-7b1a94f6-8167-42a5-9e8e-5da3365bfc76 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.083320 Oct 29 01:22:51.637931 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 781/1578] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:51 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:52.282939 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-8aef5ad2-917e-4a90-854d-8e1d75c0e074 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:52.283765 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-8aef5ad2-917e-4a90-854d-8e1d75c0e074 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:52.293215 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8aef5ad2-917e-4a90-854d-8e1d75c0e074 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:52.293978 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8aef5ad2-917e-4a90-854d-8e1d75c0e074 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:52.294799 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8aef5ad2-917e-4a90-854d-8e1d75c0e074 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:52.295232 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8aef5ad2-917e-4a90-854d-8e1d75c0e074 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:52.331776 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-8aef5ad2-917e-4a90-854d-8e1d75c0e074 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052651 Oct 29 01:22:52.332949 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 798/1579] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:52 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:52.428739 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9211dc60-392b-44cb-9a2b-3621baa1f09d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:52.429405 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9211dc60-392b-44cb-9a2b-3621baa1f09d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:52.435709 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9211dc60-392b-44cb-9a2b-3621baa1f09d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:52.436159 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9211dc60-392b-44cb-9a2b-3621baa1f09d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:52.436922 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9211dc60-392b-44cb-9a2b-3621baa1f09d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:52.437357 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9211dc60-392b-44cb-9a2b-3621baa1f09d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:52.561522 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-9211dc60-392b-44cb-9a2b-3621baa1f09d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:52.569472 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9211dc60-392b-44cb-9a2b-3621baa1f09d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.144366 Oct 29 01:22:52.570040 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 782/1580] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:52 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:52.654271 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-710324bd-a52a-4d42-86d0-28c5d9485326 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:52.654899 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-710324bd-a52a-4d42-86d0-28c5d9485326 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:52.660705 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-710324bd-a52a-4d42-86d0-28c5d9485326 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:52.661222 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-710324bd-a52a-4d42-86d0-28c5d9485326 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:52.661991 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-710324bd-a52a-4d42-86d0-28c5d9485326 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:52.662505 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-710324bd-a52a-4d42-86d0-28c5d9485326 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:52.723503 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-710324bd-a52a-4d42-86d0-28c5d9485326 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:52.731014 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-710324bd-a52a-4d42-86d0-28c5d9485326 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.080436 Oct 29 01:22:52.731638 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 799/1581] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:52 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:53.345083 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-e3e811a7-e0bf-4ede-870c-3085611d50bd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:53.346555 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-e3e811a7-e0bf-4ede-870c-3085611d50bd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:53.353647 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e3e811a7-e0bf-4ede-870c-3085611d50bd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:53.354229 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e3e811a7-e0bf-4ede-870c-3085611d50bd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:53.355388 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e3e811a7-e0bf-4ede-870c-3085611d50bd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:53.356114 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e3e811a7-e0bf-4ede-870c-3085611d50bd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:53.388178 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-e3e811a7-e0bf-4ede-870c-3085611d50bd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047235 Oct 29 01:22:53.388745 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 783/1582] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:53 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:53.586249 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-b8ebd849-57f9-423d-893b-733fa8d62af7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:53.587154 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-b8ebd849-57f9-423d-893b-733fa8d62af7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:53.593756 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b8ebd849-57f9-423d-893b-733fa8d62af7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:53.594383 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b8ebd849-57f9-423d-893b-733fa8d62af7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:53.595227 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b8ebd849-57f9-423d-893b-733fa8d62af7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:53.595608 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b8ebd849-57f9-423d-893b-733fa8d62af7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:53.718275 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-b8ebd849-57f9-423d-893b-733fa8d62af7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:53.726417 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-b8ebd849-57f9-423d-893b-733fa8d62af7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.144161 Oct 29 01:22:53.727011 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 800/1583] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:53 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:53.748288 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-80da0fa9-6b2f-4c9c-9be9-ecee00f7ae92 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:53.750176 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-80da0fa9-6b2f-4c9c-9be9-ecee00f7ae92 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:53.755476 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-80da0fa9-6b2f-4c9c-9be9-ecee00f7ae92 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:53.755925 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-80da0fa9-6b2f-4c9c-9be9-ecee00f7ae92 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:53.756702 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-80da0fa9-6b2f-4c9c-9be9-ecee00f7ae92 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:53.757136 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-80da0fa9-6b2f-4c9c-9be9-ecee00f7ae92 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:53.825492 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-80da0fa9-6b2f-4c9c-9be9-ecee00f7ae92 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:53.840846 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-80da0fa9-6b2f-4c9c-9be9-ecee00f7ae92 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.095835 Oct 29 01:22:53.841912 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 784/1584] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:53 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:54.399816 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f4060395-b060-4fca-bc2f-224c5d2dc58a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:54.400731 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f4060395-b060-4fca-bc2f-224c5d2dc58a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:54.406613 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f4060395-b060-4fca-bc2f-224c5d2dc58a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:54.407061 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f4060395-b060-4fca-bc2f-224c5d2dc58a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:54.407827 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f4060395-b060-4fca-bc2f-224c5d2dc58a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:54.408259 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f4060395-b060-4fca-bc2f-224c5d2dc58a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:54.441145 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f4060395-b060-4fca-bc2f-224c5d2dc58a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045090 Oct 29 01:22:54.441705 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 801/1585] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:54 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:54.744263 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-00570369-1dfc-42ce-b301-1a39818b3c7e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:54.744814 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-00570369-1dfc-42ce-b301-1a39818b3c7e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:54.750818 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-00570369-1dfc-42ce-b301-1a39818b3c7e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:54.751416 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-00570369-1dfc-42ce-b301-1a39818b3c7e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:54.752026 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-00570369-1dfc-42ce-b301-1a39818b3c7e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:54.752462 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-00570369-1dfc-42ce-b301-1a39818b3c7e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:54.858494 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-5dd32c78-3105-4a8a-a746-475afa8cf575 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:54.859111 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-5dd32c78-3105-4a8a-a746-475afa8cf575 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:54.866077 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5dd32c78-3105-4a8a-a746-475afa8cf575 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:54.866561 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5dd32c78-3105-4a8a-a746-475afa8cf575 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:54.867347 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5dd32c78-3105-4a8a-a746-475afa8cf575 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:54.867788 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5dd32c78-3105-4a8a-a746-475afa8cf575 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:54.878605 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-00570369-1dfc-42ce-b301-1a39818b3c7e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:54.892456 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-00570369-1dfc-42ce-b301-1a39818b3c7e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.151876 Oct 29 01:22:54.893479 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 785/1586] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:54 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:54.930659 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-5dd32c78-3105-4a8a-a746-475afa8cf575 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:54.937479 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-5dd32c78-3105-4a8a-a746-475afa8cf575 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.082712 Oct 29 01:22:54.938061 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 802/1587] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:54 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:22:55.453250 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-62e4bd60-7283-4a97-9c9e-597e3bd4628a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:55.454182 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-62e4bd60-7283-4a97-9c9e-597e3bd4628a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:55.461035 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-62e4bd60-7283-4a97-9c9e-597e3bd4628a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:55.461480 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-62e4bd60-7283-4a97-9c9e-597e3bd4628a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:55.462553 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-62e4bd60-7283-4a97-9c9e-597e3bd4628a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:55.462987 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-62e4bd60-7283-4a97-9c9e-597e3bd4628a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:55.492704 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-62e4bd60-7283-4a97-9c9e-597e3bd4628a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043204 Oct 29 01:22:55.493321 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 786/1588] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:55 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:55.910911 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-fcc7203e-3481-480f-b927-3c0da3ed066f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:55.911549 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-fcc7203e-3481-480f-b927-3c0da3ed066f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:55.917978 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fcc7203e-3481-480f-b927-3c0da3ed066f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:55.918453 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fcc7203e-3481-480f-b927-3c0da3ed066f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:55.919239 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fcc7203e-3481-480f-b927-3c0da3ed066f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:55.919671 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fcc7203e-3481-480f-b927-3c0da3ed066f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:55.954370 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f89cb23d-bdfe-4c41-926a-facec6db3de1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:55.955022 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f89cb23d-bdfe-4c41-926a-facec6db3de1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:55.964090 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f89cb23d-bdfe-4c41-926a-facec6db3de1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:55.964643 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f89cb23d-bdfe-4c41-926a-facec6db3de1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:55.965559 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f89cb23d-bdfe-4c41-926a-facec6db3de1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:55.966073 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f89cb23d-bdfe-4c41-926a-facec6db3de1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:56.043960 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-f89cb23d-bdfe-4c41-926a-facec6db3de1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:56.052638 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f89cb23d-bdfe-4c41-926a-facec6db3de1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.101986 Oct 29 01:22:56.053228 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 787/1589] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:55 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:22:56.070432 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-fcc7203e-3481-480f-b927-3c0da3ed066f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:56.077867 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-fcc7203e-3481-480f-b927-3c0da3ed066f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.170706 Oct 29 01:22:56.078462 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 803/1590] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:55 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:56.505089 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-4f87cb69-e042-4fdd-b0af-3cf9ef669864 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:56.506011 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-4f87cb69-e042-4fdd-b0af-3cf9ef669864 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:56.512019 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4f87cb69-e042-4fdd-b0af-3cf9ef669864 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:56.512478 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4f87cb69-e042-4fdd-b0af-3cf9ef669864 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:56.513257 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4f87cb69-e042-4fdd-b0af-3cf9ef669864 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:56.513691 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4f87cb69-e042-4fdd-b0af-3cf9ef669864 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:56.544539 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-4f87cb69-e042-4fdd-b0af-3cf9ef669864 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043696 Oct 29 01:22:56.545162 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 788/1591] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:56 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:57.069157 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d6516b73-c8ce-4ce4-8eb3-43b46fad4521 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:57.069753 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d6516b73-c8ce-4ce4-8eb3-43b46fad4521 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:57.076370 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d6516b73-c8ce-4ce4-8eb3-43b46fad4521 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:57.076878 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d6516b73-c8ce-4ce4-8eb3-43b46fad4521 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:57.077670 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d6516b73-c8ce-4ce4-8eb3-43b46fad4521 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:57.078099 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d6516b73-c8ce-4ce4-8eb3-43b46fad4521 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:57.095961 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-8a4e7013-9262-46d0-842b-e04afe117ec7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:57.096860 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-8a4e7013-9262-46d0-842b-e04afe117ec7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:57.105779 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8a4e7013-9262-46d0-842b-e04afe117ec7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:57.105779 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8a4e7013-9262-46d0-842b-e04afe117ec7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:57.106529 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8a4e7013-9262-46d0-842b-e04afe117ec7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:57.106975 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8a4e7013-9262-46d0-842b-e04afe117ec7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:57.190899 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-d6516b73-c8ce-4ce4-8eb3-43b46fad4521 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:57.198611 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d6516b73-c8ce-4ce4-8eb3-43b46fad4521 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.133182 Oct 29 01:22:57.199188 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 804/1592] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:57 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:22:57.276550 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-8a4e7013-9262-46d0-842b-e04afe117ec7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:57.291032 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-8a4e7013-9262-46d0-842b-e04afe117ec7 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.198351 Oct 29 01:22:57.292149 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 789/1593] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:57 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:22:57.557416 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-47a2f3cc-ca5b-4272-a23b-22b55bcb0fe0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:57.559019 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-47a2f3cc-ca5b-4272-a23b-22b55bcb0fe0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:57.570138 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-47a2f3cc-ca5b-4272-a23b-22b55bcb0fe0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:57.570970 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-47a2f3cc-ca5b-4272-a23b-22b55bcb0fe0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:57.572341 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-47a2f3cc-ca5b-4272-a23b-22b55bcb0fe0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:57.573119 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-47a2f3cc-ca5b-4272-a23b-22b55bcb0fe0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:57.613328 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-47a2f3cc-ca5b-4272-a23b-22b55bcb0fe0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060980 Oct 29 01:22:57.613946 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 805/1594] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:57 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:58.217924 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9a68b199-bd44-4a94-8c76-8fe34b444ff0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:58.218528 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9a68b199-bd44-4a94-8c76-8fe34b444ff0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:58.226904 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9a68b199-bd44-4a94-8c76-8fe34b444ff0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:58.227358 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9a68b199-bd44-4a94-8c76-8fe34b444ff0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:58.228146 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9a68b199-bd44-4a94-8c76-8fe34b444ff0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:58.228589 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9a68b199-bd44-4a94-8c76-8fe34b444ff0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:58.300660 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-9a68b199-bd44-4a94-8c76-8fe34b444ff0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:58.308705 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9a68b199-bd44-4a94-8c76-8fe34b444ff0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.094595 Oct 29 01:22:58.308934 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-82ad7faa-85e5-4f11-8b99-14eb6690217f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:58.309388 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 790/1595] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:58 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:58.309527 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-82ad7faa-85e5-4f11-8b99-14eb6690217f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:58.315969 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-82ad7faa-85e5-4f11-8b99-14eb6690217f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:58.316427 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-82ad7faa-85e5-4f11-8b99-14eb6690217f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:58.317697 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-82ad7faa-85e5-4f11-8b99-14eb6690217f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:58.318133 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-82ad7faa-85e5-4f11-8b99-14eb6690217f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:58.447638 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-82ad7faa-85e5-4f11-8b99-14eb6690217f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:58.455513 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-82ad7faa-85e5-4f11-8b99-14eb6690217f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.150183 Oct 29 01:22:58.456093 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 806/1596] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:58 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:22:58.625021 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-78956f84-2724-4e0b-8b07-6d847239dc2d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:58.625950 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-78956f84-2724-4e0b-8b07-6d847239dc2d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:58.632775 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-78956f84-2724-4e0b-8b07-6d847239dc2d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:58.633229 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-78956f84-2724-4e0b-8b07-6d847239dc2d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:58.634015 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-78956f84-2724-4e0b-8b07-6d847239dc2d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:58.634477 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-78956f84-2724-4e0b-8b07-6d847239dc2d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:58.665378 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-78956f84-2724-4e0b-8b07-6d847239dc2d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044117 Oct 29 01:22:58.666116 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 791/1597] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:58 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:59.326362 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-99a1d081-d406-4264-89fe-a9eb00be41e6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:59.326966 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-99a1d081-d406-4264-89fe-a9eb00be41e6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:59.333330 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-99a1d081-d406-4264-89fe-a9eb00be41e6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:59.333785 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-99a1d081-d406-4264-89fe-a9eb00be41e6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:59.334599 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-99a1d081-d406-4264-89fe-a9eb00be41e6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:59.335038 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-99a1d081-d406-4264-89fe-a9eb00be41e6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:59.398809 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-99a1d081-d406-4264-89fe-a9eb00be41e6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:59.406737 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-99a1d081-d406-4264-89fe-a9eb00be41e6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.084210 Oct 29 01:22:59.407338 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 807/1598] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:59 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:59.474339 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-3c59cee0-73e4-42b4-8b70-d34d53700bfd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:59.475003 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-3c59cee0-73e4-42b4-8b70-d34d53700bfd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:59.481522 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3c59cee0-73e4-42b4-8b70-d34d53700bfd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:59.481968 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3c59cee0-73e4-42b4-8b70-d34d53700bfd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:59.482782 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3c59cee0-73e4-42b4-8b70-d34d53700bfd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:59.483211 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3c59cee0-73e4-42b4-8b70-d34d53700bfd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:59.610466 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-3c59cee0-73e4-42b4-8b70-d34d53700bfd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:59.618499 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-3c59cee0-73e4-42b4-8b70-d34d53700bfd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.148453 Oct 29 01:22:59.619092 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 792/1599] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:22:59 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:59.677121 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2e1a31a2-7654-4e39-aa24-1e130c3eac95 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:59.678101 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2e1a31a2-7654-4e39-aa24-1e130c3eac95 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:22:59.684321 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2e1a31a2-7654-4e39-aa24-1e130c3eac95 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:59.684765 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2e1a31a2-7654-4e39-aa24-1e130c3eac95 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:59.685547 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2e1a31a2-7654-4e39-aa24-1e130c3eac95 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:22:59.685985 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2e1a31a2-7654-4e39-aa24-1e130c3eac95 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:22:59.717843 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2e1a31a2-7654-4e39-aa24-1e130c3eac95 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044556 Oct 29 01:22:59.718450 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 808/1600] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:22:59 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:23:00.423761 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-192d2b37-5066-4499-a6bc-cf8f443c3ca2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:00.424374 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-192d2b37-5066-4499-a6bc-cf8f443c3ca2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:00.431088 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-192d2b37-5066-4499-a6bc-cf8f443c3ca2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:00.431532 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-192d2b37-5066-4499-a6bc-cf8f443c3ca2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:00.432308 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-192d2b37-5066-4499-a6bc-cf8f443c3ca2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:00.432734 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-192d2b37-5066-4499-a6bc-cf8f443c3ca2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:00.500726 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-192d2b37-5066-4499-a6bc-cf8f443c3ca2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:00.509569 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-192d2b37-5066-4499-a6bc-cf8f443c3ca2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.089586 Oct 29 01:23:00.510154 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 793/1601] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:00 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:00.635800 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d9d52bfa-4f9d-48b6-9a83-afea0f5f64b5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:00.636421 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d9d52bfa-4f9d-48b6-9a83-afea0f5f64b5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:00.642940 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d9d52bfa-4f9d-48b6-9a83-afea0f5f64b5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:00.643389 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d9d52bfa-4f9d-48b6-9a83-afea0f5f64b5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:00.644172 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d9d52bfa-4f9d-48b6-9a83-afea0f5f64b5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:00.644676 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d9d52bfa-4f9d-48b6-9a83-afea0f5f64b5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:00.730058 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-64981e63-1723-4699-994d-52d18ba88622 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:00.731017 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-64981e63-1723-4699-994d-52d18ba88622 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:00.737002 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-64981e63-1723-4699-994d-52d18ba88622 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:00.737458 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-64981e63-1723-4699-994d-52d18ba88622 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:00.738431 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-64981e63-1723-4699-994d-52d18ba88622 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:00.739397 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-64981e63-1723-4699-994d-52d18ba88622 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:00.769619 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-64981e63-1723-4699-994d-52d18ba88622 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043567 Oct 29 01:23:00.770190 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 794/1602] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:23:00 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:23:00.771880 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-d9d52bfa-4f9d-48b6-9a83-afea0f5f64b5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:00.779390 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d9d52bfa-4f9d-48b6-9a83-afea0f5f64b5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.147426 Oct 29 01:23:00.779948 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 809/1603] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:00 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:01.526972 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a1958401-8681-475b-8677-69651ce6d929 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:01.527581 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a1958401-8681-475b-8677-69651ce6d929 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:01.534098 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a1958401-8681-475b-8677-69651ce6d929 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:01.534587 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a1958401-8681-475b-8677-69651ce6d929 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:01.535368 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a1958401-8681-475b-8677-69651ce6d929 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:01.535802 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a1958401-8681-475b-8677-69651ce6d929 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:01.598375 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-a1958401-8681-475b-8677-69651ce6d929 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:01.606230 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a1958401-8681-475b-8677-69651ce6d929 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.083108 Oct 29 01:23:01.606868 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 795/1604] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:01 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:01.780940 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c85619fb-689c-4efd-a353-56a4f508d588 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:01.781771 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c85619fb-689c-4efd-a353-56a4f508d588 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:01.788408 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c85619fb-689c-4efd-a353-56a4f508d588 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:01.788856 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c85619fb-689c-4efd-a353-56a4f508d588 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:01.789633 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c85619fb-689c-4efd-a353-56a4f508d588 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:01.790061 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c85619fb-689c-4efd-a353-56a4f508d588 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:01.796568 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-aee3ed23-3ffb-4531-9f7d-5508a1f9df72 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:01.797273 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-aee3ed23-3ffb-4531-9f7d-5508a1f9df72 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:01.803584 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-aee3ed23-3ffb-4531-9f7d-5508a1f9df72 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:01.804013 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-aee3ed23-3ffb-4531-9f7d-5508a1f9df72 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:01.804782 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-aee3ed23-3ffb-4531-9f7d-5508a1f9df72 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:01.805216 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-aee3ed23-3ffb-4531-9f7d-5508a1f9df72 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:01.821049 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c85619fb-689c-4efd-a353-56a4f508d588 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043903 Oct 29 01:23:01.821626 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 810/1605] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:23:01 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:23:01.927574 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-aee3ed23-3ffb-4531-9f7d-5508a1f9df72 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:01.935233 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-aee3ed23-3ffb-4531-9f7d-5508a1f9df72 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.141848 Oct 29 01:23:01.935435 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 796/1606] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:01 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:02.623495 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-ca9f5f95-1109-4a77-969f-86fe276d75a8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:02.624107 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-ca9f5f95-1109-4a77-969f-86fe276d75a8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:02.630712 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ca9f5f95-1109-4a77-969f-86fe276d75a8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:02.631152 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ca9f5f95-1109-4a77-969f-86fe276d75a8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:02.631793 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ca9f5f95-1109-4a77-969f-86fe276d75a8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:02.632219 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ca9f5f95-1109-4a77-969f-86fe276d75a8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:02.700435 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-ca9f5f95-1109-4a77-969f-86fe276d75a8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:02.708590 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-ca9f5f95-1109-4a77-969f-86fe276d75a8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.088834 Oct 29 01:23:02.709639 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 811/1607] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:02 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:02.832711 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-1cde7512-9279-43f0-936f-6bfd90f60350 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:02.833691 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-1cde7512-9279-43f0-936f-6bfd90f60350 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:02.841400 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1cde7512-9279-43f0-936f-6bfd90f60350 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:02.841856 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1cde7512-9279-43f0-936f-6bfd90f60350 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:02.842687 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1cde7512-9279-43f0-936f-6bfd90f60350 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:02.843160 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1cde7512-9279-43f0-936f-6bfd90f60350 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:02.873872 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-1cde7512-9279-43f0-936f-6bfd90f60350 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044897 Oct 29 01:23:02.874358 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 797/1608] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:23:02 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:23:02.952403 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-bebf34c6-1938-44d5-8019-a93b1ad0af87 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:02.953016 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-bebf34c6-1938-44d5-8019-a93b1ad0af87 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:02.960916 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bebf34c6-1938-44d5-8019-a93b1ad0af87 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:02.961365 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bebf34c6-1938-44d5-8019-a93b1ad0af87 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:02.962415 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bebf34c6-1938-44d5-8019-a93b1ad0af87 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:02.962858 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bebf34c6-1938-44d5-8019-a93b1ad0af87 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:03.102561 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-bebf34c6-1938-44d5-8019-a93b1ad0af87 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:03.110265 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-bebf34c6-1938-44d5-8019-a93b1ad0af87 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.161536 Oct 29 01:23:03.110882 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 812/1609] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:02 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:03.726059 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-91368cd5-1d57-4127-a599-361ed33d34e8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:03.726707 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-91368cd5-1d57-4127-a599-361ed33d34e8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:03.733076 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-91368cd5-1d57-4127-a599-361ed33d34e8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:03.733524 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-91368cd5-1d57-4127-a599-361ed33d34e8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:03.734315 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-91368cd5-1d57-4127-a599-361ed33d34e8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:03.735357 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-91368cd5-1d57-4127-a599-361ed33d34e8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:03.802526 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-91368cd5-1d57-4127-a599-361ed33d34e8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:03.810652 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-91368cd5-1d57-4127-a599-361ed33d34e8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.088822 Oct 29 01:23:03.811239 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 798/1610] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:03 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:03.885199 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f71b3915-583f-4d2c-adfb-bad5c0aad061 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:03.886132 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f71b3915-583f-4d2c-adfb-bad5c0aad061 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:03.892493 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f71b3915-583f-4d2c-adfb-bad5c0aad061 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:03.892974 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f71b3915-583f-4d2c-adfb-bad5c0aad061 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:03.893776 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f71b3915-583f-4d2c-adfb-bad5c0aad061 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:03.894222 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f71b3915-583f-4d2c-adfb-bad5c0aad061 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:03.927879 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f71b3915-583f-4d2c-adfb-bad5c0aad061 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046363 Oct 29 01:23:03.928485 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 813/1611] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:23:03 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:23:04.127661 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-835a2789-beb5-4a3e-bffc-72cbd5853000 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:04.128304 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-835a2789-beb5-4a3e-bffc-72cbd5853000 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:04.134623 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-835a2789-beb5-4a3e-bffc-72cbd5853000 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:04.135069 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-835a2789-beb5-4a3e-bffc-72cbd5853000 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:04.135846 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-835a2789-beb5-4a3e-bffc-72cbd5853000 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:04.136278 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-835a2789-beb5-4a3e-bffc-72cbd5853000 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:04.274630 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-835a2789-beb5-4a3e-bffc-72cbd5853000 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:04.282576 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-835a2789-beb5-4a3e-bffc-72cbd5853000 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.158613 Oct 29 01:23:04.283158 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 799/1612] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:04 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:04.827354 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c2c11730-7080-4a93-8df4-5d6d2e0a3956 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:04.828022 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c2c11730-7080-4a93-8df4-5d6d2e0a3956 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:04.834628 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c2c11730-7080-4a93-8df4-5d6d2e0a3956 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:04.835076 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c2c11730-7080-4a93-8df4-5d6d2e0a3956 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:04.835883 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c2c11730-7080-4a93-8df4-5d6d2e0a3956 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:04.836404 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c2c11730-7080-4a93-8df4-5d6d2e0a3956 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:04.904153 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-c2c11730-7080-4a93-8df4-5d6d2e0a3956 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:04.914151 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c2c11730-7080-4a93-8df4-5d6d2e0a3956 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.090152 Oct 29 01:23:04.914970 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 814/1613] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:04 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:04.940931 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-850acec8-2726-4bc7-a3c2-3cc2ff6cc697 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:04.942545 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-850acec8-2726-4bc7-a3c2-3cc2ff6cc697 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:04.949249 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-850acec8-2726-4bc7-a3c2-3cc2ff6cc697 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:04.949699 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-850acec8-2726-4bc7-a3c2-3cc2ff6cc697 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:04.950546 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-850acec8-2726-4bc7-a3c2-3cc2ff6cc697 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:04.951003 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-850acec8-2726-4bc7-a3c2-3cc2ff6cc697 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:04.983078 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-850acec8-2726-4bc7-a3c2-3cc2ff6cc697 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046136 Oct 29 01:23:04.983661 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 800/1614] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:23:04 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:23:05.304083 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c49fbf83-7407-4314-8d14-d17d80a4b0fd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:05.304708 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c49fbf83-7407-4314-8d14-d17d80a4b0fd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:05.310875 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c49fbf83-7407-4314-8d14-d17d80a4b0fd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:05.311320 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c49fbf83-7407-4314-8d14-d17d80a4b0fd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:05.312108 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c49fbf83-7407-4314-8d14-d17d80a4b0fd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:05.312541 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c49fbf83-7407-4314-8d14-d17d80a4b0fd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:05.440231 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-c49fbf83-7407-4314-8d14-d17d80a4b0fd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:05.447934 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c49fbf83-7407-4314-8d14-d17d80a4b0fd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.150511 Oct 29 01:23:05.448523 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 815/1615] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:05 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:05.933269 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-4bab6e5d-3423-47bd-9742-a80d7da2b866 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:05.934229 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-4bab6e5d-3423-47bd-9742-a80d7da2b866 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:05.943528 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4bab6e5d-3423-47bd-9742-a80d7da2b866 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:05.944195 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4bab6e5d-3423-47bd-9742-a80d7da2b866 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:05.945351 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4bab6e5d-3423-47bd-9742-a80d7da2b866 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:05.945988 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4bab6e5d-3423-47bd-9742-a80d7da2b866 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:05.994787 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-6eb638c9-f845-4000-a475-2e11d076a155 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:05.997484 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-6eb638c9-f845-4000-a475-2e11d076a155 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:06.008891 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6eb638c9-f845-4000-a475-2e11d076a155 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:06.009691 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6eb638c9-f845-4000-a475-2e11d076a155 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:06.011471 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6eb638c9-f845-4000-a475-2e11d076a155 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:06.012257 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6eb638c9-f845-4000-a475-2e11d076a155 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:06.044242 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-4bab6e5d-3423-47bd-9742-a80d7da2b866 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:06.050708 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-6eb638c9-f845-4000-a475-2e11d076a155 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059739 Oct 29 01:23:06.051301 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 816/1616] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:23:05 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:23:06.057429 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-4bab6e5d-3423-47bd-9742-a80d7da2b866 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.129510 Oct 29 01:23:06.058440 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 801/1617] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:05 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:06.465205 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f20663f4-12ef-431a-bbfd-a71f662090ea tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:06.465816 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f20663f4-12ef-431a-bbfd-a71f662090ea tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:06.471892 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f20663f4-12ef-431a-bbfd-a71f662090ea tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:06.472339 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f20663f4-12ef-431a-bbfd-a71f662090ea tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:06.473690 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f20663f4-12ef-431a-bbfd-a71f662090ea tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:06.474127 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f20663f4-12ef-431a-bbfd-a71f662090ea tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:06.607296 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-f20663f4-12ef-431a-bbfd-a71f662090ea tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:06.615048 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f20663f4-12ef-431a-bbfd-a71f662090ea tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.153795 Oct 29 01:23:06.615635 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 817/1618] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:06 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:07.061467 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-8db79ace-bde4-483b-aef3-f4b1bb74ccbd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:07.062423 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-8db79ace-bde4-483b-aef3-f4b1bb74ccbd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:07.069639 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8db79ace-bde4-483b-aef3-f4b1bb74ccbd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:07.070085 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8db79ace-bde4-483b-aef3-f4b1bb74ccbd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:07.070910 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8db79ace-bde4-483b-aef3-f4b1bb74ccbd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:07.071345 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8db79ace-bde4-483b-aef3-f4b1bb74ccbd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:07.082261 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-aa353e44-dccb-47a8-a634-2756d4ceb7d5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:07.083111 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-aa353e44-dccb-47a8-a634-2756d4ceb7d5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:07.089255 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-aa353e44-dccb-47a8-a634-2756d4ceb7d5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:07.089706 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-aa353e44-dccb-47a8-a634-2756d4ceb7d5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:07.090517 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-aa353e44-dccb-47a8-a634-2756d4ceb7d5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:07.090954 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-aa353e44-dccb-47a8-a634-2756d4ceb7d5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:07.102640 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-8db79ace-bde4-483b-aef3-f4b1bb74ccbd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045047 Oct 29 01:23:07.103225 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 802/1619] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:23:07 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:23:07.154608 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-aa353e44-dccb-47a8-a634-2756d4ceb7d5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:07.162433 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-aa353e44-dccb-47a8-a634-2756d4ceb7d5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.083824 Oct 29 01:23:07.163019 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 818/1620] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:07 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:07.632831 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-8543cb46-532c-4d63-8f97-749538ca95bd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:07.633618 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-8543cb46-532c-4d63-8f97-749538ca95bd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:07.639989 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8543cb46-532c-4d63-8f97-749538ca95bd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:07.640447 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8543cb46-532c-4d63-8f97-749538ca95bd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:07.641254 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8543cb46-532c-4d63-8f97-749538ca95bd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:07.641694 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8543cb46-532c-4d63-8f97-749538ca95bd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:07.791286 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-8543cb46-532c-4d63-8f97-749538ca95bd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:07.799653 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-8543cb46-532c-4d63-8f97-749538ca95bd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.171051 Oct 29 01:23:07.800306 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 803/1621] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:07 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:08.116025 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-573496fc-985b-4981-a1bd-51e4946a550b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:08.116950 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-573496fc-985b-4981-a1bd-51e4946a550b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:08.123707 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-573496fc-985b-4981-a1bd-51e4946a550b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:08.124154 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-573496fc-985b-4981-a1bd-51e4946a550b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:08.124924 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-573496fc-985b-4981-a1bd-51e4946a550b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:08.125353 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-573496fc-985b-4981-a1bd-51e4946a550b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:08.156831 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-573496fc-985b-4981-a1bd-51e4946a550b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044620 Oct 29 01:23:08.157405 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 819/1622] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:23:08 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:23:08.179911 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-4f7ad58d-ecf7-4d75-8ff5-5a7d5dde875b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:08.180513 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-4f7ad58d-ecf7-4d75-8ff5-5a7d5dde875b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:08.186888 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4f7ad58d-ecf7-4d75-8ff5-5a7d5dde875b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:08.187333 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4f7ad58d-ecf7-4d75-8ff5-5a7d5dde875b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:08.188103 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4f7ad58d-ecf7-4d75-8ff5-5a7d5dde875b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:08.188533 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4f7ad58d-ecf7-4d75-8ff5-5a7d5dde875b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:08.254303 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-4f7ad58d-ecf7-4d75-8ff5-5a7d5dde875b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:08.261894 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-4f7ad58d-ecf7-4d75-8ff5-5a7d5dde875b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.086130 Oct 29 01:23:08.262501 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 804/1623] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:08 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:08.817451 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f2753a60-115c-4360-a4ee-cd5ad28dd3a6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:08.818058 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f2753a60-115c-4360-a4ee-cd5ad28dd3a6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:08.823965 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f2753a60-115c-4360-a4ee-cd5ad28dd3a6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:08.824415 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f2753a60-115c-4360-a4ee-cd5ad28dd3a6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:08.825180 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f2753a60-115c-4360-a4ee-cd5ad28dd3a6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:08.825613 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f2753a60-115c-4360-a4ee-cd5ad28dd3a6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:08.950691 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-f2753a60-115c-4360-a4ee-cd5ad28dd3a6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:08.960418 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f2753a60-115c-4360-a4ee-cd5ad28dd3a6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.146946 Oct 29 01:23:08.961009 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 820/1624] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:08 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:09.168789 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-bfbbe29a-d4b1-4115-9911-8990b30dc474 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:09.169728 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-bfbbe29a-d4b1-4115-9911-8990b30dc474 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:09.175753 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bfbbe29a-d4b1-4115-9911-8990b30dc474 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:09.176188 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bfbbe29a-d4b1-4115-9911-8990b30dc474 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:09.176969 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bfbbe29a-d4b1-4115-9911-8990b30dc474 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:09.177409 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bfbbe29a-d4b1-4115-9911-8990b30dc474 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:09.208263 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-bfbbe29a-d4b1-4115-9911-8990b30dc474 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043238 Oct 29 01:23:09.208936 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 805/1625] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:23:09 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:23:09.279687 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-02d154d3-180b-4bf4-a9f8-70a1e9e084b8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:09.280289 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-02d154d3-180b-4bf4-a9f8-70a1e9e084b8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:09.287495 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-02d154d3-180b-4bf4-a9f8-70a1e9e084b8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:09.287948 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-02d154d3-180b-4bf4-a9f8-70a1e9e084b8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:09.288726 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-02d154d3-180b-4bf4-a9f8-70a1e9e084b8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:09.289163 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-02d154d3-180b-4bf4-a9f8-70a1e9e084b8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:09.366715 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-02d154d3-180b-4bf4-a9f8-70a1e9e084b8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:09.374350 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-02d154d3-180b-4bf4-a9f8-70a1e9e084b8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.098331 Oct 29 01:23:09.374955 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 821/1626] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:09 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:09.978593 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-e71e764e-3bf7-40ec-ae38-7afb58329d8a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:09.979229 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-e71e764e-3bf7-40ec-ae38-7afb58329d8a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:09.985083 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e71e764e-3bf7-40ec-ae38-7afb58329d8a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:09.985554 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e71e764e-3bf7-40ec-ae38-7afb58329d8a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:09.986315 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e71e764e-3bf7-40ec-ae38-7afb58329d8a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:09.986768 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e71e764e-3bf7-40ec-ae38-7afb58329d8a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:10.108448 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-e71e764e-3bf7-40ec-ae38-7afb58329d8a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:10.116476 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-e71e764e-3bf7-40ec-ae38-7afb58329d8a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.141535 Oct 29 01:23:10.117027 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 806/1627] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:09 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:10.220869 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-b5ef6c6b-887f-4643-8927-6630176543ad tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:10.221696 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-b5ef6c6b-887f-4643-8927-6630176543ad tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:10.228216 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b5ef6c6b-887f-4643-8927-6630176543ad tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:10.228662 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b5ef6c6b-887f-4643-8927-6630176543ad tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:10.229423 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b5ef6c6b-887f-4643-8927-6630176543ad tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:10.229851 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b5ef6c6b-887f-4643-8927-6630176543ad tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:10.260431 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-b5ef6c6b-887f-4643-8927-6630176543ad tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043676 Oct 29 01:23:10.260990 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 822/1628] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:23:10 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:23:10.391189 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-0234eb68-88be-4321-b27e-d5ee105878b2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:10.391807 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-0234eb68-88be-4321-b27e-d5ee105878b2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:10.398060 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0234eb68-88be-4321-b27e-d5ee105878b2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:10.398549 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0234eb68-88be-4321-b27e-d5ee105878b2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:10.399333 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0234eb68-88be-4321-b27e-d5ee105878b2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:10.399775 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0234eb68-88be-4321-b27e-d5ee105878b2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:10.471810 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-0234eb68-88be-4321-b27e-d5ee105878b2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:10.482304 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-0234eb68-88be-4321-b27e-d5ee105878b2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.094716 Oct 29 01:23:10.482940 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 807/1629] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:10 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:11.134170 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-411e6e09-edee-4d08-9700-e7de01f02151 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:11.134814 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-411e6e09-edee-4d08-9700-e7de01f02151 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:11.141167 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-411e6e09-edee-4d08-9700-e7de01f02151 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:11.141618 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-411e6e09-edee-4d08-9700-e7de01f02151 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:11.142451 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-411e6e09-edee-4d08-9700-e7de01f02151 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:11.142892 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-411e6e09-edee-4d08-9700-e7de01f02151 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:11.267411 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-411e6e09-edee-4d08-9700-e7de01f02151 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:11.273104 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b08fcb4e-b46c-4b0f-82e4-e17ff7616cf8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:11.274266 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b08fcb4e-b46c-4b0f-82e4-e17ff7616cf8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:11.276058 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-411e6e09-edee-4d08-9700-e7de01f02151 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.145986 Oct 29 01:23:11.276891 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 823/1630] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:11 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:11.288397 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b08fcb4e-b46c-4b0f-82e4-e17ff7616cf8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:11.289164 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b08fcb4e-b46c-4b0f-82e4-e17ff7616cf8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:11.290670 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b08fcb4e-b46c-4b0f-82e4-e17ff7616cf8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:11.291113 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b08fcb4e-b46c-4b0f-82e4-e17ff7616cf8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:11.330205 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b08fcb4e-b46c-4b0f-82e4-e17ff7616cf8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062010 Oct 29 01:23:11.330874 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 808/1631] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:23:11 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:23:11.501060 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-ccb5f613-04b4-45b1-93af-364399d64cdc tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:11.501583 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-ccb5f613-04b4-45b1-93af-364399d64cdc tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:11.507591 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ccb5f613-04b4-45b1-93af-364399d64cdc tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:11.508032 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ccb5f613-04b4-45b1-93af-364399d64cdc tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:11.508785 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ccb5f613-04b4-45b1-93af-364399d64cdc tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:11.509212 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ccb5f613-04b4-45b1-93af-364399d64cdc tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:11.568592 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-ccb5f613-04b4-45b1-93af-364399d64cdc tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:11.575924 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-ccb5f613-04b4-45b1-93af-364399d64cdc tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.078635 Oct 29 01:23:11.576483 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 824/1632] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:11 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:12.293304 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-04c6ccfa-b5ab-491c-a26f-30fdf7d2ceab tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:12.293986 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-04c6ccfa-b5ab-491c-a26f-30fdf7d2ceab tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:12.300118 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-04c6ccfa-b5ab-491c-a26f-30fdf7d2ceab tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:12.301067 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-04c6ccfa-b5ab-491c-a26f-30fdf7d2ceab tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:12.301840 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-04c6ccfa-b5ab-491c-a26f-30fdf7d2ceab tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:12.302710 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-04c6ccfa-b5ab-491c-a26f-30fdf7d2ceab tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:12.342565 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-a065a7b7-2d9b-4420-a636-12694793f624 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:12.343510 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-a065a7b7-2d9b-4420-a636-12694793f624 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:12.349710 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a065a7b7-2d9b-4420-a636-12694793f624 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:12.350164 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a065a7b7-2d9b-4420-a636-12694793f624 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:12.350947 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a065a7b7-2d9b-4420-a636-12694793f624 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:12.351376 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a065a7b7-2d9b-4420-a636-12694793f624 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:12.381623 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-a065a7b7-2d9b-4420-a636-12694793f624 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042738 Oct 29 01:23:12.382194 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 825/1633] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:23:12 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:23:12.427380 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-04c6ccfa-b5ab-491c-a26f-30fdf7d2ceab tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:12.434613 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-04c6ccfa-b5ab-491c-a26f-30fdf7d2ceab tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.145221 Oct 29 01:23:12.435165 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 809/1634] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:12 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:12.593086 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-24190383-e2b6-4863-88cc-2043f6b83e6d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:12.593691 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-24190383-e2b6-4863-88cc-2043f6b83e6d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:12.600168 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-24190383-e2b6-4863-88cc-2043f6b83e6d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:12.600620 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-24190383-e2b6-4863-88cc-2043f6b83e6d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:12.601378 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-24190383-e2b6-4863-88cc-2043f6b83e6d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:12.601811 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-24190383-e2b6-4863-88cc-2043f6b83e6d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:12.662513 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-24190383-e2b6-4863-88cc-2043f6b83e6d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:12.670044 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-24190383-e2b6-4863-88cc-2043f6b83e6d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.080661 Oct 29 01:23:12.670662 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 826/1635] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:12 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:13.393441 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-0bc99628-f3d0-4f72-9fb6-dee224e07621 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:13.394363 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-0bc99628-f3d0-4f72-9fb6-dee224e07621 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:13.401081 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0bc99628-f3d0-4f72-9fb6-dee224e07621 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:13.401566 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0bc99628-f3d0-4f72-9fb6-dee224e07621 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:13.402484 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0bc99628-f3d0-4f72-9fb6-dee224e07621 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:13.403273 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0bc99628-f3d0-4f72-9fb6-dee224e07621 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:13.434852 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-0bc99628-f3d0-4f72-9fb6-dee224e07621 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045097 Oct 29 01:23:13.435440 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 810/1636] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:23:13 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:23:13.451928 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-9e5ee24b-708d-494b-9bc6-9c1179604d8d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:13.452546 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-9e5ee24b-708d-494b-9bc6-9c1179604d8d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:13.458917 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9e5ee24b-708d-494b-9bc6-9c1179604d8d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:13.459373 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9e5ee24b-708d-494b-9bc6-9c1179604d8d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:13.460150 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9e5ee24b-708d-494b-9bc6-9c1179604d8d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:13.460621 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9e5ee24b-708d-494b-9bc6-9c1179604d8d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:13.601756 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-9e5ee24b-708d-494b-9bc6-9c1179604d8d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:13.609811 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-9e5ee24b-708d-494b-9bc6-9c1179604d8d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.161400 Oct 29 01:23:13.610370 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 827/1637] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:13 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:13.687534 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-47b97930-2745-4a95-98d7-c60039d72e2b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:13.688090 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-47b97930-2745-4a95-98d7-c60039d72e2b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:13.694957 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-47b97930-2745-4a95-98d7-c60039d72e2b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:13.695612 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-47b97930-2745-4a95-98d7-c60039d72e2b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:13.696394 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-47b97930-2745-4a95-98d7-c60039d72e2b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:13.696823 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-47b97930-2745-4a95-98d7-c60039d72e2b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:13.768848 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-47b97930-2745-4a95-98d7-c60039d72e2b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:13.777197 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-47b97930-2745-4a95-98d7-c60039d72e2b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.093399 Oct 29 01:23:13.777785 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 811/1638] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:13 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:14.446987 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-bce4a080-175b-4e89-bedc-80ae6520de75 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:14.447908 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-bce4a080-175b-4e89-bedc-80ae6520de75 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:14.453798 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bce4a080-175b-4e89-bedc-80ae6520de75 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:14.454410 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bce4a080-175b-4e89-bedc-80ae6520de75 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:14.455105 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bce4a080-175b-4e89-bedc-80ae6520de75 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:14.455541 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bce4a080-175b-4e89-bedc-80ae6520de75 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:14.484870 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-bce4a080-175b-4e89-bedc-80ae6520de75 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041624 Oct 29 01:23:14.485441 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 828/1639] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:23:14 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:23:14.627254 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ead19f25-0c65-422c-8b1a-91a7aad0edc6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:14.627857 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ead19f25-0c65-422c-8b1a-91a7aad0edc6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:14.634747 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ead19f25-0c65-422c-8b1a-91a7aad0edc6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:14.635189 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ead19f25-0c65-422c-8b1a-91a7aad0edc6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:14.635942 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ead19f25-0c65-422c-8b1a-91a7aad0edc6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:14.636369 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ead19f25-0c65-422c-8b1a-91a7aad0edc6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:14.761634 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-ead19f25-0c65-422c-8b1a-91a7aad0edc6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:14.769056 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ead19f25-0c65-422c-8b1a-91a7aad0edc6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.145501 Oct 29 01:23:14.769839 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 812/1640] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:14 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:14.795074 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-a893d0e0-c039-4fcf-ad2b-6d895fabfda0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:14.795707 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-a893d0e0-c039-4fcf-ad2b-6d895fabfda0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:14.802686 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a893d0e0-c039-4fcf-ad2b-6d895fabfda0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:14.803135 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a893d0e0-c039-4fcf-ad2b-6d895fabfda0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:14.803905 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a893d0e0-c039-4fcf-ad2b-6d895fabfda0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:14.804340 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a893d0e0-c039-4fcf-ad2b-6d895fabfda0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:14.864965 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-a893d0e0-c039-4fcf-ad2b-6d895fabfda0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:14.872493 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-a893d0e0-c039-4fcf-ad2b-6d895fabfda0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.081029 Oct 29 01:23:14.873070 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 829/1641] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:14 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:15.497022 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-05fbcf50-d611-47f6-b0e9-4733c8ede401 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:23:15.497935 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-05fbcf50-d611-47f6-b0e9-4733c8ede401 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:15.503829 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-05fbcf50-d611-47f6-b0e9-4733c8ede401 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:15.504325 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-05fbcf50-d611-47f6-b0e9-4733c8ede401 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:15.505031 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-05fbcf50-d611-47f6-b0e9-4733c8ede401 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:15.505489 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-05fbcf50-d611-47f6-b0e9-4733c8ede401 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:15.616596 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-05fbcf50-d611-47f6-b0e9-4733c8ede401 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "POST /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/action" status: 200 len: 90807 microversion: 2.1 time: 0.123063 Oct 29 01:23:15.618285 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 813/1642] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:23:15 2021] POST /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9/action => generated 90807 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:23:15.785317 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d51b462c-c490-431f-adb0-c9ef7d6ee6f1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:15.785880 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d51b462c-c490-431f-adb0-c9ef7d6ee6f1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:15.792374 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d51b462c-c490-431f-adb0-c9ef7d6ee6f1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:15.792820 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d51b462c-c490-431f-adb0-c9ef7d6ee6f1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:15.793603 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d51b462c-c490-431f-adb0-c9ef7d6ee6f1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:15.794036 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d51b462c-c490-431f-adb0-c9ef7d6ee6f1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:15.889299 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-bd26ac50-ad09-4818-b2a5-399cd4d1e44f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:15.889995 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-bd26ac50-ad09-4818-b2a5-399cd4d1e44f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:15.897410 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bd26ac50-ad09-4818-b2a5-399cd4d1e44f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:15.897863 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bd26ac50-ad09-4818-b2a5-399cd4d1e44f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:15.898682 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bd26ac50-ad09-4818-b2a5-399cd4d1e44f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:15.899116 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bd26ac50-ad09-4818-b2a5-399cd4d1e44f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:15.923179 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-d51b462c-c490-431f-adb0-c9ef7d6ee6f1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:15.931682 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d51b462c-c490-431f-adb0-c9ef7d6ee6f1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.150127 Oct 29 01:23:15.932271 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 830/1643] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:15 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:15.968836 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-bd26ac50-ad09-4818-b2a5-399cd4d1e44f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:15.976517 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-bd26ac50-ad09-4818-b2a5-399cd4d1e44f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.091137 Oct 29 01:23:15.977096 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 814/1644] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:15 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:16.949182 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-de7ba6c0-b1c6-4f5b-9373-a0e0593c79c3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:16.949857 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-de7ba6c0-b1c6-4f5b-9373-a0e0593c79c3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:16.957050 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-de7ba6c0-b1c6-4f5b-9373-a0e0593c79c3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:16.958181 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-de7ba6c0-b1c6-4f5b-9373-a0e0593c79c3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:16.959536 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-de7ba6c0-b1c6-4f5b-9373-a0e0593c79c3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:16.960095 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-de7ba6c0-b1c6-4f5b-9373-a0e0593c79c3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:16.995674 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9f3dd345-f60d-4521-8aa4-8521b1b5ceb1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:16.996268 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9f3dd345-f60d-4521-8aa4-8521b1b5ceb1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:17.002736 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9f3dd345-f60d-4521-8aa4-8521b1b5ceb1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:17.003199 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9f3dd345-f60d-4521-8aa4-8521b1b5ceb1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:17.004004 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9f3dd345-f60d-4521-8aa4-8521b1b5ceb1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:17.004935 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9f3dd345-f60d-4521-8aa4-8521b1b5ceb1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:17.088827 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-9f3dd345-f60d-4521-8aa4-8521b1b5ceb1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:17.096476 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9f3dd345-f60d-4521-8aa4-8521b1b5ceb1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.104360 Oct 29 01:23:17.097358 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 815/1645] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:16 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:17.115160 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-de7ba6c0-b1c6-4f5b-9373-a0e0593c79c3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:17.123014 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-de7ba6c0-b1c6-4f5b-9373-a0e0593c79c3 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.177583 Oct 29 01:23:17.123596 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 831/1646] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:16 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:18.114034 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-1e670878-8087-4cd3-9dfd-2d4182b32fa6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:18.114687 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-1e670878-8087-4cd3-9dfd-2d4182b32fa6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:18.120997 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1e670878-8087-4cd3-9dfd-2d4182b32fa6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:18.121435 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1e670878-8087-4cd3-9dfd-2d4182b32fa6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:18.122202 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1e670878-8087-4cd3-9dfd-2d4182b32fa6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:18.122665 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1e670878-8087-4cd3-9dfd-2d4182b32fa6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:18.139828 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f8748476-3311-451a-af27-e0f923ccb48e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:18.140656 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f8748476-3311-451a-af27-e0f923ccb48e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:18.147033 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f8748476-3311-451a-af27-e0f923ccb48e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:18.147474 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f8748476-3311-451a-af27-e0f923ccb48e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:18.148249 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f8748476-3311-451a-af27-e0f923ccb48e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:18.148763 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f8748476-3311-451a-af27-e0f923ccb48e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:18.190187 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-1e670878-8087-4cd3-9dfd-2d4182b32fa6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:18.198922 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-1e670878-8087-4cd3-9dfd-2d4182b32fa6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.088975 Oct 29 01:23:18.199428 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 816/1647] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:18 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:18.283926 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-f8748476-3311-451a-af27-e0f923ccb48e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:18.291264 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f8748476-3311-451a-af27-e0f923ccb48e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.155043 Oct 29 01:23:18.291827 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 832/1648] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:18 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:19.215684 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-891137ec-dfcf-4e35-96fe-cc23272c5da7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:19.216214 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-891137ec-dfcf-4e35-96fe-cc23272c5da7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:19.222547 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-891137ec-dfcf-4e35-96fe-cc23272c5da7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:19.223546 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-891137ec-dfcf-4e35-96fe-cc23272c5da7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:19.224322 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-891137ec-dfcf-4e35-96fe-cc23272c5da7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:19.224770 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-891137ec-dfcf-4e35-96fe-cc23272c5da7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:19.284512 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-891137ec-dfcf-4e35-96fe-cc23272c5da7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:19.292112 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-891137ec-dfcf-4e35-96fe-cc23272c5da7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.080453 Oct 29 01:23:19.292704 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 817/1649] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:19 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:19.310689 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-7a760863-386c-4622-9657-02853dfb1115 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:19.311788 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-7a760863-386c-4622-9657-02853dfb1115 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:19.320045 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7a760863-386c-4622-9657-02853dfb1115 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:19.320494 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7a760863-386c-4622-9657-02853dfb1115 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:19.321278 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7a760863-386c-4622-9657-02853dfb1115 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:19.321712 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7a760863-386c-4622-9657-02853dfb1115 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:19.462898 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-7a760863-386c-4622-9657-02853dfb1115 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:19.470830 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-7a760863-386c-4622-9657-02853dfb1115 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.166183 Oct 29 01:23:19.471679 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 833/1650] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:19 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:20.308037 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-62db514b-50f5-4678-9b0a-dbd7eb524874 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:20.308594 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-62db514b-50f5-4678-9b0a-dbd7eb524874 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:20.317220 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-62db514b-50f5-4678-9b0a-dbd7eb524874 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:20.317665 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-62db514b-50f5-4678-9b0a-dbd7eb524874 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:20.318455 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-62db514b-50f5-4678-9b0a-dbd7eb524874 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:20.318883 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-62db514b-50f5-4678-9b0a-dbd7eb524874 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:20.386436 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-62db514b-50f5-4678-9b0a-dbd7eb524874 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:20.393768 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-62db514b-50f5-4678-9b0a-dbd7eb524874 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.089526 Oct 29 01:23:20.394329 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 818/1651] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:20 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:20.489112 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-1641ac0a-a5c1-46ac-b388-286ef052a106 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:20.489718 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-1641ac0a-a5c1-46ac-b388-286ef052a106 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:20.495858 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1641ac0a-a5c1-46ac-b388-286ef052a106 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:20.496301 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1641ac0a-a5c1-46ac-b388-286ef052a106 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:20.497049 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1641ac0a-a5c1-46ac-b388-286ef052a106 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:20.497480 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1641ac0a-a5c1-46ac-b388-286ef052a106 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:20.619072 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-1641ac0a-a5c1-46ac-b388-286ef052a106 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:20.626700 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-1641ac0a-a5c1-46ac-b388-286ef052a106 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.141715 Oct 29 01:23:20.627277 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 834/1652] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:20 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:21.410024 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-6fd50fa2-3cbf-4594-9f63-c6f459fb388b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:21.411601 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-6fd50fa2-3cbf-4594-9f63-c6f459fb388b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:21.417803 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6fd50fa2-3cbf-4594-9f63-c6f459fb388b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:21.418243 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6fd50fa2-3cbf-4594-9f63-c6f459fb388b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:21.419031 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6fd50fa2-3cbf-4594-9f63-c6f459fb388b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:21.419478 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6fd50fa2-3cbf-4594-9f63-c6f459fb388b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:21.482008 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-6fd50fa2-3cbf-4594-9f63-c6f459fb388b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:21.489807 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-6fd50fa2-3cbf-4594-9f63-c6f459fb388b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.083347 Oct 29 01:23:21.490430 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 819/1653] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:21 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:21.644504 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-edd0fd95-8be7-4af3-8504-b3ca88966579 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:21.645721 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-edd0fd95-8be7-4af3-8504-b3ca88966579 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:21.652117 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-edd0fd95-8be7-4af3-8504-b3ca88966579 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:21.652570 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-edd0fd95-8be7-4af3-8504-b3ca88966579 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:21.653355 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-edd0fd95-8be7-4af3-8504-b3ca88966579 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:21.653790 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-edd0fd95-8be7-4af3-8504-b3ca88966579 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:21.778275 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-edd0fd95-8be7-4af3-8504-b3ca88966579 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:21.785792 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-edd0fd95-8be7-4af3-8504-b3ca88966579 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.144990 Oct 29 01:23:21.786363 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 835/1654] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:21 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:22.505843 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-3c8771a1-1f60-4146-a130-64f40835bba5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:22.506495 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-3c8771a1-1f60-4146-a130-64f40835bba5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:22.512620 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3c8771a1-1f60-4146-a130-64f40835bba5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:22.513061 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3c8771a1-1f60-4146-a130-64f40835bba5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:22.513811 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3c8771a1-1f60-4146-a130-64f40835bba5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:22.514236 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3c8771a1-1f60-4146-a130-64f40835bba5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:22.575943 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-3c8771a1-1f60-4146-a130-64f40835bba5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:22.583377 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-3c8771a1-1f60-4146-a130-64f40835bba5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.081073 Oct 29 01:23:22.583839 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 820/1655] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:22 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:22.802877 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c58abd11-93bf-4037-af04-1e6fe4b5834c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:22.803464 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c58abd11-93bf-4037-af04-1e6fe4b5834c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:22.809592 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c58abd11-93bf-4037-af04-1e6fe4b5834c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:22.810032 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c58abd11-93bf-4037-af04-1e6fe4b5834c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:22.810823 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c58abd11-93bf-4037-af04-1e6fe4b5834c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:22.811247 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c58abd11-93bf-4037-af04-1e6fe4b5834c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:22.936792 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-c58abd11-93bf-4037-af04-1e6fe4b5834c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:22.944308 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c58abd11-93bf-4037-af04-1e6fe4b5834c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.145235 Oct 29 01:23:22.944878 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 836/1656] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:22 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:23.600645 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-00acecc9-1b1c-48cb-89bf-5a483d52a307 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:23.601246 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-00acecc9-1b1c-48cb-89bf-5a483d52a307 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:23.607815 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-00acecc9-1b1c-48cb-89bf-5a483d52a307 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:23.608263 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-00acecc9-1b1c-48cb-89bf-5a483d52a307 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:23.609030 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-00acecc9-1b1c-48cb-89bf-5a483d52a307 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:23.609463 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-00acecc9-1b1c-48cb-89bf-5a483d52a307 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:23.670160 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-00acecc9-1b1c-48cb-89bf-5a483d52a307 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:23.677746 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-00acecc9-1b1c-48cb-89bf-5a483d52a307 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.081320 Oct 29 01:23:23.678307 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 821/1657] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:23 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:23.961371 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2367cf0d-5269-4a57-8ef4-e47992901ae2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:23.962280 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2367cf0d-5269-4a57-8ef4-e47992901ae2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:23.968897 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2367cf0d-5269-4a57-8ef4-e47992901ae2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:23.969344 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2367cf0d-5269-4a57-8ef4-e47992901ae2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:23.970121 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2367cf0d-5269-4a57-8ef4-e47992901ae2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:23.970591 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2367cf0d-5269-4a57-8ef4-e47992901ae2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:24.097326 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-2367cf0d-5269-4a57-8ef4-e47992901ae2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:24.104848 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2367cf0d-5269-4a57-8ef4-e47992901ae2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.147690 Oct 29 01:23:24.105421 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 837/1658] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:23 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:24.694253 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-2d2c70a9-57d9-43b0-ad70-7e9297417f10 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:24.694880 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-2d2c70a9-57d9-43b0-ad70-7e9297417f10 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:24.701066 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2d2c70a9-57d9-43b0-ad70-7e9297417f10 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:24.701518 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2d2c70a9-57d9-43b0-ad70-7e9297417f10 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:24.702293 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2d2c70a9-57d9-43b0-ad70-7e9297417f10 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:24.702757 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2d2c70a9-57d9-43b0-ad70-7e9297417f10 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:24.770304 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-2d2c70a9-57d9-43b0-ad70-7e9297417f10 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:24.778878 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-2d2c70a9-57d9-43b0-ad70-7e9297417f10 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.088371 Oct 29 01:23:24.779463 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 822/1659] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:24 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:24.997460 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-0f9a92ed-8f82-4e53-91d6-c302ec7b69ae tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:24.998009 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-0f9a92ed-8f82-4e53-91d6-c302ec7b69ae tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:25.001505 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [req-50451188-2d7c-4f1a-ac96-ee54e5b6e4af req-7747bea2-8997-4182-9ada-62be95d2524a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd", "tag": "8d56de6a-a409-4dde-8299-b4d26a45fc41"}]} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:23:25.003533 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:23:25.003533 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: warnings.warn(msg) Oct 29 01:23:25.004709 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0f9a92ed-8f82-4e53-91d6-c302ec7b69ae tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:25.005155 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0f9a92ed-8f82-4e53-91d6-c302ec7b69ae tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:25.005933 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0f9a92ed-8f82-4e53-91d6-c302ec7b69ae tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:25.006362 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0f9a92ed-8f82-4e53-91d6-c302ec7b69ae tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:25.011094 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-50451188-2d7c-4f1a-ac96-ee54e5b6e4af req-7747bea2-8997-4182-9ada-62be95d2524a service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:25.011613 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-50451188-2d7c-4f1a-ac96-ee54e5b6e4af req-7747bea2-8997-4182-9ada-62be95d2524a service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:25.024362 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.compute.server_external_events [req-50451188-2d7c-4f1a-ac96-ee54e5b6e4af req-7747bea2-8997-4182-9ada-62be95d2524a service nova] Creating event network-changed:8d56de6a-a409-4dde-8299-b4d26a45fc41 for instance efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd on hv-cinder-81558 Oct 29 01:23:25.029871 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [req-50451188-2d7c-4f1a-ac96-ee54e5b6e4af req-7747bea2-8997-4182-9ada-62be95d2524a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032058 Oct 29 01:23:25.031108 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 823/1660] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:23:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:23:25.032850 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-0f9a92ed-8f82-4e53-91d6-c302ec7b69ae tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Going to try to terminate instance {{(pid=115748) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 01:23:25.120823 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-0f9a92ed-8f82-4e53-91d6-c302ec7b69ae tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "DELETE /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 204 len: 0 microversion: 2.1 time: 0.126620 Oct 29 01:23:25.121961 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 838/1661] 10.222.0.90 () {58 vars in 1238 bytes} [Fri Oct 29 01:23:24 2021] DELETE /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:23:25.130968 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a0f4ab6a-21dc-4b3c-ba71-2b84fba6d5ec tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:25.131603 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a0f4ab6a-21dc-4b3c-ba71-2b84fba6d5ec tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:25.138208 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a0f4ab6a-21dc-4b3c-ba71-2b84fba6d5ec tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:25.138701 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a0f4ab6a-21dc-4b3c-ba71-2b84fba6d5ec tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:25.139483 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a0f4ab6a-21dc-4b3c-ba71-2b84fba6d5ec tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:25.139918 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a0f4ab6a-21dc-4b3c-ba71-2b84fba6d5ec tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:25.274221 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-a0f4ab6a-21dc-4b3c-ba71-2b84fba6d5ec tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:25.282337 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a0f4ab6a-21dc-4b3c-ba71-2b84fba6d5ec tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1568 microversion: 2.1 time: 0.156228 Oct 29 01:23:25.283541 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 824/1662] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:25 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:25.796437 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-20f7c726-8c43-4f86-b85e-585cefe8372d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:25.797043 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-20f7c726-8c43-4f86-b85e-585cefe8372d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:25.803387 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-20f7c726-8c43-4f86-b85e-585cefe8372d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:25.803836 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-20f7c726-8c43-4f86-b85e-585cefe8372d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:25.804645 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-20f7c726-8c43-4f86-b85e-585cefe8372d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:25.805083 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-20f7c726-8c43-4f86-b85e-585cefe8372d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:25.866980 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-20f7c726-8c43-4f86-b85e-585cefe8372d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:25.874467 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-20f7c726-8c43-4f86-b85e-585cefe8372d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.082218 Oct 29 01:23:25.875228 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 839/1663] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:25 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:26.300420 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c9d945c6-addf-4fe9-8eb7-764a0ab65327 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:26.301142 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c9d945c6-addf-4fe9-8eb7-764a0ab65327 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:26.307909 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c9d945c6-addf-4fe9-8eb7-764a0ab65327 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:26.308357 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c9d945c6-addf-4fe9-8eb7-764a0ab65327 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:26.309119 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c9d945c6-addf-4fe9-8eb7-764a0ab65327 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:26.309553 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c9d945c6-addf-4fe9-8eb7-764a0ab65327 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:26.433736 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c9d945c6-addf-4fe9-8eb7-764a0ab65327 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:26.441185 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c9d945c6-addf-4fe9-8eb7-764a0ab65327 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.144497 Oct 29 01:23:26.441749 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 825/1664] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:26 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:26.892862 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-1aa3e862-0678-41cd-a338-2f0ed2f63428 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:26.893499 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-1aa3e862-0678-41cd-a338-2f0ed2f63428 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:26.900323 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1aa3e862-0678-41cd-a338-2f0ed2f63428 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:26.900772 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1aa3e862-0678-41cd-a338-2f0ed2f63428 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:26.901533 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1aa3e862-0678-41cd-a338-2f0ed2f63428 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:26.901966 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1aa3e862-0678-41cd-a338-2f0ed2f63428 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:26.960794 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-1aa3e862-0678-41cd-a338-2f0ed2f63428 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:26.968507 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-1aa3e862-0678-41cd-a338-2f0ed2f63428 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.079333 Oct 29 01:23:26.969071 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 840/1665] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:26 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:27.463078 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-4a556e4e-334a-42d8-88b6-0573baa543eb tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:27.463685 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-4a556e4e-334a-42d8-88b6-0573baa543eb tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:27.470330 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4a556e4e-334a-42d8-88b6-0573baa543eb tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:27.470809 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4a556e4e-334a-42d8-88b6-0573baa543eb tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:27.471588 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4a556e4e-334a-42d8-88b6-0573baa543eb tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:27.472012 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4a556e4e-334a-42d8-88b6-0573baa543eb tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:27.596060 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-4a556e4e-334a-42d8-88b6-0573baa543eb tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:27.603654 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-4a556e4e-334a-42d8-88b6-0573baa543eb tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.144581 Oct 29 01:23:27.604213 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 826/1666] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:27 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:27.984840 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-a58a0840-a26e-446c-a196-abdab42e635c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:27.985492 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-a58a0840-a26e-446c-a196-abdab42e635c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:27.992392 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a58a0840-a26e-446c-a196-abdab42e635c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:27.992848 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a58a0840-a26e-446c-a196-abdab42e635c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:27.993618 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a58a0840-a26e-446c-a196-abdab42e635c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:27.994081 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a58a0840-a26e-446c-a196-abdab42e635c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:28.053503 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-a58a0840-a26e-446c-a196-abdab42e635c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:28.063200 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-a58a0840-a26e-446c-a196-abdab42e635c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.082036 Oct 29 01:23:28.063776 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 841/1667] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:27 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:28.620283 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-950fe298-9f4d-4820-b03b-2aa0450aca43 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:28.620918 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-950fe298-9f4d-4820-b03b-2aa0450aca43 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:28.627248 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-950fe298-9f4d-4820-b03b-2aa0450aca43 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:28.627731 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-950fe298-9f4d-4820-b03b-2aa0450aca43 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:28.628514 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-950fe298-9f4d-4820-b03b-2aa0450aca43 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:28.628946 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-950fe298-9f4d-4820-b03b-2aa0450aca43 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:28.759087 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-950fe298-9f4d-4820-b03b-2aa0450aca43 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:28.766317 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-950fe298-9f4d-4820-b03b-2aa0450aca43 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.149733 Oct 29 01:23:28.766899 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 827/1668] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:28 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:29.079725 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-3ef513cf-0b04-4646-a7e0-19dc7fb1df09 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:29.080333 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-3ef513cf-0b04-4646-a7e0-19dc7fb1df09 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:29.087583 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3ef513cf-0b04-4646-a7e0-19dc7fb1df09 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:29.088029 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3ef513cf-0b04-4646-a7e0-19dc7fb1df09 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:29.088790 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3ef513cf-0b04-4646-a7e0-19dc7fb1df09 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:29.089222 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3ef513cf-0b04-4646-a7e0-19dc7fb1df09 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:29.148753 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-3ef513cf-0b04-4646-a7e0-19dc7fb1df09 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:29.156120 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-3ef513cf-0b04-4646-a7e0-19dc7fb1df09 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.080072 Oct 29 01:23:29.156692 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 842/1669] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:29 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:29.783788 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9ed4968b-1995-4b24-acc4-271150f845af tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:29.784370 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9ed4968b-1995-4b24-acc4-271150f845af tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:29.791249 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9ed4968b-1995-4b24-acc4-271150f845af tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:29.791697 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9ed4968b-1995-4b24-acc4-271150f845af tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:29.792486 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9ed4968b-1995-4b24-acc4-271150f845af tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:29.792920 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9ed4968b-1995-4b24-acc4-271150f845af tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:29.917951 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-9ed4968b-1995-4b24-acc4-271150f845af tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:29.925388 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9ed4968b-1995-4b24-acc4-271150f845af tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.145268 Oct 29 01:23:29.926955 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 828/1670] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:29 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:30.172846 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2008cd78-2d67-4a0b-bda0-00547dc9cd2a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:30.173476 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2008cd78-2d67-4a0b-bda0-00547dc9cd2a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:30.179952 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2008cd78-2d67-4a0b-bda0-00547dc9cd2a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:30.180393 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2008cd78-2d67-4a0b-bda0-00547dc9cd2a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:30.181152 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2008cd78-2d67-4a0b-bda0-00547dc9cd2a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:30.181579 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2008cd78-2d67-4a0b-bda0-00547dc9cd2a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:30.247335 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-2008cd78-2d67-4a0b-bda0-00547dc9cd2a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:30.254876 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2008cd78-2d67-4a0b-bda0-00547dc9cd2a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.085599 Oct 29 01:23:30.255452 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 843/1671] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:30 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:30.945878 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d759c28b-2e67-47c7-b832-9e818d1094be tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:30.946557 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d759c28b-2e67-47c7-b832-9e818d1094be tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:30.952926 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d759c28b-2e67-47c7-b832-9e818d1094be tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:30.953379 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d759c28b-2e67-47c7-b832-9e818d1094be tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:30.954186 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d759c28b-2e67-47c7-b832-9e818d1094be tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:30.954674 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d759c28b-2e67-47c7-b832-9e818d1094be tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:31.076181 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-d759c28b-2e67-47c7-b832-9e818d1094be tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:31.083585 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d759c28b-2e67-47c7-b832-9e818d1094be tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.141481 Oct 29 01:23:31.084170 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 829/1672] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:30 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:31.271990 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-1cfeeb1d-dbbc-4c48-8c54-8b7915d61a89 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:31.272544 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-1cfeeb1d-dbbc-4c48-8c54-8b7915d61a89 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:31.278705 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1cfeeb1d-dbbc-4c48-8c54-8b7915d61a89 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:31.279152 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1cfeeb1d-dbbc-4c48-8c54-8b7915d61a89 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:31.279919 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1cfeeb1d-dbbc-4c48-8c54-8b7915d61a89 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:31.280349 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1cfeeb1d-dbbc-4c48-8c54-8b7915d61a89 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:31.342813 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-1cfeeb1d-dbbc-4c48-8c54-8b7915d61a89 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:31.350838 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-1cfeeb1d-dbbc-4c48-8c54-8b7915d61a89 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.082631 Oct 29 01:23:31.351411 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 844/1673] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:31 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:32.100610 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d638a368-29ca-49a9-9523-7c51de9c10a9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:32.101270 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d638a368-29ca-49a9-9523-7c51de9c10a9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:32.108440 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d638a368-29ca-49a9-9523-7c51de9c10a9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:32.108889 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d638a368-29ca-49a9-9523-7c51de9c10a9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:32.109656 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d638a368-29ca-49a9-9523-7c51de9c10a9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:32.110080 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d638a368-29ca-49a9-9523-7c51de9c10a9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:32.234158 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-d638a368-29ca-49a9-9523-7c51de9c10a9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:32.242243 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d638a368-29ca-49a9-9523-7c51de9c10a9 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.145340 Oct 29 01:23:32.242854 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 830/1674] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:32 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:32.367566 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c8e508da-a72d-44d8-aef1-08e4aba4fe5a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:32.368178 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c8e508da-a72d-44d8-aef1-08e4aba4fe5a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:32.374499 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c8e508da-a72d-44d8-aef1-08e4aba4fe5a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:32.374961 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c8e508da-a72d-44d8-aef1-08e4aba4fe5a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:32.375732 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c8e508da-a72d-44d8-aef1-08e4aba4fe5a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:32.376168 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c8e508da-a72d-44d8-aef1-08e4aba4fe5a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:32.439207 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-c8e508da-a72d-44d8-aef1-08e4aba4fe5a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:32.446829 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c8e508da-a72d-44d8-aef1-08e4aba4fe5a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.083588 Oct 29 01:23:32.447402 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 845/1675] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:32 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:33.258768 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-95df6635-099a-43a7-956d-41ec416b440b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:33.259316 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-95df6635-099a-43a7-956d-41ec416b440b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:33.265550 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-95df6635-099a-43a7-956d-41ec416b440b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:33.265995 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-95df6635-099a-43a7-956d-41ec416b440b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:33.266784 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-95df6635-099a-43a7-956d-41ec416b440b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:33.267218 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-95df6635-099a-43a7-956d-41ec416b440b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:33.388268 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-95df6635-099a-43a7-956d-41ec416b440b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:33.396134 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-95df6635-099a-43a7-956d-41ec416b440b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.141121 Oct 29 01:23:33.396693 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 831/1676] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:33 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:33.463508 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-79c461f6-e63a-4f29-be1e-738e83094db4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:33.464108 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-79c461f6-e63a-4f29-be1e-738e83094db4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:33.470323 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-79c461f6-e63a-4f29-be1e-738e83094db4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:33.470800 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-79c461f6-e63a-4f29-be1e-738e83094db4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:33.471592 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-79c461f6-e63a-4f29-be1e-738e83094db4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:33.472063 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-79c461f6-e63a-4f29-be1e-738e83094db4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:33.531353 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-79c461f6-e63a-4f29-be1e-738e83094db4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:33.539216 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-79c461f6-e63a-4f29-be1e-738e83094db4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.079640 Oct 29 01:23:33.539776 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 846/1677] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:33 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:34.413108 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f402318a-5a5a-4923-a1fc-ce963857ac64 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:34.413718 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f402318a-5a5a-4923-a1fc-ce963857ac64 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:34.419999 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f402318a-5a5a-4923-a1fc-ce963857ac64 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:34.420448 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f402318a-5a5a-4923-a1fc-ce963857ac64 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:34.421215 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f402318a-5a5a-4923-a1fc-ce963857ac64 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:34.421647 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f402318a-5a5a-4923-a1fc-ce963857ac64 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:34.545630 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-f402318a-5a5a-4923-a1fc-ce963857ac64 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:34.553697 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f402318a-5a5a-4923-a1fc-ce963857ac64 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.144472 Oct 29 01:23:34.554277 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 832/1678] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:34 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:34.555625 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-34f9bc7c-a2d9-483c-be65-9071322cadc2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:34.556241 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-34f9bc7c-a2d9-483c-be65-9071322cadc2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:34.562382 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-34f9bc7c-a2d9-483c-be65-9071322cadc2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:34.562859 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-34f9bc7c-a2d9-483c-be65-9071322cadc2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:34.563625 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-34f9bc7c-a2d9-483c-be65-9071322cadc2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:34.564054 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-34f9bc7c-a2d9-483c-be65-9071322cadc2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:34.624180 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-34f9bc7c-a2d9-483c-be65-9071322cadc2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:34.632071 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-34f9bc7c-a2d9-483c-be65-9071322cadc2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.080162 Oct 29 01:23:34.632637 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 847/1679] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:34 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:35.570660 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c7de39dd-f707-44b0-bcbb-8fd8538913b8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:35.571363 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c7de39dd-f707-44b0-bcbb-8fd8538913b8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:35.577588 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c7de39dd-f707-44b0-bcbb-8fd8538913b8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:35.578034 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c7de39dd-f707-44b0-bcbb-8fd8538913b8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:35.578830 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c7de39dd-f707-44b0-bcbb-8fd8538913b8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:35.579261 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c7de39dd-f707-44b0-bcbb-8fd8538913b8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:35.648331 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e327dfc0-d069-4c55-97a4-6f7ff39287d9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:35.648968 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-e327dfc0-d069-4c55-97a4-6f7ff39287d9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:35.655188 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e327dfc0-d069-4c55-97a4-6f7ff39287d9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:35.655632 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e327dfc0-d069-4c55-97a4-6f7ff39287d9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:35.656399 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e327dfc0-d069-4c55-97a4-6f7ff39287d9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:35.656827 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e327dfc0-d069-4c55-97a4-6f7ff39287d9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:35.714564 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c7de39dd-f707-44b0-bcbb-8fd8538913b8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:35.723568 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c7de39dd-f707-44b0-bcbb-8fd8538913b8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.156463 Oct 29 01:23:35.724702 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 833/1680] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:35 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:35.729016 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-e327dfc0-d069-4c55-97a4-6f7ff39287d9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:35.736634 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-e327dfc0-d069-4c55-97a4-6f7ff39287d9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.092540 Oct 29 01:23:35.737189 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 848/1681] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:35 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:36.741877 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ccf5bd4f-7495-41e9-9bce-74d897907b3e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:36.742668 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ccf5bd4f-7495-41e9-9bce-74d897907b3e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:36.748922 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ccf5bd4f-7495-41e9-9bce-74d897907b3e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:36.749377 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ccf5bd4f-7495-41e9-9bce-74d897907b3e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:36.750155 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ccf5bd4f-7495-41e9-9bce-74d897907b3e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:36.750624 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ccf5bd4f-7495-41e9-9bce-74d897907b3e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:36.752847 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-ae8dbf98-b817-46df-9f92-0ff333d3877c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:36.753615 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-ae8dbf98-b817-46df-9f92-0ff333d3877c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:36.759782 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ae8dbf98-b817-46df-9f92-0ff333d3877c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:36.760234 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ae8dbf98-b817-46df-9f92-0ff333d3877c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:36.761056 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ae8dbf98-b817-46df-9f92-0ff333d3877c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:36.761482 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ae8dbf98-b817-46df-9f92-0ff333d3877c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:36.842143 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-ae8dbf98-b817-46df-9f92-0ff333d3877c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:36.850612 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-ae8dbf98-b817-46df-9f92-0ff333d3877c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.101328 Oct 29 01:23:36.851209 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 849/1682] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:36 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:36.905360 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-ccf5bd4f-7495-41e9-9bce-74d897907b3e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:36.914116 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ccf5bd4f-7495-41e9-9bce-74d897907b3e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.176688 Oct 29 01:23:36.914795 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 834/1683] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:36 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:37.873346 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f74cf74e-a03e-4836-9680-c43e89db215f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:37.873949 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f74cf74e-a03e-4836-9680-c43e89db215f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:37.880660 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f74cf74e-a03e-4836-9680-c43e89db215f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:37.881108 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f74cf74e-a03e-4836-9680-c43e89db215f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:37.881981 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f74cf74e-a03e-4836-9680-c43e89db215f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:37.882452 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f74cf74e-a03e-4836-9680-c43e89db215f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:37.931283 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-01bbf153-6bc5-4e02-b528-f0cabc6b932b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:37.931889 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-01bbf153-6bc5-4e02-b528-f0cabc6b932b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:37.938292 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-01bbf153-6bc5-4e02-b528-f0cabc6b932b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:37.938709 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-01bbf153-6bc5-4e02-b528-f0cabc6b932b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:37.939479 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-01bbf153-6bc5-4e02-b528-f0cabc6b932b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:37.939917 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-01bbf153-6bc5-4e02-b528-f0cabc6b932b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:37.944692 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-f74cf74e-a03e-4836-9680-c43e89db215f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:37.952033 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f74cf74e-a03e-4836-9680-c43e89db215f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.082339 Oct 29 01:23:37.952816 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 850/1684] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:37 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:38.071403 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-01bbf153-6bc5-4e02-b528-f0cabc6b932b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:38.078857 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-01bbf153-6bc5-4e02-b528-f0cabc6b932b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.151188 Oct 29 01:23:38.079433 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 835/1685] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:37 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:38.969277 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-3b5cfdfc-4519-4720-b7d6-23449af50073 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:38.969923 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-3b5cfdfc-4519-4720-b7d6-23449af50073 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:38.977044 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3b5cfdfc-4519-4720-b7d6-23449af50073 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:38.977490 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3b5cfdfc-4519-4720-b7d6-23449af50073 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:38.978259 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3b5cfdfc-4519-4720-b7d6-23449af50073 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:38.978716 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3b5cfdfc-4519-4720-b7d6-23449af50073 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:39.039904 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-3b5cfdfc-4519-4720-b7d6-23449af50073 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:39.047434 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-3b5cfdfc-4519-4720-b7d6-23449af50073 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.081836 Oct 29 01:23:39.048002 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 851/1686] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:38 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:39.096974 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d7410db3-15ae-419d-8606-75adef806c59 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:39.098127 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d7410db3-15ae-419d-8606-75adef806c59 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:39.104940 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d7410db3-15ae-419d-8606-75adef806c59 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:39.105415 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d7410db3-15ae-419d-8606-75adef806c59 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:39.106188 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d7410db3-15ae-419d-8606-75adef806c59 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:39.106697 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d7410db3-15ae-419d-8606-75adef806c59 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:39.232101 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-d7410db3-15ae-419d-8606-75adef806c59 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:39.239636 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d7410db3-15ae-419d-8606-75adef806c59 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.146360 Oct 29 01:23:39.240208 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 836/1687] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:39 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:40.065148 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-b2c52aa3-1b2e-4c09-b8b3-e8fb50d1ca09 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:40.065747 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-b2c52aa3-1b2e-4c09-b8b3-e8fb50d1ca09 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:40.072484 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b2c52aa3-1b2e-4c09-b8b3-e8fb50d1ca09 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:40.072921 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b2c52aa3-1b2e-4c09-b8b3-e8fb50d1ca09 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:40.073676 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b2c52aa3-1b2e-4c09-b8b3-e8fb50d1ca09 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:40.074102 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b2c52aa3-1b2e-4c09-b8b3-e8fb50d1ca09 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:40.140895 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-b2c52aa3-1b2e-4c09-b8b3-e8fb50d1ca09 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:40.141125 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-b2c52aa3-1b2e-4c09-b8b3-e8fb50d1ca09 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.079732 Oct 29 01:23:40.141641 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 852/1688] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:40 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:40.321885 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a17f7045-5510-4cc9-b0ac-7a87930383da tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:40.322521 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a17f7045-5510-4cc9-b0ac-7a87930383da tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:40.328508 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a17f7045-5510-4cc9-b0ac-7a87930383da tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:40.328957 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a17f7045-5510-4cc9-b0ac-7a87930383da tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:40.329771 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a17f7045-5510-4cc9-b0ac-7a87930383da tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:40.330200 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a17f7045-5510-4cc9-b0ac-7a87930383da tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:40.453469 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-a17f7045-5510-4cc9-b0ac-7a87930383da tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:40.462049 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a17f7045-5510-4cc9-b0ac-7a87930383da tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.209012 Oct 29 01:23:40.462655 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 837/1689] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:40 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:41.158073 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-dae103a5-5b8a-4462-88b4-47354ad43ba3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:41.158847 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-dae103a5-5b8a-4462-88b4-47354ad43ba3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:41.165568 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dae103a5-5b8a-4462-88b4-47354ad43ba3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:41.166008 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dae103a5-5b8a-4462-88b4-47354ad43ba3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:41.166802 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dae103a5-5b8a-4462-88b4-47354ad43ba3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:41.167256 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dae103a5-5b8a-4462-88b4-47354ad43ba3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:41.229184 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-dae103a5-5b8a-4462-88b4-47354ad43ba3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:41.236683 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-dae103a5-5b8a-4462-88b4-47354ad43ba3 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.082236 Oct 29 01:23:41.237260 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 853/1690] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:41 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:41.480196 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-635b0a86-d3b9-4e3d-a83f-d4e1b41a3d43 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:41.480749 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-635b0a86-d3b9-4e3d-a83f-d4e1b41a3d43 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:41.487432 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-635b0a86-d3b9-4e3d-a83f-d4e1b41a3d43 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:41.487983 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-635b0a86-d3b9-4e3d-a83f-d4e1b41a3d43 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:41.489287 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-635b0a86-d3b9-4e3d-a83f-d4e1b41a3d43 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:41.489719 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-635b0a86-d3b9-4e3d-a83f-d4e1b41a3d43 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:41.613756 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-635b0a86-d3b9-4e3d-a83f-d4e1b41a3d43 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:41.621060 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-635b0a86-d3b9-4e3d-a83f-d4e1b41a3d43 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.144674 Oct 29 01:23:41.621621 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 838/1691] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:41 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:42.254792 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-dcaddf76-567a-48ba-8da2-a0da683bedc9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:42.255356 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-dcaddf76-567a-48ba-8da2-a0da683bedc9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:42.261693 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dcaddf76-567a-48ba-8da2-a0da683bedc9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:42.262131 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dcaddf76-567a-48ba-8da2-a0da683bedc9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:42.262926 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dcaddf76-567a-48ba-8da2-a0da683bedc9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:42.263354 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dcaddf76-567a-48ba-8da2-a0da683bedc9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:42.331473 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-dcaddf76-567a-48ba-8da2-a0da683bedc9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:42.340645 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-dcaddf76-567a-48ba-8da2-a0da683bedc9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.089934 Oct 29 01:23:42.341669 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 854/1692] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:42 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:42.637848 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b31b5813-054f-41d9-94ba-7635e7d1f729 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:42.638503 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b31b5813-054f-41d9-94ba-7635e7d1f729 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:42.646554 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b31b5813-054f-41d9-94ba-7635e7d1f729 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:42.647094 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b31b5813-054f-41d9-94ba-7635e7d1f729 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:42.648193 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b31b5813-054f-41d9-94ba-7635e7d1f729 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:42.648640 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b31b5813-054f-41d9-94ba-7635e7d1f729 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:42.782750 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-b31b5813-054f-41d9-94ba-7635e7d1f729 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:42.790990 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b31b5813-054f-41d9-94ba-7635e7d1f729 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.156843 Oct 29 01:23:42.791566 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 839/1693] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:42 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:43.358331 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-9486cbfd-21a3-42b1-84be-69ea8bcd289b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:43.358975 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-9486cbfd-21a3-42b1-84be-69ea8bcd289b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:43.365839 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9486cbfd-21a3-42b1-84be-69ea8bcd289b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:43.366282 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9486cbfd-21a3-42b1-84be-69ea8bcd289b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:43.367084 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9486cbfd-21a3-42b1-84be-69ea8bcd289b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:43.367509 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9486cbfd-21a3-42b1-84be-69ea8bcd289b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:43.427765 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-9486cbfd-21a3-42b1-84be-69ea8bcd289b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:43.435273 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-9486cbfd-21a3-42b1-84be-69ea8bcd289b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.080595 Oct 29 01:23:43.435838 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 855/1694] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:43 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:43.807564 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-89e6771d-4ff5-4af8-86f3-169b4db05957 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:43.808365 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-89e6771d-4ff5-4af8-86f3-169b4db05957 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:43.814697 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-89e6771d-4ff5-4af8-86f3-169b4db05957 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:43.815868 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-89e6771d-4ff5-4af8-86f3-169b4db05957 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:43.816146 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-89e6771d-4ff5-4af8-86f3-169b4db05957 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:43.816587 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-89e6771d-4ff5-4af8-86f3-169b4db05957 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:43.938765 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-89e6771d-4ff5-4af8-86f3-169b4db05957 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:43.947106 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-89e6771d-4ff5-4af8-86f3-169b4db05957 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.143129 Oct 29 01:23:43.947680 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 840/1695] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:43 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:44.451887 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-4072ba36-06b0-4e98-afa8-009ebe0d5aba tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:44.452492 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-4072ba36-06b0-4e98-afa8-009ebe0d5aba tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:44.458889 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4072ba36-06b0-4e98-afa8-009ebe0d5aba tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:44.459330 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4072ba36-06b0-4e98-afa8-009ebe0d5aba tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:44.460097 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4072ba36-06b0-4e98-afa8-009ebe0d5aba tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:44.460526 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4072ba36-06b0-4e98-afa8-009ebe0d5aba tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:44.523266 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-4072ba36-06b0-4e98-afa8-009ebe0d5aba tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:44.532664 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-4072ba36-06b0-4e98-afa8-009ebe0d5aba tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.084410 Oct 29 01:23:44.533237 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 856/1696] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:44 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:44.964869 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-2f4d3829-cce3-405e-a603-26eda2d08a8e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:44.964869 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-2f4d3829-cce3-405e-a603-26eda2d08a8e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:44.971387 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2f4d3829-cce3-405e-a603-26eda2d08a8e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:44.971927 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2f4d3829-cce3-405e-a603-26eda2d08a8e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:44.972618 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2f4d3829-cce3-405e-a603-26eda2d08a8e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:44.973050 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2f4d3829-cce3-405e-a603-26eda2d08a8e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:45.097255 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-2f4d3829-cce3-405e-a603-26eda2d08a8e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:45.104730 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-2f4d3829-cce3-405e-a603-26eda2d08a8e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.144439 Oct 29 01:23:45.105296 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 841/1697] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:44 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:45.548887 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-1553dca6-46bd-4208-aa73-6aeb8df6bad8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:45.549702 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-1553dca6-46bd-4208-aa73-6aeb8df6bad8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:45.556476 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1553dca6-46bd-4208-aa73-6aeb8df6bad8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:45.556929 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1553dca6-46bd-4208-aa73-6aeb8df6bad8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:45.557709 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1553dca6-46bd-4208-aa73-6aeb8df6bad8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:45.558148 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1553dca6-46bd-4208-aa73-6aeb8df6bad8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:45.620716 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-1553dca6-46bd-4208-aa73-6aeb8df6bad8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:45.628341 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-1553dca6-46bd-4208-aa73-6aeb8df6bad8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.083116 Oct 29 01:23:45.629157 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 857/1698] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:45 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:46.122794 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-5df955ca-da86-41c2-86cf-c17a289dae85 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:46.123460 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-5df955ca-da86-41c2-86cf-c17a289dae85 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:46.129668 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5df955ca-da86-41c2-86cf-c17a289dae85 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:46.130114 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5df955ca-da86-41c2-86cf-c17a289dae85 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:46.131102 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5df955ca-da86-41c2-86cf-c17a289dae85 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:46.131530 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5df955ca-da86-41c2-86cf-c17a289dae85 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:46.256715 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-5df955ca-da86-41c2-86cf-c17a289dae85 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:46.264316 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-5df955ca-da86-41c2-86cf-c17a289dae85 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.145439 Oct 29 01:23:46.264891 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 842/1699] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:46 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:46.644961 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-bf172a8e-30d2-4e33-af6e-09c3181b4cfa tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:46.645640 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-bf172a8e-30d2-4e33-af6e-09c3181b4cfa tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:46.651895 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bf172a8e-30d2-4e33-af6e-09c3181b4cfa tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:46.652394 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bf172a8e-30d2-4e33-af6e-09c3181b4cfa tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:46.653168 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bf172a8e-30d2-4e33-af6e-09c3181b4cfa tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:46.653628 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bf172a8e-30d2-4e33-af6e-09c3181b4cfa tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:46.715465 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-bf172a8e-30d2-4e33-af6e-09c3181b4cfa tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:46.722976 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-bf172a8e-30d2-4e33-af6e-09c3181b4cfa tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.081730 Oct 29 01:23:46.723544 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 858/1700] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:46 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:47.282032 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-1f39f1d2-b0be-4e28-83a6-13ce39d8edab tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:47.282640 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-1f39f1d2-b0be-4e28-83a6-13ce39d8edab tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:47.289332 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1f39f1d2-b0be-4e28-83a6-13ce39d8edab tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:47.289783 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1f39f1d2-b0be-4e28-83a6-13ce39d8edab tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:47.290593 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1f39f1d2-b0be-4e28-83a6-13ce39d8edab tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:47.291028 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1f39f1d2-b0be-4e28-83a6-13ce39d8edab tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:47.414409 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-1f39f1d2-b0be-4e28-83a6-13ce39d8edab tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:47.422167 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-1f39f1d2-b0be-4e28-83a6-13ce39d8edab tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.143931 Oct 29 01:23:47.422760 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 843/1701] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:47 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:47.740830 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-348b60b5-c851-417b-931e-4b44e7ea5248 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:47.741491 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-348b60b5-c851-417b-931e-4b44e7ea5248 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:47.747990 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-348b60b5-c851-417b-931e-4b44e7ea5248 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:47.748457 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-348b60b5-c851-417b-931e-4b44e7ea5248 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:47.749229 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-348b60b5-c851-417b-931e-4b44e7ea5248 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:47.749656 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-348b60b5-c851-417b-931e-4b44e7ea5248 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:47.810138 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-348b60b5-c851-417b-931e-4b44e7ea5248 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:47.818004 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-348b60b5-c851-417b-931e-4b44e7ea5248 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.081666 Oct 29 01:23:47.818605 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 859/1702] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:47 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:48.439847 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-052bc058-fbd9-49f1-b19e-0640a18809e6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:48.440443 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-052bc058-fbd9-49f1-b19e-0640a18809e6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:48.447400 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-052bc058-fbd9-49f1-b19e-0640a18809e6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:48.447855 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-052bc058-fbd9-49f1-b19e-0640a18809e6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:48.448638 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-052bc058-fbd9-49f1-b19e-0640a18809e6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:48.449093 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-052bc058-fbd9-49f1-b19e-0640a18809e6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:48.576094 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-052bc058-fbd9-49f1-b19e-0640a18809e6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:48.584254 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-052bc058-fbd9-49f1-b19e-0640a18809e6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.148147 Oct 29 01:23:48.584817 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 844/1703] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:48 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:48.835255 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e470bbc3-7e75-4396-850f-645bb30c0e59 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:48.835823 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-e470bbc3-7e75-4396-850f-645bb30c0e59 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:48.842477 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e470bbc3-7e75-4396-850f-645bb30c0e59 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:48.842919 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e470bbc3-7e75-4396-850f-645bb30c0e59 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:48.843687 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e470bbc3-7e75-4396-850f-645bb30c0e59 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:48.844113 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e470bbc3-7e75-4396-850f-645bb30c0e59 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:48.904591 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-e470bbc3-7e75-4396-850f-645bb30c0e59 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:48.912207 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-e470bbc3-7e75-4396-850f-645bb30c0e59 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.081320 Oct 29 01:23:48.912824 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 860/1704] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:48 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:49.601374 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f0203846-ed89-461a-8794-e6c532a686cd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:49.601975 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f0203846-ed89-461a-8794-e6c532a686cd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:49.608277 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f0203846-ed89-461a-8794-e6c532a686cd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:49.608727 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f0203846-ed89-461a-8794-e6c532a686cd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:49.609496 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f0203846-ed89-461a-8794-e6c532a686cd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:49.609924 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f0203846-ed89-461a-8794-e6c532a686cd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:49.731743 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-f0203846-ed89-461a-8794-e6c532a686cd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:49.739999 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f0203846-ed89-461a-8794-e6c532a686cd tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.142350 Oct 29 01:23:49.740572 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 845/1705] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:49 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:49.929443 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c50324c8-8da9-4dc2-8754-e06fb513212c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:49.930017 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c50324c8-8da9-4dc2-8754-e06fb513212c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:49.936778 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c50324c8-8da9-4dc2-8754-e06fb513212c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:49.937231 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c50324c8-8da9-4dc2-8754-e06fb513212c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:49.938014 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c50324c8-8da9-4dc2-8754-e06fb513212c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:49.938480 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c50324c8-8da9-4dc2-8754-e06fb513212c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:50.003955 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-c50324c8-8da9-4dc2-8754-e06fb513212c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:50.011287 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c50324c8-8da9-4dc2-8754-e06fb513212c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.086174 Oct 29 01:23:50.011842 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 861/1706] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:49 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:50.757370 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-6d99fce5-3663-4fb0-8bf7-3b8c304d734f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:50.757961 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-6d99fce5-3663-4fb0-8bf7-3b8c304d734f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:50.764516 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6d99fce5-3663-4fb0-8bf7-3b8c304d734f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:50.764956 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6d99fce5-3663-4fb0-8bf7-3b8c304d734f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:50.765727 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6d99fce5-3663-4fb0-8bf7-3b8c304d734f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:50.766159 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6d99fce5-3663-4fb0-8bf7-3b8c304d734f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:50.891710 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-6d99fce5-3663-4fb0-8bf7-3b8c304d734f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:50.899931 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-6d99fce5-3663-4fb0-8bf7-3b8c304d734f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.146718 Oct 29 01:23:50.900503 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 846/1707] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:50 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:51.027778 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-0b95a2ec-59f1-4479-a8ac-0421179cd400 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:51.028338 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-0b95a2ec-59f1-4479-a8ac-0421179cd400 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:51.034783 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0b95a2ec-59f1-4479-a8ac-0421179cd400 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:51.035224 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0b95a2ec-59f1-4479-a8ac-0421179cd400 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:51.036523 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0b95a2ec-59f1-4479-a8ac-0421179cd400 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:51.036523 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0b95a2ec-59f1-4479-a8ac-0421179cd400 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:51.105275 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-0b95a2ec-59f1-4479-a8ac-0421179cd400 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:51.113301 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-0b95a2ec-59f1-4479-a8ac-0421179cd400 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.088698 Oct 29 01:23:51.113999 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 862/1708] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:51 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:51.916327 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b9011bf0-e281-464e-950c-62c5dddc9cbb tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:51.916946 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b9011bf0-e281-464e-950c-62c5dddc9cbb tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:51.923292 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b9011bf0-e281-464e-950c-62c5dddc9cbb tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:51.923742 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b9011bf0-e281-464e-950c-62c5dddc9cbb tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:51.924519 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b9011bf0-e281-464e-950c-62c5dddc9cbb tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:51.925455 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b9011bf0-e281-464e-950c-62c5dddc9cbb tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:52.048028 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-b9011bf0-e281-464e-950c-62c5dddc9cbb tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:52.058033 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b9011bf0-e281-464e-950c-62c5dddc9cbb tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.145308 Oct 29 01:23:52.058649 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 847/1709] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:51 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:52.130442 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-a4fa7867-96d7-4c1d-a564-39a921eed5c9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:52.131204 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-a4fa7867-96d7-4c1d-a564-39a921eed5c9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:52.137576 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a4fa7867-96d7-4c1d-a564-39a921eed5c9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:52.138023 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a4fa7867-96d7-4c1d-a564-39a921eed5c9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:52.138850 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a4fa7867-96d7-4c1d-a564-39a921eed5c9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:52.139287 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a4fa7867-96d7-4c1d-a564-39a921eed5c9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:52.205602 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-a4fa7867-96d7-4c1d-a564-39a921eed5c9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:52.214179 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-a4fa7867-96d7-4c1d-a564-39a921eed5c9 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.088066 Oct 29 01:23:52.214829 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 863/1710] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:52 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:53.075567 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-af898b11-45cb-43f7-97b8-97cf63bde443 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:53.076116 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-af898b11-45cb-43f7-97b8-97cf63bde443 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:53.083898 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-af898b11-45cb-43f7-97b8-97cf63bde443 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:53.084367 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-af898b11-45cb-43f7-97b8-97cf63bde443 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:53.085137 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-af898b11-45cb-43f7-97b8-97cf63bde443 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:53.085597 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-af898b11-45cb-43f7-97b8-97cf63bde443 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:53.209305 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-af898b11-45cb-43f7-97b8-97cf63bde443 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:53.217074 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-af898b11-45cb-43f7-97b8-97cf63bde443 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.145269 Oct 29 01:23:53.217649 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 848/1711] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:53 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:53.232556 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-1981b8cf-214e-4b3d-9288-9923a3ae512b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:53.233162 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-1981b8cf-214e-4b3d-9288-9923a3ae512b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:53.239677 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1981b8cf-214e-4b3d-9288-9923a3ae512b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:53.240120 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1981b8cf-214e-4b3d-9288-9923a3ae512b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:53.240899 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1981b8cf-214e-4b3d-9288-9923a3ae512b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:53.241332 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1981b8cf-214e-4b3d-9288-9923a3ae512b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:53.305950 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-1981b8cf-214e-4b3d-9288-9923a3ae512b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:53.313535 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-1981b8cf-214e-4b3d-9288-9923a3ae512b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.084722 Oct 29 01:23:53.314100 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 864/1712] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:53 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:54.233877 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-965c1f38-85c4-4324-8f8d-1a03e470abe8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:54.234566 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-965c1f38-85c4-4324-8f8d-1a03e470abe8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:54.241079 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-965c1f38-85c4-4324-8f8d-1a03e470abe8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:54.241518 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-965c1f38-85c4-4324-8f8d-1a03e470abe8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:54.242313 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-965c1f38-85c4-4324-8f8d-1a03e470abe8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:54.242767 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-965c1f38-85c4-4324-8f8d-1a03e470abe8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:54.331871 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-85ce6e75-0794-4f3d-90c7-0b9d3b14300a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:54.332484 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-85ce6e75-0794-4f3d-90c7-0b9d3b14300a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:54.339129 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-85ce6e75-0794-4f3d-90c7-0b9d3b14300a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:54.339581 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-85ce6e75-0794-4f3d-90c7-0b9d3b14300a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:54.340355 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-85ce6e75-0794-4f3d-90c7-0b9d3b14300a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:54.340788 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-85ce6e75-0794-4f3d-90c7-0b9d3b14300a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:54.371469 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-965c1f38-85c4-4324-8f8d-1a03e470abe8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:54.379321 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-965c1f38-85c4-4324-8f8d-1a03e470abe8 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.149199 Oct 29 01:23:54.379901 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 849/1713] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:54 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:54.401702 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-85ce6e75-0794-4f3d-90c7-0b9d3b14300a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:54.409450 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-85ce6e75-0794-4f3d-90c7-0b9d3b14300a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.081928 Oct 29 01:23:54.410638 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 865/1714] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:54 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:55.396482 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d2c62f7f-0cee-422d-b8bd-7f789b581644 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:55.397084 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d2c62f7f-0cee-422d-b8bd-7f789b581644 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:55.403373 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d2c62f7f-0cee-422d-b8bd-7f789b581644 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:55.403829 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d2c62f7f-0cee-422d-b8bd-7f789b581644 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:55.404591 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d2c62f7f-0cee-422d-b8bd-7f789b581644 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:55.405022 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d2c62f7f-0cee-422d-b8bd-7f789b581644 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:55.427234 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-14112b7e-c446-4bbc-9017-d3f24b9cdee0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:55.427832 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-14112b7e-c446-4bbc-9017-d3f24b9cdee0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:55.434194 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-14112b7e-c446-4bbc-9017-d3f24b9cdee0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:55.434669 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-14112b7e-c446-4bbc-9017-d3f24b9cdee0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:55.435439 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-14112b7e-c446-4bbc-9017-d3f24b9cdee0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:55.435869 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-14112b7e-c446-4bbc-9017-d3f24b9cdee0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:55.498595 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-14112b7e-c446-4bbc-9017-d3f24b9cdee0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:55.506376 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-14112b7e-c446-4bbc-9017-d3f24b9cdee0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.083588 Oct 29 01:23:55.506981 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 866/1715] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:55 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:55.550194 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-d2c62f7f-0cee-422d-b8bd-7f789b581644 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:55.558439 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d2c62f7f-0cee-422d-b8bd-7f789b581644 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.165810 Oct 29 01:23:55.559003 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 850/1716] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:55 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:56.522895 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-3eb1ba8d-6ea0-4e18-bf92-34211984ab9a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:56.523632 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-3eb1ba8d-6ea0-4e18-bf92-34211984ab9a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:56.531275 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3eb1ba8d-6ea0-4e18-bf92-34211984ab9a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:56.531788 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3eb1ba8d-6ea0-4e18-bf92-34211984ab9a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:56.532631 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3eb1ba8d-6ea0-4e18-bf92-34211984ab9a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:56.533076 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3eb1ba8d-6ea0-4e18-bf92-34211984ab9a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:56.575087 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-4166a68e-9d16-4264-9874-97c9fce9e61f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:56.575699 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-4166a68e-9d16-4264-9874-97c9fce9e61f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:56.581923 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4166a68e-9d16-4264-9874-97c9fce9e61f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:56.582375 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4166a68e-9d16-4264-9874-97c9fce9e61f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:56.583178 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4166a68e-9d16-4264-9874-97c9fce9e61f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:56.583617 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4166a68e-9d16-4264-9874-97c9fce9e61f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:56.596485 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-3eb1ba8d-6ea0-4e18-bf92-34211984ab9a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:56.604675 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-3eb1ba8d-6ea0-4e18-bf92-34211984ab9a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.085557 Oct 29 01:23:56.605582 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 867/1717] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:56 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:56.708588 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-4166a68e-9d16-4264-9874-97c9fce9e61f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:56.716194 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-4166a68e-9d16-4264-9874-97c9fce9e61f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.144667 Oct 29 01:23:56.716763 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 851/1718] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:56 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:57.622188 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-51644032-1796-40ac-8348-c61ab3d008e6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:57.622846 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-51644032-1796-40ac-8348-c61ab3d008e6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:57.630094 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-51644032-1796-40ac-8348-c61ab3d008e6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:57.630573 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-51644032-1796-40ac-8348-c61ab3d008e6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:57.631352 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-51644032-1796-40ac-8348-c61ab3d008e6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:57.631785 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-51644032-1796-40ac-8348-c61ab3d008e6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:57.693117 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-51644032-1796-40ac-8348-c61ab3d008e6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:57.700892 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-51644032-1796-40ac-8348-c61ab3d008e6 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.082285 Oct 29 01:23:57.701474 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 868/1719] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:57 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:57.733086 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-958aea85-3572-4685-a342-68d21ddc7964 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:57.733805 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-958aea85-3572-4685-a342-68d21ddc7964 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:57.741891 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-958aea85-3572-4685-a342-68d21ddc7964 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:57.742761 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-958aea85-3572-4685-a342-68d21ddc7964 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:57.743650 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-958aea85-3572-4685-a342-68d21ddc7964 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:57.744091 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-958aea85-3572-4685-a342-68d21ddc7964 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:57.871536 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-958aea85-3572-4685-a342-68d21ddc7964 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:57.879155 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-958aea85-3572-4685-a342-68d21ddc7964 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.149772 Oct 29 01:23:57.880299 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 852/1720] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:57 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:58.719132 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-a87fd85d-4b49-4d3f-940e-b3d139c24f53 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:58.719735 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-a87fd85d-4b49-4d3f-940e-b3d139c24f53 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:58.726073 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a87fd85d-4b49-4d3f-940e-b3d139c24f53 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:58.726548 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a87fd85d-4b49-4d3f-940e-b3d139c24f53 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:58.727926 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a87fd85d-4b49-4d3f-940e-b3d139c24f53 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:58.728354 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a87fd85d-4b49-4d3f-940e-b3d139c24f53 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:58.791529 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-a87fd85d-4b49-4d3f-940e-b3d139c24f53 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:58.799022 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-a87fd85d-4b49-4d3f-940e-b3d139c24f53 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.083540 Oct 29 01:23:58.799605 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 869/1721] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:58 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:58.897808 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-4f802851-8d49-433c-834f-3b33f2701461 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:58.898431 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-4f802851-8d49-433c-834f-3b33f2701461 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:58.904713 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4f802851-8d49-433c-834f-3b33f2701461 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:58.905156 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4f802851-8d49-433c-834f-3b33f2701461 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:58.905919 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4f802851-8d49-433c-834f-3b33f2701461 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:58.906344 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4f802851-8d49-433c-834f-3b33f2701461 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:59.028446 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-4f802851-8d49-433c-834f-3b33f2701461 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:59.036069 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-4f802851-8d49-433c-834f-3b33f2701461 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.142393 Oct 29 01:23:59.036640 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 853/1722] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:58 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:59.815855 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-05e979a1-8fe3-4928-acc3-dfb73303dd31 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:59.816458 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-05e979a1-8fe3-4928-acc3-dfb73303dd31 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:23:59.822966 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-05e979a1-8fe3-4928-acc3-dfb73303dd31 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:59.823417 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-05e979a1-8fe3-4928-acc3-dfb73303dd31 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:59.824202 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-05e979a1-8fe3-4928-acc3-dfb73303dd31 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:23:59.824636 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-05e979a1-8fe3-4928-acc3-dfb73303dd31 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:23:59.896792 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-05e979a1-8fe3-4928-acc3-dfb73303dd31 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:59.904285 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-05e979a1-8fe3-4928-acc3-dfb73303dd31 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.092115 Oct 29 01:23:59.904859 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 870/1723] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:23:59 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:00.053364 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-dce102e1-efe8-4dbf-bed5-2217f9e5adac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:00.053962 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-dce102e1-efe8-4dbf-bed5-2217f9e5adac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:00.060453 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dce102e1-efe8-4dbf-bed5-2217f9e5adac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:00.060940 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dce102e1-efe8-4dbf-bed5-2217f9e5adac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:00.061715 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dce102e1-efe8-4dbf-bed5-2217f9e5adac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:00.062151 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dce102e1-efe8-4dbf-bed5-2217f9e5adac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:00.186451 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-dce102e1-efe8-4dbf-bed5-2217f9e5adac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:00.194542 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-dce102e1-efe8-4dbf-bed5-2217f9e5adac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.145404 Oct 29 01:24:00.195160 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 854/1724] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:00 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:00.921513 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-63a49dc2-4742-46df-8e67-b8ddc2f6d44d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:00.922118 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-63a49dc2-4742-46df-8e67-b8ddc2f6d44d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:00.929074 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-63a49dc2-4742-46df-8e67-b8ddc2f6d44d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:00.929514 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-63a49dc2-4742-46df-8e67-b8ddc2f6d44d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:00.930278 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-63a49dc2-4742-46df-8e67-b8ddc2f6d44d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:00.930735 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-63a49dc2-4742-46df-8e67-b8ddc2f6d44d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:00.993549 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-63a49dc2-4742-46df-8e67-b8ddc2f6d44d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:01.001078 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-63a49dc2-4742-46df-8e67-b8ddc2f6d44d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.083222 Oct 29 01:24:01.001653 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 871/1725] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:00 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:01.213006 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c632e0ad-74d6-47e8-9137-3d68679a8fe1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:01.213543 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c632e0ad-74d6-47e8-9137-3d68679a8fe1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:01.219980 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c632e0ad-74d6-47e8-9137-3d68679a8fe1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:01.220424 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c632e0ad-74d6-47e8-9137-3d68679a8fe1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:01.221199 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c632e0ad-74d6-47e8-9137-3d68679a8fe1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:01.221633 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c632e0ad-74d6-47e8-9137-3d68679a8fe1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:01.346729 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c632e0ad-74d6-47e8-9137-3d68679a8fe1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:01.354818 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c632e0ad-74d6-47e8-9137-3d68679a8fe1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.145782 Oct 29 01:24:01.355406 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 855/1726] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:01 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:02.017965 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-10f569b8-83b1-4568-85d4-f1afe9cf178f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:02.018613 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-10f569b8-83b1-4568-85d4-f1afe9cf178f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:02.025793 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-10f569b8-83b1-4568-85d4-f1afe9cf178f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:02.026242 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-10f569b8-83b1-4568-85d4-f1afe9cf178f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:02.027055 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-10f569b8-83b1-4568-85d4-f1afe9cf178f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:02.027493 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-10f569b8-83b1-4568-85d4-f1afe9cf178f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:02.089377 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-10f569b8-83b1-4568-85d4-f1afe9cf178f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:02.097840 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-10f569b8-83b1-4568-85d4-f1afe9cf178f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.083459 Oct 29 01:24:02.098447 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 872/1727] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:02 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:02.372068 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-29c1eda5-5bd2-42d0-8aaf-fc1c14985dc5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:02.372733 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-29c1eda5-5bd2-42d0-8aaf-fc1c14985dc5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:02.379849 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-29c1eda5-5bd2-42d0-8aaf-fc1c14985dc5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:02.380301 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-29c1eda5-5bd2-42d0-8aaf-fc1c14985dc5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:02.381071 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-29c1eda5-5bd2-42d0-8aaf-fc1c14985dc5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:02.381497 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-29c1eda5-5bd2-42d0-8aaf-fc1c14985dc5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:02.505157 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-29c1eda5-5bd2-42d0-8aaf-fc1c14985dc5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:02.512760 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-29c1eda5-5bd2-42d0-8aaf-fc1c14985dc5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.144285 Oct 29 01:24:02.513336 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 856/1728] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:02 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:03.114020 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2436f0a5-07ea-47ba-a9bf-01ed3475acad tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:03.114893 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2436f0a5-07ea-47ba-a9bf-01ed3475acad tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:03.121040 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2436f0a5-07ea-47ba-a9bf-01ed3475acad tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:03.121478 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2436f0a5-07ea-47ba-a9bf-01ed3475acad tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:03.122249 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2436f0a5-07ea-47ba-a9bf-01ed3475acad tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:03.122705 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2436f0a5-07ea-47ba-a9bf-01ed3475acad tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:03.182287 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-2436f0a5-07ea-47ba-a9bf-01ed3475acad tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:03.189916 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2436f0a5-07ea-47ba-a9bf-01ed3475acad tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.080027 Oct 29 01:24:03.190510 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 873/1729] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:03 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:03.529638 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-e9fbfe60-8d3d-49ec-bbd3-02c09adcc087 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:03.530245 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-e9fbfe60-8d3d-49ec-bbd3-02c09adcc087 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:03.536747 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e9fbfe60-8d3d-49ec-bbd3-02c09adcc087 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:03.537190 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e9fbfe60-8d3d-49ec-bbd3-02c09adcc087 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:03.537950 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e9fbfe60-8d3d-49ec-bbd3-02c09adcc087 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:03.538378 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e9fbfe60-8d3d-49ec-bbd3-02c09adcc087 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:03.658774 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-e9fbfe60-8d3d-49ec-bbd3-02c09adcc087 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:03.666783 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-e9fbfe60-8d3d-49ec-bbd3-02c09adcc087 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.140753 Oct 29 01:24:03.667356 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 857/1730] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:03 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:04.206429 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-067bbb80-82fc-47c7-80ee-43fdd8295bbe tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:04.207079 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-067bbb80-82fc-47c7-80ee-43fdd8295bbe tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:04.214430 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-067bbb80-82fc-47c7-80ee-43fdd8295bbe tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:04.214803 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-067bbb80-82fc-47c7-80ee-43fdd8295bbe tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:04.215583 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-067bbb80-82fc-47c7-80ee-43fdd8295bbe tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:04.216017 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-067bbb80-82fc-47c7-80ee-43fdd8295bbe tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:04.275989 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-067bbb80-82fc-47c7-80ee-43fdd8295bbe tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:04.283656 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-067bbb80-82fc-47c7-80ee-43fdd8295bbe tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.080909 Oct 29 01:24:04.284227 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 874/1731] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:04 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:04.683992 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f5fa3d1b-42d4-404e-a28d-f0731af34240 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:04.684592 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f5fa3d1b-42d4-404e-a28d-f0731af34240 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:04.690905 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f5fa3d1b-42d4-404e-a28d-f0731af34240 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:04.691565 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f5fa3d1b-42d4-404e-a28d-f0731af34240 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:04.692849 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f5fa3d1b-42d4-404e-a28d-f0731af34240 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:04.693276 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f5fa3d1b-42d4-404e-a28d-f0731af34240 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:04.814810 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-f5fa3d1b-42d4-404e-a28d-f0731af34240 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:04.822752 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f5fa3d1b-42d4-404e-a28d-f0731af34240 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.142527 Oct 29 01:24:04.823308 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 858/1732] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:04 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:05.303611 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-1966606c-57e8-4abf-afc6-00c9c193ebe7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:05.304179 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-1966606c-57e8-4abf-afc6-00c9c193ebe7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:05.310506 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1966606c-57e8-4abf-afc6-00c9c193ebe7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:05.310955 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1966606c-57e8-4abf-afc6-00c9c193ebe7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:05.311730 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1966606c-57e8-4abf-afc6-00c9c193ebe7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:05.312165 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1966606c-57e8-4abf-afc6-00c9c193ebe7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:05.373282 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-1966606c-57e8-4abf-afc6-00c9c193ebe7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:05.381429 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-1966606c-57e8-4abf-afc6-00c9c193ebe7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.081627 Oct 29 01:24:05.382013 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 875/1733] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:05 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:05.839783 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-5a07fef0-bb41-4920-bab1-f6bd6272b527 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:05.840405 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-5a07fef0-bb41-4920-bab1-f6bd6272b527 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:05.846808 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5a07fef0-bb41-4920-bab1-f6bd6272b527 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:05.847248 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5a07fef0-bb41-4920-bab1-f6bd6272b527 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:05.848032 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5a07fef0-bb41-4920-bab1-f6bd6272b527 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:05.848457 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5a07fef0-bb41-4920-bab1-f6bd6272b527 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:05.976465 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-5a07fef0-bb41-4920-bab1-f6bd6272b527 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:05.984027 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-5a07fef0-bb41-4920-bab1-f6bd6272b527 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.148162 Oct 29 01:24:05.984606 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 859/1734] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:05 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:06.398129 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e136880a-def4-4540-aa9f-460ea6812509 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:06.398776 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-e136880a-def4-4540-aa9f-460ea6812509 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:06.404775 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e136880a-def4-4540-aa9f-460ea6812509 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:06.405222 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e136880a-def4-4540-aa9f-460ea6812509 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:06.405993 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e136880a-def4-4540-aa9f-460ea6812509 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:06.406457 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e136880a-def4-4540-aa9f-460ea6812509 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:06.469985 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-e136880a-def4-4540-aa9f-460ea6812509 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:06.478188 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-e136880a-def4-4540-aa9f-460ea6812509 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.083877 Oct 29 01:24:06.478799 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 876/1735] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:06 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:07.004441 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f29eaf3b-cd82-4097-89de-3f46cb1b8855 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:07.005042 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f29eaf3b-cd82-4097-89de-3f46cb1b8855 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:07.011410 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f29eaf3b-cd82-4097-89de-3f46cb1b8855 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:07.011861 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f29eaf3b-cd82-4097-89de-3f46cb1b8855 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:07.012673 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f29eaf3b-cd82-4097-89de-3f46cb1b8855 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:07.013105 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f29eaf3b-cd82-4097-89de-3f46cb1b8855 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:07.140536 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-f29eaf3b-cd82-4097-89de-3f46cb1b8855 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:07.148534 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f29eaf3b-cd82-4097-89de-3f46cb1b8855 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.147732 Oct 29 01:24:07.149103 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 860/1736] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:06 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:07.502317 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-4120fd49-5982-4fbe-a0cc-4dd3eb649ee7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:07.503081 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-4120fd49-5982-4fbe-a0cc-4dd3eb649ee7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:07.509791 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4120fd49-5982-4fbe-a0cc-4dd3eb649ee7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:07.510234 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4120fd49-5982-4fbe-a0cc-4dd3eb649ee7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:07.511028 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4120fd49-5982-4fbe-a0cc-4dd3eb649ee7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:07.511457 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4120fd49-5982-4fbe-a0cc-4dd3eb649ee7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:07.574057 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-4120fd49-5982-4fbe-a0cc-4dd3eb649ee7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:07.581866 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-4120fd49-5982-4fbe-a0cc-4dd3eb649ee7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.083168 Oct 29 01:24:07.583050 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 877/1737] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:07 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:07.736309 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:24:07.736309 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: Fri Oct 29 01:24:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 29 01:24:08.165836 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-25fc201b-8fbf-487b-964c-748f0711e737 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:08.166555 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-25fc201b-8fbf-487b-964c-748f0711e737 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:08.172816 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-25fc201b-8fbf-487b-964c-748f0711e737 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:08.173261 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-25fc201b-8fbf-487b-964c-748f0711e737 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:08.174024 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-25fc201b-8fbf-487b-964c-748f0711e737 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:08.174503 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-25fc201b-8fbf-487b-964c-748f0711e737 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:08.296400 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-25fc201b-8fbf-487b-964c-748f0711e737 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:08.305549 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-25fc201b-8fbf-487b-964c-748f0711e737 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.142934 Oct 29 01:24:08.306595 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 861/1738] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:08 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:08.599647 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-de74a2cc-a67d-4d77-9c6f-af8592cb0685 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:08.600238 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-de74a2cc-a67d-4d77-9c6f-af8592cb0685 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:08.606584 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-de74a2cc-a67d-4d77-9c6f-af8592cb0685 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:08.607033 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-de74a2cc-a67d-4d77-9c6f-af8592cb0685 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:08.607801 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-de74a2cc-a67d-4d77-9c6f-af8592cb0685 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:08.608228 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-de74a2cc-a67d-4d77-9c6f-af8592cb0685 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:08.904232 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-de74a2cc-a67d-4d77-9c6f-af8592cb0685 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:08.912811 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-de74a2cc-a67d-4d77-9c6f-af8592cb0685 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.317003 Oct 29 01:24:08.913392 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 878/1739] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:08 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:09.326757 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-91a222f4-c56c-4d39-a214-a398dcd2f3a1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:09.327347 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-91a222f4-c56c-4d39-a214-a398dcd2f3a1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:09.334088 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-91a222f4-c56c-4d39-a214-a398dcd2f3a1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:09.334564 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-91a222f4-c56c-4d39-a214-a398dcd2f3a1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:09.335328 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-91a222f4-c56c-4d39-a214-a398dcd2f3a1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:09.335754 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-91a222f4-c56c-4d39-a214-a398dcd2f3a1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:09.457720 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-91a222f4-c56c-4d39-a214-a398dcd2f3a1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:09.465493 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-91a222f4-c56c-4d39-a214-a398dcd2f3a1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.142415 Oct 29 01:24:09.466072 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 862/1740] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:09 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:09.929867 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-ddae3d51-1625-42fd-86a8-65216db3dec7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:09.930520 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-ddae3d51-1625-42fd-86a8-65216db3dec7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:09.936956 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ddae3d51-1625-42fd-86a8-65216db3dec7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:09.937408 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ddae3d51-1625-42fd-86a8-65216db3dec7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:09.938185 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ddae3d51-1625-42fd-86a8-65216db3dec7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:09.938651 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ddae3d51-1625-42fd-86a8-65216db3dec7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:10.000441 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-ddae3d51-1625-42fd-86a8-65216db3dec7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:10.008827 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-ddae3d51-1625-42fd-86a8-65216db3dec7 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.083110 Oct 29 01:24:10.009414 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 879/1741] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:09 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:10.482353 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-56f6fa8d-a251-474f-8848-2e4224575f85 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:10.482981 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-56f6fa8d-a251-474f-8848-2e4224575f85 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:10.490015 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-56f6fa8d-a251-474f-8848-2e4224575f85 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:10.490485 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-56f6fa8d-a251-474f-8848-2e4224575f85 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:10.491256 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-56f6fa8d-a251-474f-8848-2e4224575f85 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:10.491682 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-56f6fa8d-a251-474f-8848-2e4224575f85 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:10.619133 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-56f6fa8d-a251-474f-8848-2e4224575f85 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:10.626650 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-56f6fa8d-a251-474f-8848-2e4224575f85 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.147869 Oct 29 01:24:10.627201 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 863/1742] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:10 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:11.025637 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-ab06c0f3-e260-4fdc-8794-94390fc00e95 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:11.026241 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-ab06c0f3-e260-4fdc-8794-94390fc00e95 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:11.032645 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ab06c0f3-e260-4fdc-8794-94390fc00e95 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:11.033088 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ab06c0f3-e260-4fdc-8794-94390fc00e95 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:11.033862 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ab06c0f3-e260-4fdc-8794-94390fc00e95 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:11.034294 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ab06c0f3-e260-4fdc-8794-94390fc00e95 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:11.104391 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-ab06c0f3-e260-4fdc-8794-94390fc00e95 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:11.104960 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-ab06c0f3-e260-4fdc-8794-94390fc00e95 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.082673 Oct 29 01:24:11.105205 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 880/1743] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:11 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:11.644203 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-7a8bfcb0-481a-4a31-9f2d-71f94da69f7f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:11.645414 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-7a8bfcb0-481a-4a31-9f2d-71f94da69f7f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:11.654209 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7a8bfcb0-481a-4a31-9f2d-71f94da69f7f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:11.654692 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7a8bfcb0-481a-4a31-9f2d-71f94da69f7f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:11.655469 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7a8bfcb0-481a-4a31-9f2d-71f94da69f7f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:11.655902 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7a8bfcb0-481a-4a31-9f2d-71f94da69f7f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:11.704621 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d8b7b90c-7633-419d-8ebb-3d5ad9496082 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:11.705195 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d8b7b90c-7633-419d-8ebb-3d5ad9496082 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:11.713173 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d8b7b90c-7633-419d-8ebb-3d5ad9496082 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:11.713727 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d8b7b90c-7633-419d-8ebb-3d5ad9496082 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:11.714617 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d8b7b90c-7633-419d-8ebb-3d5ad9496082 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:11.715120 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d8b7b90c-7633-419d-8ebb-3d5ad9496082 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:11.785520 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-7a8bfcb0-481a-4a31-9f2d-71f94da69f7f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:11.792929 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-7a8bfcb0-481a-4a31-9f2d-71f94da69f7f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.153175 Oct 29 01:24:11.793491 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 864/1744] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:11 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:12.122308 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-4f416e98-5170-45e4-ac53-1d91426dd5d4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:12.123082 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-4f416e98-5170-45e4-ac53-1d91426dd5d4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:12.129182 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4f416e98-5170-45e4-ac53-1d91426dd5d4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:12.129641 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4f416e98-5170-45e4-ac53-1d91426dd5d4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:12.130412 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4f416e98-5170-45e4-ac53-1d91426dd5d4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:12.130851 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4f416e98-5170-45e4-ac53-1d91426dd5d4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:12.191026 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-4f416e98-5170-45e4-ac53-1d91426dd5d4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:12.201592 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-4f416e98-5170-45e4-ac53-1d91426dd5d4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.082554 Oct 29 01:24:12.202512 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 865/1745] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:12 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:12.810572 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-15c8dd78-b98d-408f-b958-b9c3959449fe tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:12.811442 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-15c8dd78-b98d-408f-b958-b9c3959449fe tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:12.818189 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-15c8dd78-b98d-408f-b958-b9c3959449fe tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:12.818659 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-15c8dd78-b98d-408f-b958-b9c3959449fe tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:12.819426 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-15c8dd78-b98d-408f-b958-b9c3959449fe tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:12.819854 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-15c8dd78-b98d-408f-b958-b9c3959449fe tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:12.946896 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-15c8dd78-b98d-408f-b958-b9c3959449fe tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:12.955327 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-15c8dd78-b98d-408f-b958-b9c3959449fe tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.148327 Oct 29 01:24:12.955897 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 866/1746] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:12 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:13.219089 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d986e542-d275-4987-8eea-a20220168faa tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:13.219850 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d986e542-d275-4987-8eea-a20220168faa tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:13.226353 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d986e542-d275-4987-8eea-a20220168faa tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:13.226827 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d986e542-d275-4987-8eea-a20220168faa tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:13.227581 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d986e542-d275-4987-8eea-a20220168faa tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:13.228093 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d986e542-d275-4987-8eea-a20220168faa tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:13.288813 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-d986e542-d275-4987-8eea-a20220168faa tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:13.296478 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d986e542-d275-4987-8eea-a20220168faa tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.081005 Oct 29 01:24:13.297052 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 867/1747] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:13 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:13.972648 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-5b0a31e0-bc69-4f6d-9644-e092f154c134 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:13.973308 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-5b0a31e0-bc69-4f6d-9644-e092f154c134 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:13.980963 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5b0a31e0-bc69-4f6d-9644-e092f154c134 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:13.981430 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5b0a31e0-bc69-4f6d-9644-e092f154c134 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:13.982265 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5b0a31e0-bc69-4f6d-9644-e092f154c134 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:13.982726 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5b0a31e0-bc69-4f6d-9644-e092f154c134 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:14.109807 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-5b0a31e0-bc69-4f6d-9644-e092f154c134 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:14.117367 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-5b0a31e0-bc69-4f6d-9644-e092f154c134 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.148429 Oct 29 01:24:14.117946 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 868/1748] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:13 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:14.314172 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-5ae17f22-0aa9-429b-8d44-63cd3460ad20 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:14.314807 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-5ae17f22-0aa9-429b-8d44-63cd3460ad20 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:14.321242 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5ae17f22-0aa9-429b-8d44-63cd3460ad20 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:14.321613 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5ae17f22-0aa9-429b-8d44-63cd3460ad20 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:14.322371 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5ae17f22-0aa9-429b-8d44-63cd3460ad20 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:14.322821 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5ae17f22-0aa9-429b-8d44-63cd3460ad20 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:14.386455 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-5ae17f22-0aa9-429b-8d44-63cd3460ad20 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:14.393875 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-5ae17f22-0aa9-429b-8d44-63cd3460ad20 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.083700 Oct 29 01:24:14.394462 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 869/1749] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:14 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:15.134888 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-81b7e990-e536-4dc3-b5a6-e0b1f50e4a82 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:15.135574 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-81b7e990-e536-4dc3-b5a6-e0b1f50e4a82 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:15.141762 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-81b7e990-e536-4dc3-b5a6-e0b1f50e4a82 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:15.142210 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-81b7e990-e536-4dc3-b5a6-e0b1f50e4a82 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:15.143011 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-81b7e990-e536-4dc3-b5a6-e0b1f50e4a82 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:15.143449 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-81b7e990-e536-4dc3-b5a6-e0b1f50e4a82 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:15.265439 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-81b7e990-e536-4dc3-b5a6-e0b1f50e4a82 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:15.274441 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-81b7e990-e536-4dc3-b5a6-e0b1f50e4a82 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.142856 Oct 29 01:24:15.275354 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 870/1750] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:15 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:15.410755 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-244ee01e-880f-483d-9816-8bc25032f735 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:15.411391 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-244ee01e-880f-483d-9816-8bc25032f735 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:15.417306 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-244ee01e-880f-483d-9816-8bc25032f735 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:15.417752 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-244ee01e-880f-483d-9816-8bc25032f735 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:15.418544 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-244ee01e-880f-483d-9816-8bc25032f735 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:15.418978 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-244ee01e-880f-483d-9816-8bc25032f735 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:15.481532 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-244ee01e-880f-483d-9816-8bc25032f735 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:15.489701 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-244ee01e-880f-483d-9816-8bc25032f735 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.082619 Oct 29 01:24:15.490272 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 871/1751] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:15 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:16.291785 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-cafe9a35-229b-43dd-80e4-721e4e08e814 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:16.292477 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-cafe9a35-229b-43dd-80e4-721e4e08e814 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:16.298942 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cafe9a35-229b-43dd-80e4-721e4e08e814 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:16.299390 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cafe9a35-229b-43dd-80e4-721e4e08e814 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:16.300161 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cafe9a35-229b-43dd-80e4-721e4e08e814 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:16.300599 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cafe9a35-229b-43dd-80e4-721e4e08e814 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:16.423197 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-cafe9a35-229b-43dd-80e4-721e4e08e814 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:16.434049 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-cafe9a35-229b-43dd-80e4-721e4e08e814 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.145894 Oct 29 01:24:16.434666 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 872/1752] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:16 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:16.506909 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d36c0ce8-8692-4688-a06b-b561796643be tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:16.507522 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d36c0ce8-8692-4688-a06b-b561796643be tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:16.513492 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d36c0ce8-8692-4688-a06b-b561796643be tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:16.513938 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d36c0ce8-8692-4688-a06b-b561796643be tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:16.514744 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d36c0ce8-8692-4688-a06b-b561796643be tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:16.515181 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d36c0ce8-8692-4688-a06b-b561796643be tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:16.580424 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-d36c0ce8-8692-4688-a06b-b561796643be tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:16.588774 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d36c0ce8-8692-4688-a06b-b561796643be tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.085980 Oct 29 01:24:16.589342 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 873/1753] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:16 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:17.451874 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-75f75b27-5f1e-4b6a-ba4f-1decee12f23e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:17.452656 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-75f75b27-5f1e-4b6a-ba4f-1decee12f23e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:17.459871 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-75f75b27-5f1e-4b6a-ba4f-1decee12f23e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:17.459871 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-75f75b27-5f1e-4b6a-ba4f-1decee12f23e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:17.460579 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-75f75b27-5f1e-4b6a-ba4f-1decee12f23e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:17.461265 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-75f75b27-5f1e-4b6a-ba4f-1decee12f23e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:17.589318 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-75f75b27-5f1e-4b6a-ba4f-1decee12f23e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:17.596799 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-75f75b27-5f1e-4b6a-ba4f-1decee12f23e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.148558 Oct 29 01:24:17.597365 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 874/1754] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:17 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:17.605055 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-cfbd0a4c-3e45-4343-8e75-5779ed85b8d0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:17.605653 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-cfbd0a4c-3e45-4343-8e75-5779ed85b8d0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:17.611700 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cfbd0a4c-3e45-4343-8e75-5779ed85b8d0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:17.612149 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cfbd0a4c-3e45-4343-8e75-5779ed85b8d0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:17.613459 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cfbd0a4c-3e45-4343-8e75-5779ed85b8d0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:17.613888 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cfbd0a4c-3e45-4343-8e75-5779ed85b8d0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:17.673747 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-cfbd0a4c-3e45-4343-8e75-5779ed85b8d0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:17.681685 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-cfbd0a4c-3e45-4343-8e75-5779ed85b8d0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.080052 Oct 29 01:24:17.682250 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 875/1755] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:17 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:18.613535 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-970652a8-a866-4fe3-b674-3447b7d43160 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:18.614233 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-970652a8-a866-4fe3-b674-3447b7d43160 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:18.620627 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-970652a8-a866-4fe3-b674-3447b7d43160 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:18.621077 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-970652a8-a866-4fe3-b674-3447b7d43160 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:18.621856 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-970652a8-a866-4fe3-b674-3447b7d43160 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:18.622288 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-970652a8-a866-4fe3-b674-3447b7d43160 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:18.748587 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-970652a8-a866-4fe3-b674-3447b7d43160 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:18.756673 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-970652a8-a866-4fe3-b674-3447b7d43160 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.146926 Oct 29 01:24:18.757277 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 876/1756] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:18 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:18.761502 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-92e426a9-6187-4f99-81e9-d3b31869b69b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:18.762110 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-92e426a9-6187-4f99-81e9-d3b31869b69b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:18.768498 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-92e426a9-6187-4f99-81e9-d3b31869b69b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:18.769692 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-92e426a9-6187-4f99-81e9-d3b31869b69b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:18.770713 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-92e426a9-6187-4f99-81e9-d3b31869b69b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:18.771254 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-92e426a9-6187-4f99-81e9-d3b31869b69b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:18.833613 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-92e426a9-6187-4f99-81e9-d3b31869b69b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:18.841487 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-92e426a9-6187-4f99-81e9-d3b31869b69b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.083198 Oct 29 01:24:18.842055 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 877/1757] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:18 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:19.774203 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-7050d6d5-9966-4862-95f3-d051715459a0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:19.774965 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-7050d6d5-9966-4862-95f3-d051715459a0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:19.781229 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7050d6d5-9966-4862-95f3-d051715459a0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:19.781672 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7050d6d5-9966-4862-95f3-d051715459a0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:19.782459 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7050d6d5-9966-4862-95f3-d051715459a0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:19.782892 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7050d6d5-9966-4862-95f3-d051715459a0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:19.907530 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-7050d6d5-9966-4862-95f3-d051715459a0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:19.915097 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-7050d6d5-9966-4862-95f3-d051715459a0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.145088 Oct 29 01:24:19.915674 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 878/1758] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:19 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:19.919924 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-97ebbab0-3a10-4a34-adf2-7917a238c71e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:19.920521 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-97ebbab0-3a10-4a34-adf2-7917a238c71e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:19.927188 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-97ebbab0-3a10-4a34-adf2-7917a238c71e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:19.927700 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-97ebbab0-3a10-4a34-adf2-7917a238c71e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:19.928504 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-97ebbab0-3a10-4a34-adf2-7917a238c71e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:19.928946 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-97ebbab0-3a10-4a34-adf2-7917a238c71e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:19.991023 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-97ebbab0-3a10-4a34-adf2-7917a238c71e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:19.998749 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-97ebbab0-3a10-4a34-adf2-7917a238c71e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.082039 Oct 29 01:24:19.999323 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 879/1759] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:19 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:20.935269 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-104e1151-d495-4997-b409-4dd6f0bafd9b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:20.936323 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-104e1151-d495-4997-b409-4dd6f0bafd9b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:20.944311 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-104e1151-d495-4997-b409-4dd6f0bafd9b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:20.944753 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-104e1151-d495-4997-b409-4dd6f0bafd9b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:20.945525 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-104e1151-d495-4997-b409-4dd6f0bafd9b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:20.945963 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-104e1151-d495-4997-b409-4dd6f0bafd9b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:21.073599 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-104e1151-d495-4997-b409-4dd6f0bafd9b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:21.081821 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-104e1151-d495-4997-b409-4dd6f0bafd9b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.152463 Oct 29 01:24:21.082417 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 880/1760] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:20 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:21.086990 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ce2db1b7-c6a0-497d-bb6d-679d22b3e1fb tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:21.087590 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ce2db1b7-c6a0-497d-bb6d-679d22b3e1fb tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:21.093470 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ce2db1b7-c6a0-497d-bb6d-679d22b3e1fb tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:21.093914 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ce2db1b7-c6a0-497d-bb6d-679d22b3e1fb tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:21.094720 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ce2db1b7-c6a0-497d-bb6d-679d22b3e1fb tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:21.095153 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ce2db1b7-c6a0-497d-bb6d-679d22b3e1fb tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:21.156392 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-ce2db1b7-c6a0-497d-bb6d-679d22b3e1fb tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:21.164022 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ce2db1b7-c6a0-497d-bb6d-679d22b3e1fb tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.080581 Oct 29 01:24:21.164608 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 881/1761] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:21 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:22.099790 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-dcefe9c4-feb3-4efd-a6f2-917282153ef1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:22.100495 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-dcefe9c4-feb3-4efd-a6f2-917282153ef1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:22.106809 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dcefe9c4-feb3-4efd-a6f2-917282153ef1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:22.107259 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dcefe9c4-feb3-4efd-a6f2-917282153ef1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:22.108039 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dcefe9c4-feb3-4efd-a6f2-917282153ef1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:22.108473 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dcefe9c4-feb3-4efd-a6f2-917282153ef1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:22.231777 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-dcefe9c4-feb3-4efd-a6f2-917282153ef1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:22.239990 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-dcefe9c4-feb3-4efd-a6f2-917282153ef1 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.143822 Oct 29 01:24:22.240562 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 882/1762] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:22 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:22.244819 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-11476f70-fac4-4796-9e07-558077b21eed tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:22.245420 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-11476f70-fac4-4796-9e07-558077b21eed tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:22.251605 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-11476f70-fac4-4796-9e07-558077b21eed tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:22.252081 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-11476f70-fac4-4796-9e07-558077b21eed tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:22.252852 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-11476f70-fac4-4796-9e07-558077b21eed tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:22.253957 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-11476f70-fac4-4796-9e07-558077b21eed tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:22.319150 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-11476f70-fac4-4796-9e07-558077b21eed tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:22.326570 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-11476f70-fac4-4796-9e07-558077b21eed tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.085003 Oct 29 01:24:22.327133 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 883/1763] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:22 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:23.256755 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-1234546d-581b-4819-b3d8-e19e3f0b4d43 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:23.257428 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-1234546d-581b-4819-b3d8-e19e3f0b4d43 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:23.263659 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1234546d-581b-4819-b3d8-e19e3f0b4d43 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:23.264101 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1234546d-581b-4819-b3d8-e19e3f0b4d43 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:23.264866 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1234546d-581b-4819-b3d8-e19e3f0b4d43 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:23.265292 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1234546d-581b-4819-b3d8-e19e3f0b4d43 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:23.392116 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-1234546d-581b-4819-b3d8-e19e3f0b4d43 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:23.400222 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-1234546d-581b-4819-b3d8-e19e3f0b4d43 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.147628 Oct 29 01:24:23.400790 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 884/1764] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:23 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:23.405045 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-e2952ff9-457c-49d5-99bc-29210ddd87db tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:23.405638 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-e2952ff9-457c-49d5-99bc-29210ddd87db tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:23.411767 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e2952ff9-457c-49d5-99bc-29210ddd87db tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:23.412204 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e2952ff9-457c-49d5-99bc-29210ddd87db tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:23.412969 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e2952ff9-457c-49d5-99bc-29210ddd87db tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:23.413397 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e2952ff9-457c-49d5-99bc-29210ddd87db tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:23.473642 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-e2952ff9-457c-49d5-99bc-29210ddd87db tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:23.481091 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-e2952ff9-457c-49d5-99bc-29210ddd87db tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.079343 Oct 29 01:24:23.481655 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 885/1765] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:23 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:24.418975 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-66b758c2-1af6-4192-9791-32188c4cbeaf tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:24.419676 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-66b758c2-1af6-4192-9791-32188c4cbeaf tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:24.427398 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-66b758c2-1af6-4192-9791-32188c4cbeaf tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:24.427877 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-66b758c2-1af6-4192-9791-32188c4cbeaf tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:24.428647 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-66b758c2-1af6-4192-9791-32188c4cbeaf tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:24.429074 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-66b758c2-1af6-4192-9791-32188c4cbeaf tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:24.553793 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-66b758c2-1af6-4192-9791-32188c4cbeaf tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:24.561677 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-66b758c2-1af6-4192-9791-32188c4cbeaf tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.147555 Oct 29 01:24:24.562220 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 886/1766] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:24 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:24.567457 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-7d4d38d1-e81b-419f-be90-260b7bf277d1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:24.568058 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-7d4d38d1-e81b-419f-be90-260b7bf277d1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:24.573955 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7d4d38d1-e81b-419f-be90-260b7bf277d1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:24.574418 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7d4d38d1-e81b-419f-be90-260b7bf277d1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:24.575189 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7d4d38d1-e81b-419f-be90-260b7bf277d1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:24.575624 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7d4d38d1-e81b-419f-be90-260b7bf277d1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:24.645148 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-7d4d38d1-e81b-419f-be90-260b7bf277d1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:24.653146 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-7d4d38d1-e81b-419f-be90-260b7bf277d1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.089833 Oct 29 01:24:24.653721 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 887/1767] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:24 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:25.578839 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-7c366cc0-fe3b-4e2d-9a3c-e894c05b7911 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:25.579831 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-7c366cc0-fe3b-4e2d-9a3c-e894c05b7911 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:25.586541 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7c366cc0-fe3b-4e2d-9a3c-e894c05b7911 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:25.586985 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7c366cc0-fe3b-4e2d-9a3c-e894c05b7911 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:25.587752 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7c366cc0-fe3b-4e2d-9a3c-e894c05b7911 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:25.588184 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7c366cc0-fe3b-4e2d-9a3c-e894c05b7911 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:25.712506 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-7c366cc0-fe3b-4e2d-9a3c-e894c05b7911 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:25.720476 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-7c366cc0-fe3b-4e2d-9a3c-e894c05b7911 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.145376 Oct 29 01:24:25.721054 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 888/1768] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:25 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:25.725960 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-976e40aa-33f3-409c-be4d-87dabb7f7196 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:25.726559 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-976e40aa-33f3-409c-be4d-87dabb7f7196 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:25.732594 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-976e40aa-33f3-409c-be4d-87dabb7f7196 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:25.733041 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-976e40aa-33f3-409c-be4d-87dabb7f7196 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:25.733814 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-976e40aa-33f3-409c-be4d-87dabb7f7196 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:25.734248 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-976e40aa-33f3-409c-be4d-87dabb7f7196 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:25.794945 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-976e40aa-33f3-409c-be4d-87dabb7f7196 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:25.802555 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-976e40aa-33f3-409c-be4d-87dabb7f7196 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.079879 Oct 29 01:24:25.803125 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 889/1769] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:25 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:26.738399 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-692150aa-7648-4082-9e3a-565cb27a3d4e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:26.739112 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-692150aa-7648-4082-9e3a-565cb27a3d4e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:26.745428 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-692150aa-7648-4082-9e3a-565cb27a3d4e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:26.745870 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-692150aa-7648-4082-9e3a-565cb27a3d4e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:26.746676 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-692150aa-7648-4082-9e3a-565cb27a3d4e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:26.747108 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-692150aa-7648-4082-9e3a-565cb27a3d4e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:26.875079 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-692150aa-7648-4082-9e3a-565cb27a3d4e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:26.882683 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-692150aa-7648-4082-9e3a-565cb27a3d4e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.148514 Oct 29 01:24:26.883258 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 890/1770] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:26 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:26.887532 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-3cce20a7-ae39-4299-936a-92b29a243a89 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:26.888136 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-3cce20a7-ae39-4299-936a-92b29a243a89 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:26.894481 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3cce20a7-ae39-4299-936a-92b29a243a89 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:26.894926 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3cce20a7-ae39-4299-936a-92b29a243a89 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:26.895694 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3cce20a7-ae39-4299-936a-92b29a243a89 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:26.896123 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3cce20a7-ae39-4299-936a-92b29a243a89 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:26.956998 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-3cce20a7-ae39-4299-936a-92b29a243a89 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:26.965507 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-3cce20a7-ae39-4299-936a-92b29a243a89 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.081229 Oct 29 01:24:26.966079 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 891/1771] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:26 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:27.900125 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-93110084-67f5-4383-a4bd-ab94c9693677 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:27.900829 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-93110084-67f5-4383-a4bd-ab94c9693677 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:27.907268 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-93110084-67f5-4383-a4bd-ab94c9693677 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:27.907704 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-93110084-67f5-4383-a4bd-ab94c9693677 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:27.908464 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-93110084-67f5-4383-a4bd-ab94c9693677 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:27.909027 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-93110084-67f5-4383-a4bd-ab94c9693677 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:28.035906 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-93110084-67f5-4383-a4bd-ab94c9693677 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:28.043667 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-93110084-67f5-4383-a4bd-ab94c9693677 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.147132 Oct 29 01:24:28.044240 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 892/1772] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:27 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:28.048820 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-e6850964-bc80-4ac6-a902-271f9f503e7a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:28.049420 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-e6850964-bc80-4ac6-a902-271f9f503e7a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:28.055581 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e6850964-bc80-4ac6-a902-271f9f503e7a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:28.056026 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e6850964-bc80-4ac6-a902-271f9f503e7a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:28.056816 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e6850964-bc80-4ac6-a902-271f9f503e7a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:28.057249 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e6850964-bc80-4ac6-a902-271f9f503e7a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:28.118060 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-e6850964-bc80-4ac6-a902-271f9f503e7a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:28.125542 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-e6850964-bc80-4ac6-a902-271f9f503e7a tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.080328 Oct 29 01:24:28.126106 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 893/1773] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:28 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:29.060502 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-429ca596-5a04-4b33-ba45-f40a432aaeb2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:29.061274 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-429ca596-5a04-4b33-ba45-f40a432aaeb2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:29.068271 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-429ca596-5a04-4b33-ba45-f40a432aaeb2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:29.068713 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-429ca596-5a04-4b33-ba45-f40a432aaeb2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:29.069485 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-429ca596-5a04-4b33-ba45-f40a432aaeb2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:29.069911 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-429ca596-5a04-4b33-ba45-f40a432aaeb2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:29.201164 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-429ca596-5a04-4b33-ba45-f40a432aaeb2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:29.208900 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-429ca596-5a04-4b33-ba45-f40a432aaeb2 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.151919 Oct 29 01:24:29.209407 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 894/1774] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:29 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:29.213946 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-dc2fc732-95a5-4d41-83d9-0cda0c6d0d6f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:29.214577 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-dc2fc732-95a5-4d41-83d9-0cda0c6d0d6f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:29.220925 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dc2fc732-95a5-4d41-83d9-0cda0c6d0d6f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:29.221864 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dc2fc732-95a5-4d41-83d9-0cda0c6d0d6f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:29.222698 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dc2fc732-95a5-4d41-83d9-0cda0c6d0d6f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:29.223136 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dc2fc732-95a5-4d41-83d9-0cda0c6d0d6f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:29.283577 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-dc2fc732-95a5-4d41-83d9-0cda0c6d0d6f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:29.291632 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-dc2fc732-95a5-4d41-83d9-0cda0c6d0d6f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.081240 Oct 29 01:24:29.292208 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 895/1775] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:29 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:30.225270 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f8ac5ab2-9d75-4c0c-a614-bb2c2c3f38cc tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:30.225933 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f8ac5ab2-9d75-4c0c-a614-bb2c2c3f38cc tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:30.232395 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f8ac5ab2-9d75-4c0c-a614-bb2c2c3f38cc tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:30.232841 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f8ac5ab2-9d75-4c0c-a614-bb2c2c3f38cc tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:30.233635 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f8ac5ab2-9d75-4c0c-a614-bb2c2c3f38cc tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:30.234090 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f8ac5ab2-9d75-4c0c-a614-bb2c2c3f38cc tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:30.371122 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-f8ac5ab2-9d75-4c0c-a614-bb2c2c3f38cc tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:30.381723 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f8ac5ab2-9d75-4c0c-a614-bb2c2c3f38cc tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.160187 Oct 29 01:24:30.382309 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 896/1776] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:30 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:30.386600 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a88f2321-accc-409b-8f58-843a272c1aa8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:30.387206 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a88f2321-accc-409b-8f58-843a272c1aa8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:30.393326 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a88f2321-accc-409b-8f58-843a272c1aa8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:30.393777 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a88f2321-accc-409b-8f58-843a272c1aa8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:30.394594 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a88f2321-accc-409b-8f58-843a272c1aa8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:30.395033 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a88f2321-accc-409b-8f58-843a272c1aa8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:30.458598 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-a88f2321-accc-409b-8f58-843a272c1aa8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:30.471020 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a88f2321-accc-409b-8f58-843a272c1aa8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.087656 Oct 29 01:24:30.472106 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 897/1777] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:30 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:31.399240 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-37321174-3c2f-449d-8d82-f7ebaf1596a0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:31.399933 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-37321174-3c2f-449d-8d82-f7ebaf1596a0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:31.406109 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-37321174-3c2f-449d-8d82-f7ebaf1596a0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:31.406586 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-37321174-3c2f-449d-8d82-f7ebaf1596a0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:31.407347 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-37321174-3c2f-449d-8d82-f7ebaf1596a0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:31.407770 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-37321174-3c2f-449d-8d82-f7ebaf1596a0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:31.531487 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-37321174-3c2f-449d-8d82-f7ebaf1596a0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:31.539152 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-37321174-3c2f-449d-8d82-f7ebaf1596a0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.143528 Oct 29 01:24:31.539725 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 898/1778] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:31 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:31.544144 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-79fa7991-6394-420d-bd1f-0b6ba92d110c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:31.544739 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-79fa7991-6394-420d-bd1f-0b6ba92d110c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:31.553485 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-79fa7991-6394-420d-bd1f-0b6ba92d110c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:31.553926 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-79fa7991-6394-420d-bd1f-0b6ba92d110c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:31.554718 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-79fa7991-6394-420d-bd1f-0b6ba92d110c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:31.555146 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-79fa7991-6394-420d-bd1f-0b6ba92d110c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:31.627227 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-79fa7991-6394-420d-bd1f-0b6ba92d110c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:31.635384 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-79fa7991-6394-420d-bd1f-0b6ba92d110c tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.094664 Oct 29 01:24:31.636039 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 899/1779] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:31 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:32.555928 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-e9ce29c5-70aa-4cb2-8c15-1c5ed82d5382 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:32.556640 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-e9ce29c5-70aa-4cb2-8c15-1c5ed82d5382 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:32.563109 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e9ce29c5-70aa-4cb2-8c15-1c5ed82d5382 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:32.563549 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e9ce29c5-70aa-4cb2-8c15-1c5ed82d5382 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:32.564314 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e9ce29c5-70aa-4cb2-8c15-1c5ed82d5382 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:32.564742 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e9ce29c5-70aa-4cb2-8c15-1c5ed82d5382 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:32.700131 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-e9ce29c5-70aa-4cb2-8c15-1c5ed82d5382 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:32.708416 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-e9ce29c5-70aa-4cb2-8c15-1c5ed82d5382 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.156118 Oct 29 01:24:32.708988 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 900/1780] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:32 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:32.713500 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-83ef90fc-1b2d-4d7e-8028-7d732810b85f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:32.714096 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-83ef90fc-1b2d-4d7e-8028-7d732810b85f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:32.720001 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-83ef90fc-1b2d-4d7e-8028-7d732810b85f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:32.720438 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-83ef90fc-1b2d-4d7e-8028-7d732810b85f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:32.721200 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-83ef90fc-1b2d-4d7e-8028-7d732810b85f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:32.721626 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-83ef90fc-1b2d-4d7e-8028-7d732810b85f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:32.788750 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-83ef90fc-1b2d-4d7e-8028-7d732810b85f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:32.796047 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-83ef90fc-1b2d-4d7e-8028-7d732810b85f tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.086138 Oct 29 01:24:32.796608 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 901/1781] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:32 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:33.726223 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-e0c289c7-aeac-415c-af7c-1b1520db4ece tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:33.726991 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-e0c289c7-aeac-415c-af7c-1b1520db4ece tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:33.732893 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e0c289c7-aeac-415c-af7c-1b1520db4ece tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:33.733338 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e0c289c7-aeac-415c-af7c-1b1520db4ece tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:33.734110 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e0c289c7-aeac-415c-af7c-1b1520db4ece tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:33.734580 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e0c289c7-aeac-415c-af7c-1b1520db4ece tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:33.864527 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-e0c289c7-aeac-415c-af7c-1b1520db4ece tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:33.872012 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-e0c289c7-aeac-415c-af7c-1b1520db4ece tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.150067 Oct 29 01:24:33.872582 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 902/1782] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:33 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:33.876820 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-92908ff3-31b2-41e4-8b7f-1cd1613c76d5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:33.877419 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-92908ff3-31b2-41e4-8b7f-1cd1613c76d5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:33.883137 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-92908ff3-31b2-41e4-8b7f-1cd1613c76d5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:33.883585 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-92908ff3-31b2-41e4-8b7f-1cd1613c76d5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:33.884350 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-92908ff3-31b2-41e4-8b7f-1cd1613c76d5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:33.884784 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-92908ff3-31b2-41e4-8b7f-1cd1613c76d5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:33.945441 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-92908ff3-31b2-41e4-8b7f-1cd1613c76d5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:33.953062 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-92908ff3-31b2-41e4-8b7f-1cd1613c76d5 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.079464 Oct 29 01:24:33.953640 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 903/1783] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:33 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:34.889374 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-52611815-6af4-4660-9ce8-dd913e7f1611 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:34.890077 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-52611815-6af4-4660-9ce8-dd913e7f1611 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:34.896549 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-52611815-6af4-4660-9ce8-dd913e7f1611 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:34.896990 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-52611815-6af4-4660-9ce8-dd913e7f1611 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:34.897760 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-52611815-6af4-4660-9ce8-dd913e7f1611 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:34.898180 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-52611815-6af4-4660-9ce8-dd913e7f1611 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:35.026923 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-52611815-6af4-4660-9ce8-dd913e7f1611 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:35.034699 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-52611815-6af4-4660-9ce8-dd913e7f1611 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.148885 Oct 29 01:24:35.035764 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 904/1784] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:34 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:35.040006 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-4a6eefd5-5eb6-4675-89e8-bd487729f6cb tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:35.040607 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-4a6eefd5-5eb6-4675-89e8-bd487729f6cb tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:35.046794 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4a6eefd5-5eb6-4675-89e8-bd487729f6cb tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:35.047230 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4a6eefd5-5eb6-4675-89e8-bd487729f6cb tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:35.047997 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4a6eefd5-5eb6-4675-89e8-bd487729f6cb tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:35.048423 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4a6eefd5-5eb6-4675-89e8-bd487729f6cb tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:35.109502 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-4a6eefd5-5eb6-4675-89e8-bd487729f6cb tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:35.117717 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-4a6eefd5-5eb6-4675-89e8-bd487729f6cb tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.080964 Oct 29 01:24:35.118290 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 905/1785] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:35 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:36.052898 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-70fbaff1-17d6-4bb9-b39d-94d93dbc2cac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:36.053627 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-70fbaff1-17d6-4bb9-b39d-94d93dbc2cac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:36.061546 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-70fbaff1-17d6-4bb9-b39d-94d93dbc2cac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:36.062197 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-70fbaff1-17d6-4bb9-b39d-94d93dbc2cac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:36.063000 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-70fbaff1-17d6-4bb9-b39d-94d93dbc2cac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:36.063432 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-70fbaff1-17d6-4bb9-b39d-94d93dbc2cac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:36.188740 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-70fbaff1-17d6-4bb9-b39d-94d93dbc2cac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:36.196820 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-70fbaff1-17d6-4bb9-b39d-94d93dbc2cac tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.148088 Oct 29 01:24:36.197396 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 906/1786] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:36 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:36.201747 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-126babbb-1e3b-46de-9cde-5ab7211bd0f8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:36.202351 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-126babbb-1e3b-46de-9cde-5ab7211bd0f8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:36.208589 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-126babbb-1e3b-46de-9cde-5ab7211bd0f8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:36.209090 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-126babbb-1e3b-46de-9cde-5ab7211bd0f8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:36.209809 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-126babbb-1e3b-46de-9cde-5ab7211bd0f8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:36.210266 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-126babbb-1e3b-46de-9cde-5ab7211bd0f8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:36.271716 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-126babbb-1e3b-46de-9cde-5ab7211bd0f8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:36.279066 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-126babbb-1e3b-46de-9cde-5ab7211bd0f8 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.080695 Oct 29 01:24:36.279631 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 907/1787] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:36 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:37.213904 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-77c4e05f-72f0-4111-8bdc-071ebd13d257 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:37.214604 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-77c4e05f-72f0-4111-8bdc-071ebd13d257 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:37.220867 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-77c4e05f-72f0-4111-8bdc-071ebd13d257 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:37.221312 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-77c4e05f-72f0-4111-8bdc-071ebd13d257 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:37.222092 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-77c4e05f-72f0-4111-8bdc-071ebd13d257 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:37.222565 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-77c4e05f-72f0-4111-8bdc-071ebd13d257 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:37.359582 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-77c4e05f-72f0-4111-8bdc-071ebd13d257 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:37.367226 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-77c4e05f-72f0-4111-8bdc-071ebd13d257 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.157332 Oct 29 01:24:37.367810 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 908/1788] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:37 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:37.372217 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ccf419ea-8f28-48d1-9546-785c0284dd7e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:37.372834 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ccf419ea-8f28-48d1-9546-785c0284dd7e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:37.379731 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ccf419ea-8f28-48d1-9546-785c0284dd7e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:37.380180 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ccf419ea-8f28-48d1-9546-785c0284dd7e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:37.380956 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ccf419ea-8f28-48d1-9546-785c0284dd7e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:37.381388 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ccf419ea-8f28-48d1-9546-785c0284dd7e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:37.441935 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-ccf419ea-8f28-48d1-9546-785c0284dd7e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:37.449487 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ccf419ea-8f28-48d1-9546-785c0284dd7e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.080692 Oct 29 01:24:37.450125 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 909/1789] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:37 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:38.383988 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-3ada62d4-8a05-45ba-ad7b-607e08c2cc4e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:38.384685 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-3ada62d4-8a05-45ba-ad7b-607e08c2cc4e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:38.391064 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3ada62d4-8a05-45ba-ad7b-607e08c2cc4e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:38.391502 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3ada62d4-8a05-45ba-ad7b-607e08c2cc4e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:38.392266 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3ada62d4-8a05-45ba-ad7b-607e08c2cc4e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:38.392691 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3ada62d4-8a05-45ba-ad7b-607e08c2cc4e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:38.515992 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-3ada62d4-8a05-45ba-ad7b-607e08c2cc4e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:38.523957 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-3ada62d4-8a05-45ba-ad7b-607e08c2cc4e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.143611 Oct 29 01:24:38.524527 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 910/1790] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:38 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:38.528801 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a59530f5-9101-41ad-a268-69ef0e44e9ce tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:38.529396 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a59530f5-9101-41ad-a268-69ef0e44e9ce tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:38.535829 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a59530f5-9101-41ad-a268-69ef0e44e9ce tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:38.536274 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a59530f5-9101-41ad-a268-69ef0e44e9ce tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:38.537030 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a59530f5-9101-41ad-a268-69ef0e44e9ce tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:38.537457 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a59530f5-9101-41ad-a268-69ef0e44e9ce tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:38.607137 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-a59530f5-9101-41ad-a268-69ef0e44e9ce tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:38.614743 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a59530f5-9101-41ad-a268-69ef0e44e9ce tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.089211 Oct 29 01:24:38.615312 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 911/1791] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:38 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:39.541094 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-5b5bfddc-7a55-48b2-a0b5-b87f370e6a40 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:39.541769 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-5b5bfddc-7a55-48b2-a0b5-b87f370e6a40 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:39.548034 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5b5bfddc-7a55-48b2-a0b5-b87f370e6a40 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:39.548478 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5b5bfddc-7a55-48b2-a0b5-b87f370e6a40 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:39.549252 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5b5bfddc-7a55-48b2-a0b5-b87f370e6a40 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:39.549687 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5b5bfddc-7a55-48b2-a0b5-b87f370e6a40 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:39.677050 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-5b5bfddc-7a55-48b2-a0b5-b87f370e6a40 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:39.684634 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-5b5bfddc-7a55-48b2-a0b5-b87f370e6a40 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.147197 Oct 29 01:24:39.685203 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 912/1792] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:39 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:39.689474 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-933dedb9-b0c7-4252-a695-bba61b44321d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:39.690085 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-933dedb9-b0c7-4252-a695-bba61b44321d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:39.695935 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-933dedb9-b0c7-4252-a695-bba61b44321d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:39.696390 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-933dedb9-b0c7-4252-a695-bba61b44321d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:39.697158 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-933dedb9-b0c7-4252-a695-bba61b44321d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:39.697595 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-933dedb9-b0c7-4252-a695-bba61b44321d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:39.758280 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-933dedb9-b0c7-4252-a695-bba61b44321d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:39.765774 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-933dedb9-b0c7-4252-a695-bba61b44321d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.079599 Oct 29 01:24:39.766352 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 913/1793] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:39 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:40.701126 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-daf66387-616a-4aba-985b-8a4ab4a90d23 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:40.701820 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-daf66387-616a-4aba-985b-8a4ab4a90d23 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:40.708309 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-daf66387-616a-4aba-985b-8a4ab4a90d23 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:40.708754 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-daf66387-616a-4aba-985b-8a4ab4a90d23 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:40.709526 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-daf66387-616a-4aba-985b-8a4ab4a90d23 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:40.709957 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-daf66387-616a-4aba-985b-8a4ab4a90d23 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:40.833753 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-daf66387-616a-4aba-985b-8a4ab4a90d23 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:40.843723 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-daf66387-616a-4aba-985b-8a4ab4a90d23 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.146123 Oct 29 01:24:40.844699 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 914/1794] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:40 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:40.851612 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c628f808-bbd9-46ba-9525-7b09f4016a22 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:40.852530 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c628f808-bbd9-46ba-9525-7b09f4016a22 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:40.860821 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c628f808-bbd9-46ba-9525-7b09f4016a22 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:40.861480 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c628f808-bbd9-46ba-9525-7b09f4016a22 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:40.863147 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c628f808-bbd9-46ba-9525-7b09f4016a22 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:40.863796 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c628f808-bbd9-46ba-9525-7b09f4016a22 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:40.936957 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c628f808-bbd9-46ba-9525-7b09f4016a22 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:40.944519 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c628f808-bbd9-46ba-9525-7b09f4016a22 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.098549 Oct 29 01:24:40.945093 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 915/1795] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:40 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:41.860946 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-13d5601e-490d-40db-93db-04d0a0fe1eb0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:41.861631 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-13d5601e-490d-40db-93db-04d0a0fe1eb0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:41.868983 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-13d5601e-490d-40db-93db-04d0a0fe1eb0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:41.869420 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-13d5601e-490d-40db-93db-04d0a0fe1eb0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:41.870188 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-13d5601e-490d-40db-93db-04d0a0fe1eb0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:41.870646 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-13d5601e-490d-40db-93db-04d0a0fe1eb0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:41.995162 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-13d5601e-490d-40db-93db-04d0a0fe1eb0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:42.002715 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-13d5601e-490d-40db-93db-04d0a0fe1eb0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.145426 Oct 29 01:24:42.003367 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 916/1796] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:41 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:42.007770 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-2e273fc7-46dc-4749-b51c-23117d9a8b2e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:42.008364 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-2e273fc7-46dc-4749-b51c-23117d9a8b2e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:42.014257 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2e273fc7-46dc-4749-b51c-23117d9a8b2e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:42.014916 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2e273fc7-46dc-4749-b51c-23117d9a8b2e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:42.015599 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2e273fc7-46dc-4749-b51c-23117d9a8b2e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:42.016027 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2e273fc7-46dc-4749-b51c-23117d9a8b2e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:42.080051 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-2e273fc7-46dc-4749-b51c-23117d9a8b2e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:42.088709 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-2e273fc7-46dc-4749-b51c-23117d9a8b2e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.084258 Oct 29 01:24:42.089284 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 917/1797] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:42 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:43.019599 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f16b0c26-2bf1-46fa-ba4e-cdf68181790b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:43.020376 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f16b0c26-2bf1-46fa-ba4e-cdf68181790b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:43.026646 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f16b0c26-2bf1-46fa-ba4e-cdf68181790b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:43.027094 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f16b0c26-2bf1-46fa-ba4e-cdf68181790b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:43.027862 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f16b0c26-2bf1-46fa-ba4e-cdf68181790b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:43.028297 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f16b0c26-2bf1-46fa-ba4e-cdf68181790b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:43.154380 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-f16b0c26-2bf1-46fa-ba4e-cdf68181790b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:43.162652 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f16b0c26-2bf1-46fa-ba4e-cdf68181790b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.146657 Oct 29 01:24:43.163224 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 918/1798] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:43 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:43.167620 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-25e767f3-7ec7-4ad1-9a05-aadfeb207b90 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:43.168219 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-25e767f3-7ec7-4ad1-9a05-aadfeb207b90 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:43.174492 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-25e767f3-7ec7-4ad1-9a05-aadfeb207b90 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:43.174945 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-25e767f3-7ec7-4ad1-9a05-aadfeb207b90 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:43.176324 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-25e767f3-7ec7-4ad1-9a05-aadfeb207b90 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:43.176755 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-25e767f3-7ec7-4ad1-9a05-aadfeb207b90 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:43.238274 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-25e767f3-7ec7-4ad1-9a05-aadfeb207b90 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:43.245654 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-25e767f3-7ec7-4ad1-9a05-aadfeb207b90 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.081446 Oct 29 01:24:43.246220 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 919/1799] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:43 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:44.179794 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-08d6b1e5-3d27-4f81-9671-4a6c1157282e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:44.180499 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-08d6b1e5-3d27-4f81-9671-4a6c1157282e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:44.187032 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-08d6b1e5-3d27-4f81-9671-4a6c1157282e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:44.187481 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-08d6b1e5-3d27-4f81-9671-4a6c1157282e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:44.188256 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-08d6b1e5-3d27-4f81-9671-4a6c1157282e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:44.188679 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-08d6b1e5-3d27-4f81-9671-4a6c1157282e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:44.322044 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-08d6b1e5-3d27-4f81-9671-4a6c1157282e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:44.329526 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-08d6b1e5-3d27-4f81-9671-4a6c1157282e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.153485 Oct 29 01:24:44.330098 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 920/1800] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:44 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:44.334384 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-e706552f-9772-427f-9ad5-b514167d1c47 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:44.335007 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-e706552f-9772-427f-9ad5-b514167d1c47 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:44.341029 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e706552f-9772-427f-9ad5-b514167d1c47 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:44.341473 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e706552f-9772-427f-9ad5-b514167d1c47 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:44.342239 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e706552f-9772-427f-9ad5-b514167d1c47 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:44.342700 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e706552f-9772-427f-9ad5-b514167d1c47 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:44.402643 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-e706552f-9772-427f-9ad5-b514167d1c47 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:44.410494 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-e706552f-9772-427f-9ad5-b514167d1c47 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.079354 Oct 29 01:24:44.411091 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 921/1801] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:44 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:45.346788 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-17cfb59c-a91a-49e5-a769-f3989ca11a31 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:45.348011 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-17cfb59c-a91a-49e5-a769-f3989ca11a31 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:45.354295 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-17cfb59c-a91a-49e5-a769-f3989ca11a31 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:45.354781 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-17cfb59c-a91a-49e5-a769-f3989ca11a31 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:45.355559 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-17cfb59c-a91a-49e5-a769-f3989ca11a31 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:45.355995 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-17cfb59c-a91a-49e5-a769-f3989ca11a31 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:45.485421 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-17cfb59c-a91a-49e5-a769-f3989ca11a31 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:45.492928 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-17cfb59c-a91a-49e5-a769-f3989ca11a31 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.149812 Oct 29 01:24:45.493493 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 922/1802] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:45 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:45.498964 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-63d409cd-5633-4cd6-a579-e76a76f19a28 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:45.499566 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-63d409cd-5633-4cd6-a579-e76a76f19a28 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:45.506000 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-63d409cd-5633-4cd6-a579-e76a76f19a28 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:45.506497 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-63d409cd-5633-4cd6-a579-e76a76f19a28 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:45.507270 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-63d409cd-5633-4cd6-a579-e76a76f19a28 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:45.507702 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-63d409cd-5633-4cd6-a579-e76a76f19a28 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:45.569217 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-63d409cd-5633-4cd6-a579-e76a76f19a28 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:45.576734 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-63d409cd-5633-4cd6-a579-e76a76f19a28 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.082266 Oct 29 01:24:45.577304 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 923/1803] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:45 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:46.509698 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-0ea3e48a-477c-4188-a07a-c451e0e98b3b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:46.510373 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-0ea3e48a-477c-4188-a07a-c451e0e98b3b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:46.516585 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0ea3e48a-477c-4188-a07a-c451e0e98b3b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:46.517031 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0ea3e48a-477c-4188-a07a-c451e0e98b3b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:46.517800 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0ea3e48a-477c-4188-a07a-c451e0e98b3b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:46.518231 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0ea3e48a-477c-4188-a07a-c451e0e98b3b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:46.640450 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-0ea3e48a-477c-4188-a07a-c451e0e98b3b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:46.647913 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-0ea3e48a-477c-4188-a07a-c451e0e98b3b tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.141876 Oct 29 01:24:46.648480 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 924/1804] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:46 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:46.652709 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-27121182-7736-4706-afce-a39722b84a4d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:46.653310 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-27121182-7736-4706-afce-a39722b84a4d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:46.660028 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-27121182-7736-4706-afce-a39722b84a4d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:46.660504 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-27121182-7736-4706-afce-a39722b84a4d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:46.661234 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-27121182-7736-4706-afce-a39722b84a4d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:46.661668 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-27121182-7736-4706-afce-a39722b84a4d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:46.726006 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-27121182-7736-4706-afce-a39722b84a4d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:46.734688 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-27121182-7736-4706-afce-a39722b84a4d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.085226 Oct 29 01:24:46.735256 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 925/1805] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:46 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:47.664931 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-152c3af0-1f5f-4821-a508-01f9155342ff tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:47.665646 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-152c3af0-1f5f-4821-a508-01f9155342ff tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:47.671947 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-152c3af0-1f5f-4821-a508-01f9155342ff tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:47.672394 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-152c3af0-1f5f-4821-a508-01f9155342ff tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:47.673179 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-152c3af0-1f5f-4821-a508-01f9155342ff tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:47.673612 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-152c3af0-1f5f-4821-a508-01f9155342ff tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:47.798460 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-152c3af0-1f5f-4821-a508-01f9155342ff tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:47.806059 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-152c3af0-1f5f-4821-a508-01f9155342ff tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.144763 Oct 29 01:24:47.806664 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 926/1806] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:47 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:47.810936 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-e34a66c5-3d85-4f38-82c9-46a285047843 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:47.811542 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-e34a66c5-3d85-4f38-82c9-46a285047843 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:47.818188 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e34a66c5-3d85-4f38-82c9-46a285047843 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:47.818604 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e34a66c5-3d85-4f38-82c9-46a285047843 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:47.819317 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e34a66c5-3d85-4f38-82c9-46a285047843 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:47.819789 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e34a66c5-3d85-4f38-82c9-46a285047843 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:47.882629 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-e34a66c5-3d85-4f38-82c9-46a285047843 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:47.890087 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-e34a66c5-3d85-4f38-82c9-46a285047843 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.082442 Oct 29 01:24:47.890872 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 927/1807] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:47 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:48.823030 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a285b328-47bd-4768-b816-93e53cc3a837 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:48.823030 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a285b328-47bd-4768-b816-93e53cc3a837 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:48.830039 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a285b328-47bd-4768-b816-93e53cc3a837 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:48.830554 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a285b328-47bd-4768-b816-93e53cc3a837 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:48.831382 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a285b328-47bd-4768-b816-93e53cc3a837 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:48.832308 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a285b328-47bd-4768-b816-93e53cc3a837 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:48.953993 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-a285b328-47bd-4768-b816-93e53cc3a837 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:48.962549 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a285b328-47bd-4768-b816-93e53cc3a837 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.143194 Oct 29 01:24:48.963133 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 928/1808] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:48 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:48.967502 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-29d51ebf-9f75-419e-b2ab-66d11b64c6aa tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:48.968110 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-29d51ebf-9f75-419e-b2ab-66d11b64c6aa tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:48.975098 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-29d51ebf-9f75-419e-b2ab-66d11b64c6aa tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:48.975552 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-29d51ebf-9f75-419e-b2ab-66d11b64c6aa tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:48.976353 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-29d51ebf-9f75-419e-b2ab-66d11b64c6aa tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:48.976787 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-29d51ebf-9f75-419e-b2ab-66d11b64c6aa tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:49.045245 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-29d51ebf-9f75-419e-b2ab-66d11b64c6aa tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:49.061468 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-29d51ebf-9f75-419e-b2ab-66d11b64c6aa tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.097288 Oct 29 01:24:49.062040 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 929/1809] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:48 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:49.983437 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f9d91c08-2089-4ace-b982-bc7eac56aa59 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:49.984104 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f9d91c08-2089-4ace-b982-bc7eac56aa59 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:49.991308 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f9d91c08-2089-4ace-b982-bc7eac56aa59 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:49.991756 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f9d91c08-2089-4ace-b982-bc7eac56aa59 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:49.992661 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f9d91c08-2089-4ace-b982-bc7eac56aa59 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:49.993006 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f9d91c08-2089-4ace-b982-bc7eac56aa59 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:50.116361 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-f9d91c08-2089-4ace-b982-bc7eac56aa59 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:50.124046 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f9d91c08-2089-4ace-b982-bc7eac56aa59 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.144225 Oct 29 01:24:50.124626 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 930/1810] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:49 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:50.128891 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-25242544-e5ad-41be-a3bf-4d2b0a7d5b08 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:50.129491 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-25242544-e5ad-41be-a3bf-4d2b0a7d5b08 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:50.135492 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-25242544-e5ad-41be-a3bf-4d2b0a7d5b08 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:50.135936 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-25242544-e5ad-41be-a3bf-4d2b0a7d5b08 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:50.136706 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-25242544-e5ad-41be-a3bf-4d2b0a7d5b08 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:50.137137 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-25242544-e5ad-41be-a3bf-4d2b0a7d5b08 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:50.197397 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-25242544-e5ad-41be-a3bf-4d2b0a7d5b08 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:50.204951 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-25242544-e5ad-41be-a3bf-4d2b0a7d5b08 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.079353 Oct 29 01:24:50.205528 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 931/1811] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:50 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:51.140790 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d7d225ea-63ca-4f18-b3b0-4ebe3a5b8448 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:51.141465 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d7d225ea-63ca-4f18-b3b0-4ebe3a5b8448 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:51.148349 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d7d225ea-63ca-4f18-b3b0-4ebe3a5b8448 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:51.148791 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d7d225ea-63ca-4f18-b3b0-4ebe3a5b8448 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:51.149555 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d7d225ea-63ca-4f18-b3b0-4ebe3a5b8448 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:51.149983 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d7d225ea-63ca-4f18-b3b0-4ebe3a5b8448 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:51.290863 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-d7d225ea-63ca-4f18-b3b0-4ebe3a5b8448 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:51.298084 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d7d225ea-63ca-4f18-b3b0-4ebe3a5b8448 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.160955 Oct 29 01:24:51.298894 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 932/1812] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:51 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:51.303419 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ccb04d4b-9067-4e1b-9d52-ee14d5e0e52e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:51.304030 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ccb04d4b-9067-4e1b-9d52-ee14d5e0e52e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:51.309788 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ccb04d4b-9067-4e1b-9d52-ee14d5e0e52e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:51.310244 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ccb04d4b-9067-4e1b-9d52-ee14d5e0e52e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:51.311261 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ccb04d4b-9067-4e1b-9d52-ee14d5e0e52e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:51.311703 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ccb04d4b-9067-4e1b-9d52-ee14d5e0e52e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:51.374009 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-ccb04d4b-9067-4e1b-9d52-ee14d5e0e52e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:51.387548 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ccb04d4b-9067-4e1b-9d52-ee14d5e0e52e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.087765 Oct 29 01:24:51.388120 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 933/1813] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:51 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:52.314975 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-af846611-e2a1-4cd0-8a48-e2cc8aad0ec0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:52.315624 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-af846611-e2a1-4cd0-8a48-e2cc8aad0ec0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:52.322412 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-af846611-e2a1-4cd0-8a48-e2cc8aad0ec0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:52.322883 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-af846611-e2a1-4cd0-8a48-e2cc8aad0ec0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:52.323654 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-af846611-e2a1-4cd0-8a48-e2cc8aad0ec0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:52.324076 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-af846611-e2a1-4cd0-8a48-e2cc8aad0ec0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:52.448448 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-af846611-e2a1-4cd0-8a48-e2cc8aad0ec0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:52.455982 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-af846611-e2a1-4cd0-8a48-e2cc8aad0ec0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.144751 Oct 29 01:24:52.456555 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 934/1814] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:52 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:52.461033 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-0209f17e-8a98-45fc-a301-35fad3c6da70 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:52.461624 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-0209f17e-8a98-45fc-a301-35fad3c6da70 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:52.467553 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0209f17e-8a98-45fc-a301-35fad3c6da70 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:52.467996 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0209f17e-8a98-45fc-a301-35fad3c6da70 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:52.471574 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0209f17e-8a98-45fc-a301-35fad3c6da70 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:52.471574 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0209f17e-8a98-45fc-a301-35fad3c6da70 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:52.531874 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-0209f17e-8a98-45fc-a301-35fad3c6da70 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:52.540640 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-0209f17e-8a98-45fc-a301-35fad3c6da70 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.082796 Oct 29 01:24:52.541234 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 935/1815] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:52 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:53.473812 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ccc0d904-be18-4213-8cab-8220f1a95f9f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:53.474553 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ccc0d904-be18-4213-8cab-8220f1a95f9f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:53.480793 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ccc0d904-be18-4213-8cab-8220f1a95f9f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:53.481238 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ccc0d904-be18-4213-8cab-8220f1a95f9f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:53.482012 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ccc0d904-be18-4213-8cab-8220f1a95f9f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:53.482463 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ccc0d904-be18-4213-8cab-8220f1a95f9f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:53.609212 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-ccc0d904-be18-4213-8cab-8220f1a95f9f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:53.616890 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ccc0d904-be18-4213-8cab-8220f1a95f9f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.147317 Oct 29 01:24:53.617460 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 936/1816] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:53 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:53.621784 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-8edca473-1071-46aa-824a-e887bcf1639b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:53.622380 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-8edca473-1071-46aa-824a-e887bcf1639b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:53.628527 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8edca473-1071-46aa-824a-e887bcf1639b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:53.628973 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8edca473-1071-46aa-824a-e887bcf1639b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:53.629745 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8edca473-1071-46aa-824a-e887bcf1639b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:53.630175 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8edca473-1071-46aa-824a-e887bcf1639b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:53.691942 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-8edca473-1071-46aa-824a-e887bcf1639b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:53.699467 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-8edca473-1071-46aa-824a-e887bcf1639b tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.081040 Oct 29 01:24:53.700035 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 937/1817] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:53 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:54.634806 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b8bc150f-09cd-4981-9d6c-414e45aa48d5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:54.635505 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b8bc150f-09cd-4981-9d6c-414e45aa48d5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:54.641747 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b8bc150f-09cd-4981-9d6c-414e45aa48d5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:54.642184 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b8bc150f-09cd-4981-9d6c-414e45aa48d5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:54.642968 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b8bc150f-09cd-4981-9d6c-414e45aa48d5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:54.643393 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b8bc150f-09cd-4981-9d6c-414e45aa48d5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:54.765271 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-b8bc150f-09cd-4981-9d6c-414e45aa48d5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:54.773597 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b8bc150f-09cd-4981-9d6c-414e45aa48d5 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.142477 Oct 29 01:24:54.774179 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 938/1818] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:54 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:54.778629 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-988b1b01-e29d-43e4-854c-d6b743c67a94 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:54.779238 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-988b1b01-e29d-43e4-854c-d6b743c67a94 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:54.785245 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-988b1b01-e29d-43e4-854c-d6b743c67a94 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:54.785696 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-988b1b01-e29d-43e4-854c-d6b743c67a94 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:54.786551 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-988b1b01-e29d-43e4-854c-d6b743c67a94 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:54.786992 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-988b1b01-e29d-43e4-854c-d6b743c67a94 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:54.852567 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-988b1b01-e29d-43e4-854c-d6b743c67a94 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:54.860055 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-988b1b01-e29d-43e4-854c-d6b743c67a94 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.084798 Oct 29 01:24:54.860638 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 939/1819] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:54 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:55.793396 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-261547d5-8128-4716-9802-8b337053c262 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:55.793396 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-261547d5-8128-4716-9802-8b337053c262 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:55.799974 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-261547d5-8128-4716-9802-8b337053c262 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:55.800424 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-261547d5-8128-4716-9802-8b337053c262 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:55.801195 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-261547d5-8128-4716-9802-8b337053c262 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:55.801627 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-261547d5-8128-4716-9802-8b337053c262 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:55.930610 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-261547d5-8128-4716-9802-8b337053c262 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:55.943180 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-261547d5-8128-4716-9802-8b337053c262 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.155460 Oct 29 01:24:55.943764 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 940/1820] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:55 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:55.948104 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-dc177bae-da6a-45a7-84f2-31b915dee9ff tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:55.948700 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-dc177bae-da6a-45a7-84f2-31b915dee9ff tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:55.954887 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dc177bae-da6a-45a7-84f2-31b915dee9ff tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:55.955332 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dc177bae-da6a-45a7-84f2-31b915dee9ff tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:55.956104 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dc177bae-da6a-45a7-84f2-31b915dee9ff tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:55.957163 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dc177bae-da6a-45a7-84f2-31b915dee9ff tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:56.017821 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-dc177bae-da6a-45a7-84f2-31b915dee9ff tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:56.025886 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-dc177bae-da6a-45a7-84f2-31b915dee9ff tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.081168 Oct 29 01:24:56.026647 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 941/1821] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:55 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:56.960192 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-743982f5-c8e2-4033-a490-dbf46cbae90d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:56.960816 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-743982f5-c8e2-4033-a490-dbf46cbae90d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:56.967284 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-743982f5-c8e2-4033-a490-dbf46cbae90d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:56.967732 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-743982f5-c8e2-4033-a490-dbf46cbae90d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:56.968504 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-743982f5-c8e2-4033-a490-dbf46cbae90d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:56.968937 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-743982f5-c8e2-4033-a490-dbf46cbae90d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:57.091680 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-743982f5-c8e2-4033-a490-dbf46cbae90d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:57.102665 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-743982f5-c8e2-4033-a490-dbf46cbae90d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.146268 Oct 29 01:24:57.103256 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 942/1822] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:56 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:57.107698 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-1363c3cb-8a1d-4ced-b559-c2fb8cf621a2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:57.108292 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-1363c3cb-8a1d-4ced-b559-c2fb8cf621a2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:57.114062 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1363c3cb-8a1d-4ced-b559-c2fb8cf621a2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:57.114532 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1363c3cb-8a1d-4ced-b559-c2fb8cf621a2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:57.115298 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1363c3cb-8a1d-4ced-b559-c2fb8cf621a2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:57.115728 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1363c3cb-8a1d-4ced-b559-c2fb8cf621a2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:57.179315 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-1363c3cb-8a1d-4ced-b559-c2fb8cf621a2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:57.186816 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-1363c3cb-8a1d-4ced-b559-c2fb8cf621a2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.082565 Oct 29 01:24:57.187387 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 943/1823] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:57 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:58.119591 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-e8dced25-18df-497e-9cbb-e856050c0d0c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:58.120271 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-e8dced25-18df-497e-9cbb-e856050c0d0c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:58.126732 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e8dced25-18df-497e-9cbb-e856050c0d0c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:58.127184 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e8dced25-18df-497e-9cbb-e856050c0d0c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:58.127984 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e8dced25-18df-497e-9cbb-e856050c0d0c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:58.128416 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e8dced25-18df-497e-9cbb-e856050c0d0c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:58.253938 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-e8dced25-18df-497e-9cbb-e856050c0d0c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:58.261491 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-e8dced25-18df-497e-9cbb-e856050c0d0c tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.145616 Oct 29 01:24:58.262074 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 944/1824] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:58 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:58.266525 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-133f5e1a-e71f-4b82-8aca-3ce7711aabb0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:58.267130 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-133f5e1a-e71f-4b82-8aca-3ce7711aabb0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:58.274150 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-133f5e1a-e71f-4b82-8aca-3ce7711aabb0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:58.274631 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-133f5e1a-e71f-4b82-8aca-3ce7711aabb0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:58.275393 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-133f5e1a-e71f-4b82-8aca-3ce7711aabb0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:58.275849 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-133f5e1a-e71f-4b82-8aca-3ce7711aabb0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:58.337613 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-133f5e1a-e71f-4b82-8aca-3ce7711aabb0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:58.345230 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-133f5e1a-e71f-4b82-8aca-3ce7711aabb0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.082094 Oct 29 01:24:58.345824 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 945/1825] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:58 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:59.279217 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-86e964a2-3975-4323-8310-8586329ee25e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:59.279904 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-86e964a2-3975-4323-8310-8586329ee25e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:59.286788 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-86e964a2-3975-4323-8310-8586329ee25e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:59.287239 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-86e964a2-3975-4323-8310-8586329ee25e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:59.288009 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-86e964a2-3975-4323-8310-8586329ee25e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:59.288452 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-86e964a2-3975-4323-8310-8586329ee25e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:59.418712 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-86e964a2-3975-4323-8310-8586329ee25e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:59.426946 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-86e964a2-3975-4323-8310-8586329ee25e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.151334 Oct 29 01:24:59.427536 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 946/1826] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:59 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:59.432160 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-71bbb881-62aa-42a2-9a51-9594108865b2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:59.432781 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-71bbb881-62aa-42a2-9a51-9594108865b2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:24:59.438620 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-71bbb881-62aa-42a2-9a51-9594108865b2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:59.439068 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-71bbb881-62aa-42a2-9a51-9594108865b2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:59.439842 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-71bbb881-62aa-42a2-9a51-9594108865b2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:24:59.440276 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-71bbb881-62aa-42a2-9a51-9594108865b2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:24:59.500668 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-71bbb881-62aa-42a2-9a51-9594108865b2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:59.508030 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-71bbb881-62aa-42a2-9a51-9594108865b2 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.079419 Oct 29 01:24:59.508607 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 947/1827] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:24:59 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:00.443850 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-0eabb1ea-ee70-4052-a60c-308ef4e32e66 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:00.444555 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-0eabb1ea-ee70-4052-a60c-308ef4e32e66 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:25:00.450808 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0eabb1ea-ee70-4052-a60c-308ef4e32e66 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:25:00.451260 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0eabb1ea-ee70-4052-a60c-308ef4e32e66 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:25:00.452032 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0eabb1ea-ee70-4052-a60c-308ef4e32e66 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:25:00.452467 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0eabb1ea-ee70-4052-a60c-308ef4e32e66 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:25:00.574960 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-0eabb1ea-ee70-4052-a60c-308ef4e32e66 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:00.582254 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-0eabb1ea-ee70-4052-a60c-308ef4e32e66 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.142107 Oct 29 01:25:00.582852 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 948/1828] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:25:00 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:25:00.587274 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-0ed8b2bc-d720-47fb-af63-24ffdad73871 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:00.587868 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-0ed8b2bc-d720-47fb-af63-24ffdad73871 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:25:00.593424 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0ed8b2bc-d720-47fb-af63-24ffdad73871 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:25:00.593865 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0ed8b2bc-d720-47fb-af63-24ffdad73871 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:25:00.594652 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0ed8b2bc-d720-47fb-af63-24ffdad73871 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:25:00.595084 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0ed8b2bc-d720-47fb-af63-24ffdad73871 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:25:00.662361 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-0ed8b2bc-d720-47fb-af63-24ffdad73871 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:00.670351 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-0ed8b2bc-d720-47fb-af63-24ffdad73871 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.086521 Oct 29 01:25:00.670947 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 949/1829] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:25:00 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:01.600485 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b34e57fd-8562-42dd-bdef-ee8531374a94 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:01.601178 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b34e57fd-8562-42dd-bdef-ee8531374a94 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:25:01.607439 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b34e57fd-8562-42dd-bdef-ee8531374a94 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:25:01.607879 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b34e57fd-8562-42dd-bdef-ee8531374a94 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:25:01.608755 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b34e57fd-8562-42dd-bdef-ee8531374a94 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:25:01.609202 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b34e57fd-8562-42dd-bdef-ee8531374a94 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:25:01.735390 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-b34e57fd-8562-42dd-bdef-ee8531374a94 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:01.743283 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b34e57fd-8562-42dd-bdef-ee8531374a94 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.147036 Oct 29 01:25:01.743865 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 950/1830] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:25:01 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:25:01.748100 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-18590837-f84e-4466-b3e5-b29808cc66e4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:01.748702 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-18590837-f84e-4466-b3e5-b29808cc66e4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:25:01.755133 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-18590837-f84e-4466-b3e5-b29808cc66e4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:25:01.755586 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-18590837-f84e-4466-b3e5-b29808cc66e4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:25:01.756355 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-18590837-f84e-4466-b3e5-b29808cc66e4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:25:01.756796 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-18590837-f84e-4466-b3e5-b29808cc66e4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:25:01.817550 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-18590837-f84e-4466-b3e5-b29808cc66e4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:01.825072 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-18590837-f84e-4466-b3e5-b29808cc66e4 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.080245 Oct 29 01:25:01.825643 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 951/1831] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:25:01 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:02.759973 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-6ae4e434-2e92-4efb-a18d-fd9fe253e2c0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:02.760653 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-6ae4e434-2e92-4efb-a18d-fd9fe253e2c0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:25:02.767495 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6ae4e434-2e92-4efb-a18d-fd9fe253e2c0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:25:02.767932 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6ae4e434-2e92-4efb-a18d-fd9fe253e2c0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:25:02.769342 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6ae4e434-2e92-4efb-a18d-fd9fe253e2c0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:25:02.769766 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6ae4e434-2e92-4efb-a18d-fd9fe253e2c0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:25:02.891954 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-6ae4e434-2e92-4efb-a18d-fd9fe253e2c0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:02.900121 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-6ae4e434-2e92-4efb-a18d-fd9fe253e2c0 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.143769 Oct 29 01:25:02.901010 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 952/1832] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:25:02 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:25:02.905568 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f87fac48-3139-4fd4-9caa-8416649a3209 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:02.906171 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f87fac48-3139-4fd4-9caa-8416649a3209 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:25:02.912315 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f87fac48-3139-4fd4-9caa-8416649a3209 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:25:02.912757 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f87fac48-3139-4fd4-9caa-8416649a3209 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:25:02.913518 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f87fac48-3139-4fd4-9caa-8416649a3209 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:25:02.913944 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f87fac48-3139-4fd4-9caa-8416649a3209 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:25:02.977509 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-f87fac48-3139-4fd4-9caa-8416649a3209 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:02.985198 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f87fac48-3139-4fd4-9caa-8416649a3209 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.083077 Oct 29 01:25:02.985798 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 953/1833] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:25:02 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:03.917286 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-abb8b105-3971-489f-a193-a930114fd492 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:03.917977 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-abb8b105-3971-489f-a193-a930114fd492 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:25:03.924023 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-abb8b105-3971-489f-a193-a930114fd492 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:25:03.924575 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-abb8b105-3971-489f-a193-a930114fd492 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:25:03.925347 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-abb8b105-3971-489f-a193-a930114fd492 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:25:03.925779 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-abb8b105-3971-489f-a193-a930114fd492 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:25:04.050159 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-abb8b105-3971-489f-a193-a930114fd492 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:04.057672 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-abb8b105-3971-489f-a193-a930114fd492 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.144058 Oct 29 01:25:04.058250 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 954/1834] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:25:03 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:25:04.062494 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-47f37eac-8e1d-4d2d-b86b-b5786089e696 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:04.063093 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-47f37eac-8e1d-4d2d-b86b-b5786089e696 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:25:04.068856 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-47f37eac-8e1d-4d2d-b86b-b5786089e696 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:25:04.069297 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-47f37eac-8e1d-4d2d-b86b-b5786089e696 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:25:04.070053 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-47f37eac-8e1d-4d2d-b86b-b5786089e696 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:25:04.070520 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-47f37eac-8e1d-4d2d-b86b-b5786089e696 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:25:04.131177 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-47f37eac-8e1d-4d2d-b86b-b5786089e696 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:04.138623 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-47f37eac-8e1d-4d2d-b86b-b5786089e696 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.079363 Oct 29 01:25:04.139193 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 955/1835] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:25:04 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:05.074736 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-83870ebd-e5a6-4f4e-96ab-2e59d0787f1d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:05.075409 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-83870ebd-e5a6-4f4e-96ab-2e59d0787f1d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:25:05.081669 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-83870ebd-e5a6-4f4e-96ab-2e59d0787f1d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:25:05.082118 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-83870ebd-e5a6-4f4e-96ab-2e59d0787f1d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:25:05.082920 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-83870ebd-e5a6-4f4e-96ab-2e59d0787f1d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:25:05.083358 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-83870ebd-e5a6-4f4e-96ab-2e59d0787f1d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:25:05.210381 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-83870ebd-e5a6-4f4e-96ab-2e59d0787f1d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:05.217668 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-83870ebd-e5a6-4f4e-96ab-2e59d0787f1d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.146592 Oct 29 01:25:05.218229 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 956/1836] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:25:05 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:25:05.222962 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-85ee402c-f133-4e17-9d7a-b9ec613eff22 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:05.223558 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-85ee402c-f133-4e17-9d7a-b9ec613eff22 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:25:05.229188 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-85ee402c-f133-4e17-9d7a-b9ec613eff22 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:25:05.229626 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-85ee402c-f133-4e17-9d7a-b9ec613eff22 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:25:05.230414 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-85ee402c-f133-4e17-9d7a-b9ec613eff22 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:25:05.230835 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-85ee402c-f133-4e17-9d7a-b9ec613eff22 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:25:05.294475 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-85ee402c-f133-4e17-9d7a-b9ec613eff22 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:05.302029 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-85ee402c-f133-4e17-9d7a-b9ec613eff22 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.082821 Oct 29 01:25:05.302622 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 957/1837] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:25:05 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:06.235706 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-20531176-82a6-4244-a303-326b462e0c53 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:06.236358 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-20531176-82a6-4244-a303-326b462e0c53 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:25:06.243100 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-20531176-82a6-4244-a303-326b462e0c53 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:25:06.243539 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-20531176-82a6-4244-a303-326b462e0c53 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:25:06.244299 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-20531176-82a6-4244-a303-326b462e0c53 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:25:06.244728 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-20531176-82a6-4244-a303-326b462e0c53 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:25:06.366721 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-20531176-82a6-4244-a303-326b462e0c53 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:06.374441 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-20531176-82a6-4244-a303-326b462e0c53 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.142988 Oct 29 01:25:06.375059 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 958/1838] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:25:06 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:25:06.379948 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ed4a0911-f112-4f7e-81e2-270518fa6442 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:06.380545 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ed4a0911-f112-4f7e-81e2-270518fa6442 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:25:06.386351 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ed4a0911-f112-4f7e-81e2-270518fa6442 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:25:06.386821 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ed4a0911-f112-4f7e-81e2-270518fa6442 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:25:06.387582 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ed4a0911-f112-4f7e-81e2-270518fa6442 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:25:06.388008 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ed4a0911-f112-4f7e-81e2-270518fa6442 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:25:06.450599 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-ed4a0911-f112-4f7e-81e2-270518fa6442 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:06.458315 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ed4a0911-f112-4f7e-81e2-270518fa6442 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.082277 Oct 29 01:25:06.458916 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 959/1839] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:25:06 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:07.391924 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-02a44a83-2401-4c6e-a4fd-532fb16bce5d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:07.392621 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-02a44a83-2401-4c6e-a4fd-532fb16bce5d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:25:07.398839 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-02a44a83-2401-4c6e-a4fd-532fb16bce5d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:25:07.399282 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-02a44a83-2401-4c6e-a4fd-532fb16bce5d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:25:07.400033 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-02a44a83-2401-4c6e-a4fd-532fb16bce5d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:25:07.400461 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-02a44a83-2401-4c6e-a4fd-532fb16bce5d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:25:07.527497 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-02a44a83-2401-4c6e-a4fd-532fb16bce5d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:07.535677 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-02a44a83-2401-4c6e-a4fd-532fb16bce5d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.147449 Oct 29 01:25:07.536932 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 960/1840] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:25:07 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:25:07.541578 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-e428d25e-a8fc-4a0a-8f7c-17ff3b4d45e1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:07.542227 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-e428d25e-a8fc-4a0a-8f7c-17ff3b4d45e1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:25:07.548361 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e428d25e-a8fc-4a0a-8f7c-17ff3b4d45e1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:25:07.548802 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e428d25e-a8fc-4a0a-8f7c-17ff3b4d45e1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:25:07.549565 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e428d25e-a8fc-4a0a-8f7c-17ff3b4d45e1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:25:07.549992 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e428d25e-a8fc-4a0a-8f7c-17ff3b4d45e1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:25:07.609939 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-e428d25e-a8fc-4a0a-8f7c-17ff3b4d45e1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:07.617385 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-e428d25e-a8fc-4a0a-8f7c-17ff3b4d45e1 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.079300 Oct 29 01:25:07.617977 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 961/1841] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:25:07 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:08.553822 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-fcb741a7-74a7-4abf-aabd-b6c1035a4cc6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:08.554542 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-fcb741a7-74a7-4abf-aabd-b6c1035a4cc6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:25:08.560837 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fcb741a7-74a7-4abf-aabd-b6c1035a4cc6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:25:08.561288 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fcb741a7-74a7-4abf-aabd-b6c1035a4cc6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:25:08.562065 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fcb741a7-74a7-4abf-aabd-b6c1035a4cc6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:25:08.562526 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fcb741a7-74a7-4abf-aabd-b6c1035a4cc6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:25:08.689136 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-fcb741a7-74a7-4abf-aabd-b6c1035a4cc6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:08.696805 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-fcb741a7-74a7-4abf-aabd-b6c1035a4cc6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.147219 Oct 29 01:25:08.697387 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 962/1842] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:25:08 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:25:08.701665 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-359a54a6-21cd-472b-95dc-8c177d2eac0d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:08.702265 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-359a54a6-21cd-472b-95dc-8c177d2eac0d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:25:08.708150 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-359a54a6-21cd-472b-95dc-8c177d2eac0d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:25:08.708604 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-359a54a6-21cd-472b-95dc-8c177d2eac0d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:25:08.709373 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-359a54a6-21cd-472b-95dc-8c177d2eac0d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:25:08.710068 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-359a54a6-21cd-472b-95dc-8c177d2eac0d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:25:08.770431 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-359a54a6-21cd-472b-95dc-8c177d2eac0d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:08.781927 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-359a54a6-21cd-472b-95dc-8c177d2eac0d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.083225 Oct 29 01:25:08.782994 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 963/1843] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:25:08 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:09.714037 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-cccdbda5-d870-4584-b6eb-7a994c2633f4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:09.714737 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-cccdbda5-d870-4584-b6eb-7a994c2633f4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:25:09.721149 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cccdbda5-d870-4584-b6eb-7a994c2633f4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:25:09.721598 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cccdbda5-d870-4584-b6eb-7a994c2633f4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:25:09.722376 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cccdbda5-d870-4584-b6eb-7a994c2633f4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:25:09.722839 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cccdbda5-d870-4584-b6eb-7a994c2633f4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:25:09.851314 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-cccdbda5-d870-4584-b6eb-7a994c2633f4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:09.859056 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-cccdbda5-d870-4584-b6eb-7a994c2633f4 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.148652 Oct 29 01:25:09.859642 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 964/1844] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:25:09 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:25:09.864534 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f998ad2a-a6b1-4abe-886c-986ed925d4b0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:09.865137 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f998ad2a-a6b1-4abe-886c-986ed925d4b0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:25:09.871026 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f998ad2a-a6b1-4abe-886c-986ed925d4b0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:25:09.871474 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f998ad2a-a6b1-4abe-886c-986ed925d4b0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:25:09.872252 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f998ad2a-a6b1-4abe-886c-986ed925d4b0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:25:09.872684 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f998ad2a-a6b1-4abe-886c-986ed925d4b0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:25:09.934853 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-f998ad2a-a6b1-4abe-886c-986ed925d4b0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:09.943392 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f998ad2a-a6b1-4abe-886c-986ed925d4b0 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.082714 Oct 29 01:25:09.943970 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 965/1845] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:25:09 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:10.876680 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-0ef787d0-7663-4e84-8b27-28d77c2c1777 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:10.877357 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-0ef787d0-7663-4e84-8b27-28d77c2c1777 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:25:10.884200 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0ef787d0-7663-4e84-8b27-28d77c2c1777 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:25:10.884642 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0ef787d0-7663-4e84-8b27-28d77c2c1777 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:25:10.885404 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0ef787d0-7663-4e84-8b27-28d77c2c1777 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:25:10.885831 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0ef787d0-7663-4e84-8b27-28d77c2c1777 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:25:11.021991 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-0ef787d0-7663-4e84-8b27-28d77c2c1777 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:11.029661 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-0ef787d0-7663-4e84-8b27-28d77c2c1777 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.156658 Oct 29 01:25:11.030233 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 966/1846] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:25:10 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:25:11.035011 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-229d36f1-8039-4fa0-a4e8-2504bacb9358 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:11.035618 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-229d36f1-8039-4fa0-a4e8-2504bacb9358 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:25:11.041399 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-229d36f1-8039-4fa0-a4e8-2504bacb9358 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:25:11.041844 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-229d36f1-8039-4fa0-a4e8-2504bacb9358 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:25:11.042639 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-229d36f1-8039-4fa0-a4e8-2504bacb9358 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:25:11.043074 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-229d36f1-8039-4fa0-a4e8-2504bacb9358 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:25:11.106732 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-229d36f1-8039-4fa0-a4e8-2504bacb9358 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:11.114878 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-229d36f1-8039-4fa0-a4e8-2504bacb9358 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.083615 Oct 29 01:25:11.115461 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 967/1847] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:25:11 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:11.763501 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-da6305a0-e7f2-471e-b447-6c5e63a9629c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:11.763982 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-da6305a0-e7f2-471e-b447-6c5e63a9629c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:25:11.771024 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-da6305a0-e7f2-471e-b447-6c5e63a9629c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:25:11.771471 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-da6305a0-e7f2-471e-b447-6c5e63a9629c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:25:11.772365 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-da6305a0-e7f2-471e-b447-6c5e63a9629c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:25:11.772801 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-da6305a0-e7f2-471e-b447-6c5e63a9629c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:26:00.725447 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:26:00.726313 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: Fri Oct 29 01:26:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf (ip 10.222.0.90) !!! Oct 29 01:26:00.853734 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:26:00.854343 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: Fri Oct 29 01:26:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf (ip 10.222.0.90) !!! Oct 29 01:26:03.043757 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:26:03.044422 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: Fri Oct 29 01:26:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf (ip 10.222.0.90) !!! Oct 29 01:26:11.819351 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.objects.instance [None req-d8b7b90c-7633-419d-8ebb-3d5ad9496082 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lazy-loading 'services' on Instance uuid 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d {{(pid=115748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:26:12.019417 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.objects.instance [None req-da6305a0-e7f2-471e-b447-6c5e63a9629c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lazy-loading 'services' on Instance uuid 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d {{(pid=115747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:26:16.284040 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:26:16.284743 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: Fri Oct 29 01:26:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf (ip 10.222.0.90) !!! Oct 29 01:26:42.257560 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:26:42.258171 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: Fri Oct 29 01:26:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf (ip 10.222.0.90) !!! Oct 29 01:27:27.754124 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:27:27.754820 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: Fri Oct 29 01:27:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf (ip 10.222.0.90) !!! Oct 29 01:28:12.390561 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d8b7b90c-7633-419d-8ebb-3d5ad9496082 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "DELETE /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf" status: 202 len: 0 microversion: 2.1 time: 240.689407 Oct 29 01:28:12.391232 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 881/1848] 10.222.0.90 () {58 vars in 1415 bytes} [Fri Oct 29 01:24:11 2021] DELETE /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf => generated 0 bytes in 240691 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:28:12.397102 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-711b5da7-0be4-4dce-9cf0-e32cea7526a6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:12.397813 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-711b5da7-0be4-4dce-9cf0-e32cea7526a6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:28:12.404439 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-711b5da7-0be4-4dce-9cf0-e32cea7526a6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:28:12.404894 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-711b5da7-0be4-4dce-9cf0-e32cea7526a6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:28:12.405684 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-711b5da7-0be4-4dce-9cf0-e32cea7526a6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:28:12.406115 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-711b5da7-0be4-4dce-9cf0-e32cea7526a6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:28:12.477463 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.wsgi [None req-da6305a0-e7f2-471e-b447-6c5e63a9629c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cbcaf23f-9484-4c28-aeba-eddcc065b991) Oct 29 01:28:12.478078 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-da6305a0-e7f2-471e-b447-6c5e63a9629c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cbcaf23f-9484-4c28-aeba-eddcc065b991) {{(pid=115747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:28:12.479064 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-da6305a0-e7f2-471e-b447-6c5e63a9629c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "DELETE /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf" status: 400 len: 269 microversion: 2.1 time: 180.719317 Oct 29 01:28:12.479998 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 968/1849] 10.222.0.90 () {58 vars in 1415 bytes} [Fri Oct 29 01:25:11 2021] DELETE /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf => generated 269 bytes in 180721 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 29 01:28:12.546944 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-711b5da7-0be4-4dce-9cf0-e32cea7526a6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:12.554870 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-711b5da7-0be4-4dce-9cf0-e32cea7526a6 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.162445 Oct 29 01:28:12.555440 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 882/1850] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:28:12 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:12.561327 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e96da5c8-7b2a-41fa-b132-9a5512bc485c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:12.563568 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-e96da5c8-7b2a-41fa-b132-9a5512bc485c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:28:12.571549 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e96da5c8-7b2a-41fa-b132-9a5512bc485c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:28:12.572106 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e96da5c8-7b2a-41fa-b132-9a5512bc485c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:28:12.572906 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e96da5c8-7b2a-41fa-b132-9a5512bc485c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:28:12.573660 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e96da5c8-7b2a-41fa-b132-9a5512bc485c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:28:12.631785 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-cf791010-7fca-40f6-af58-848cacda3946 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:12.632405 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-cf791010-7fca-40f6-af58-848cacda3946 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:28:12.638536 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cf791010-7fca-40f6-af58-848cacda3946 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:28:12.638987 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cf791010-7fca-40f6-af58-848cacda3946 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:28:12.639770 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cf791010-7fca-40f6-af58-848cacda3946 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:28:12.640432 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cf791010-7fca-40f6-af58-848cacda3946 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:28:12.706249 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-cf791010-7fca-40f6-af58-848cacda3946 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:12.713912 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-cf791010-7fca-40f6-af58-848cacda3946 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.232980 Oct 29 01:28:12.714514 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 969/1851] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:28:12 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:12.719480 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-819999f9-b3d3-4aba-b56c-e00af910e592 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:12.720075 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-819999f9-b3d3-4aba-b56c-e00af910e592 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:28:12.726218 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-819999f9-b3d3-4aba-b56c-e00af910e592 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:28:12.726638 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-819999f9-b3d3-4aba-b56c-e00af910e592 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:28:12.727426 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-819999f9-b3d3-4aba-b56c-e00af910e592 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:28:12.727864 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-819999f9-b3d3-4aba-b56c-e00af910e592 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:28:12.852340 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-819999f9-b3d3-4aba-b56c-e00af910e592 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:12.860350 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-819999f9-b3d3-4aba-b56c-e00af910e592 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1450 microversion: 2.1 time: 0.144739 Oct 29 01:28:12.861139 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 970/1852] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:28:12 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1450 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:12.865237 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-1ebd0cf6-6524-4425-9daa-9cbab8f6c095 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:12.865840 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-1ebd0cf6-6524-4425-9daa-9cbab8f6c095 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:28:12.871557 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1ebd0cf6-6524-4425-9daa-9cbab8f6c095 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:28:12.872056 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1ebd0cf6-6524-4425-9daa-9cbab8f6c095 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:28:12.872813 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1ebd0cf6-6524-4425-9daa-9cbab8f6c095 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:28:12.873250 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1ebd0cf6-6524-4425-9daa-9cbab8f6c095 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:28:12.934524 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-1ebd0cf6-6524-4425-9daa-9cbab8f6c095 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:12.942026 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-1ebd0cf6-6524-4425-9daa-9cbab8f6c095 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.080146 Oct 29 01:28:12.942633 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 971/1853] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:28:12 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:12.947003 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a12f8b80-5c3f-403e-ab56-7b4ba3c17cf6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:12.947495 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a12f8b80-5c3f-403e-ab56-7b4ba3c17cf6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:28:12.953640 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a12f8b80-5c3f-403e-ab56-7b4ba3c17cf6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:28:12.954081 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a12f8b80-5c3f-403e-ab56-7b4ba3c17cf6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:28:12.955153 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a12f8b80-5c3f-403e-ab56-7b4ba3c17cf6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:28:12.955595 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a12f8b80-5c3f-403e-ab56-7b4ba3c17cf6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:20.745554 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:29:20.746303 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: Fri Oct 29 01:29:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf (ip 10.222.0.90) !!! Oct 29 01:29:20.873015 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:29:20.873695 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: Fri Oct 29 01:29:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf (ip 10.222.0.90) !!! Oct 29 01:29:23.061382 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:29:23.062105 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: Fri Oct 29 01:29:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf (ip 10.222.0.90) !!! Oct 29 01:29:36.304556 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:29:36.305087 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: Fri Oct 29 01:29:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf (ip 10.222.0.90) !!! Oct 29 01:30:12.721592 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.objects.instance [None req-e96da5c8-7b2a-41fa-b132-9a5512bc485c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lazy-loading 'services' on Instance uuid 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d {{(pid=115748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:30:12.760253 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.objects.instance [None req-a12f8b80-5c3f-403e-ab56-7b4ba3c17cf6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lazy-loading 'services' on Instance uuid 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d {{(pid=115747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:30:47.772757 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:30:47.773455 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: Fri Oct 29 01:30:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf (ip 10.222.0.90) !!! Oct 29 01:32:12.969818 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.wsgi [None req-e96da5c8-7b2a-41fa-b132-9a5512bc485c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f0ddc3c4-a565-4d05-a89c-72141fa81539) Oct 29 01:32:12.970651 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e96da5c8-7b2a-41fa-b132-9a5512bc485c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f0ddc3c4-a565-4d05-a89c-72141fa81539) {{(pid=115748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:32:12.971688 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-e96da5c8-7b2a-41fa-b132-9a5512bc485c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "DELETE /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf" status: 400 len: 269 microversion: 2.1 time: 240.414828 Oct 29 01:32:12.972709 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: Fri Oct 29 01:32:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf (ip 10.222.0.90) !!! Oct 29 01:32:12.972709 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: Fri Oct 29 01:32:12 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf (10.222.0.90) Oct 29 01:32:12.973721 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: CRITICAL nova [None req-e96da5c8-7b2a-41fa-b132-9a5512bc485c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Unhandled error: OSError: write error Oct 29 01:32:12.973721 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: ERROR nova OSError: write error Oct 29 01:32:12.973721 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: ERROR nova Oct 29 01:32:12.974095 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 883/1854] 10.222.0.90 () {58 vars in 1415 bytes} [Fri Oct 29 01:28:12 2021] DELETE /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf => generated 0 bytes in 240418 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Oct 29 01:32:12.979132 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-1393c4aa-1df1-44e5-94f2-4538231b5529 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:12.979816 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-1393c4aa-1df1-44e5-94f2-4538231b5529 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:12.986870 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1393c4aa-1df1-44e5-94f2-4538231b5529 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:12.987416 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1393c4aa-1df1-44e5-94f2-4538231b5529 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:12.988187 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1393c4aa-1df1-44e5-94f2-4538231b5529 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:12.988659 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1393c4aa-1df1-44e5-94f2-4538231b5529 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:13.001248 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.wsgi [None req-a12f8b80-5c3f-403e-ab56-7b4ba3c17cf6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-23f22761-a23f-4019-84bb-87c787daa49c) Oct 29 01:32:13.001891 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a12f8b80-5c3f-403e-ab56-7b4ba3c17cf6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-23f22761-a23f-4019-84bb-87c787daa49c) {{(pid=115747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:32:13.003302 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a12f8b80-5c3f-403e-ab56-7b4ba3c17cf6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "DELETE /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf" status: 400 len: 269 microversion: 2.1 time: 240.059195 Oct 29 01:32:13.003302 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: Fri Oct 29 01:32:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf (ip 10.222.0.90) !!! Oct 29 01:32:13.003302 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: Fri Oct 29 01:32:13 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf (10.222.0.90) Oct 29 01:32:13.004402 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: CRITICAL nova [None req-a12f8b80-5c3f-403e-ab56-7b4ba3c17cf6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Unhandled error: OSError: write error Oct 29 01:32:13.004402 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: ERROR nova OSError: write error Oct 29 01:32:13.004402 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: ERROR nova Oct 29 01:32:13.004664 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 972/1855] 10.222.0.90 () {58 vars in 1415 bytes} [Fri Oct 29 01:28:12 2021] DELETE /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf => generated 0 bytes in 240061 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Oct 29 01:32:13.009682 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-e7210df4-2f6f-46fb-b078-920bc0f43099 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:13.010289 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-e7210df4-2f6f-46fb-b078-920bc0f43099 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:13.019685 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e7210df4-2f6f-46fb-b078-920bc0f43099 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:13.020010 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e7210df4-2f6f-46fb-b078-920bc0f43099 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:13.020981 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e7210df4-2f6f-46fb-b078-920bc0f43099 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:13.021730 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e7210df4-2f6f-46fb-b078-920bc0f43099 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:13.052650 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-1393c4aa-1df1-44e5-94f2-4538231b5529 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:13.066563 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-1393c4aa-1df1-44e5-94f2-4538231b5529 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1213 microversion: 2.1 time: 0.091465 Oct 29 01:32:13.067529 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: Fri Oct 29 01:32:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd (ip 10.222.0.90) !!! Oct 29 01:32:13.067529 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: Fri Oct 29 01:32:13 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd (10.222.0.90) Oct 29 01:32:13.067710 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: CRITICAL nova [None req-1393c4aa-1df1-44e5-94f2-4538231b5529 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Unhandled error: OSError: write error Oct 29 01:32:13.067710 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: ERROR nova OSError: write error Oct 29 01:32:13.067710 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: ERROR nova Oct 29 01:32:13.067940 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 884/1856] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:12 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 0 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Oct 29 01:32:13.072564 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-870c2f19-2388-451a-ae5c-d6ec7dbd3ba3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:13.072928 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-870c2f19-2388-451a-ae5c-d6ec7dbd3ba3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:13.079464 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-870c2f19-2388-451a-ae5c-d6ec7dbd3ba3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:13.079910 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-870c2f19-2388-451a-ae5c-d6ec7dbd3ba3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:13.080695 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-870c2f19-2388-451a-ae5c-d6ec7dbd3ba3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:13.081126 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-870c2f19-2388-451a-ae5c-d6ec7dbd3ba3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:13.101277 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-e7210df4-2f6f-46fb-b078-920bc0f43099 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:13.109157 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-e7210df4-2f6f-46fb-b078-920bc0f43099 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.103682 Oct 29 01:32:13.109779 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: Fri Oct 29 01:32:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde (ip 10.222.0.90) !!! Oct 29 01:32:13.109779 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: Fri Oct 29 01:32:13 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde (10.222.0.90) Oct 29 01:32:13.110459 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: CRITICAL nova [None req-e7210df4-2f6f-46fb-b078-920bc0f43099 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Unhandled error: OSError: write error Oct 29 01:32:13.110459 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: ERROR nova OSError: write error Oct 29 01:32:13.110459 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: ERROR nova Oct 29 01:32:13.110723 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 973/1857] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:13 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 0 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Oct 29 01:32:13.115423 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-2e5ae9a2-627c-4da3-a97b-2d03b2ea595d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:13.116019 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-2e5ae9a2-627c-4da3-a97b-2d03b2ea595d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:13.121522 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2e5ae9a2-627c-4da3-a97b-2d03b2ea595d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:13.121964 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2e5ae9a2-627c-4da3-a97b-2d03b2ea595d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:13.122776 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2e5ae9a2-627c-4da3-a97b-2d03b2ea595d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:13.123245 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2e5ae9a2-627c-4da3-a97b-2d03b2ea595d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:13.181149 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-2e5ae9a2-627c-4da3-a97b-2d03b2ea595d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:13.188546 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-2e5ae9a2-627c-4da3-a97b-2d03b2ea595d tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1213 microversion: 2.1 time: 0.076447 Oct 29 01:32:13.189118 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 974/1858] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:13 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1213 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:13.193260 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-5c1715c2-284a-4f7b-a95b-382eec18d47e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:13.193854 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-5c1715c2-284a-4f7b-a95b-382eec18d47e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:13.199556 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5c1715c2-284a-4f7b-a95b-382eec18d47e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:13.199986 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5c1715c2-284a-4f7b-a95b-382eec18d47e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:13.200744 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5c1715c2-284a-4f7b-a95b-382eec18d47e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:13.201827 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5c1715c2-284a-4f7b-a95b-382eec18d47e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:13.265079 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-5c1715c2-284a-4f7b-a95b-382eec18d47e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe886b061dd447649b65fc919fb6dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd9f9783640477abd2d011a323a6f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:13.273204 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-5c1715c2-284a-4f7b-a95b-382eec18d47e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 200 len: 1225 microversion: 2.1 time: 0.082956 Oct 29 01:32:13.273784 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 975/1859] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:13 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:13.278258 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-44171799-00b2-430f-816a-60bf589af9a1 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:13.278772 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-44171799-00b2-430f-816a-60bf589af9a1 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:13.284631 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-44171799-00b2-430f-816a-60bf589af9a1 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:13.285074 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-44171799-00b2-430f-816a-60bf589af9a1 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:13.285851 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-44171799-00b2-430f-816a-60bf589af9a1 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:13.286282 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-44171799-00b2-430f-816a-60bf589af9a1 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:40.762942 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:32:40.763690 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: Fri Oct 29 01:32:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf (ip 10.222.0.90) !!! Oct 29 01:32:40.891117 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:32:40.891742 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: Fri Oct 29 01:32:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf (ip 10.222.0.90) !!! Oct 29 01:32:43.078591 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:32:43.079217 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: Fri Oct 29 01:32:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf (ip 10.222.0.90) !!! Oct 29 01:32:56.321513 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:32:56.322052 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: Fri Oct 29 01:32:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf (ip 10.222.0.90) !!! Oct 29 01:33:22.279848 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:33:22.280315 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: Fri Oct 29 01:33:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf (ip 10.222.0.90) !!! Oct 29 01:34:07.790837 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:34:07.791372 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: Fri Oct 29 01:34:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf (ip 10.222.0.90) !!! Oct 29 01:34:11.806743 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.objects.instance [None req-870c2f19-2388-451a-ae5c-d6ec7dbd3ba3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lazy-loading 'services' on Instance uuid 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d {{(pid=115748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:34:11.889349 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.objects.instance [None req-44171799-00b2-430f-816a-60bf589af9a1 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lazy-loading 'services' on Instance uuid 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d {{(pid=115747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:34:13.333585 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.wsgi [None req-870c2f19-2388-451a-ae5c-d6ec7dbd3ba3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-80cde2cb-fb67-47a7-8a36-0fee247e6301) Oct 29 01:34:13.334234 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-870c2f19-2388-451a-ae5c-d6ec7dbd3ba3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-80cde2cb-fb67-47a7-8a36-0fee247e6301) {{(pid=115748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:34:13.335120 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-870c2f19-2388-451a-ae5c-d6ec7dbd3ba3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "DELETE /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf" status: 400 len: 269 microversion: 2.1 time: 120.266481 Oct 29 01:34:13.335627 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: Fri Oct 29 01:34:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf (ip 10.222.0.90) !!! Oct 29 01:34:13.335627 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: Fri Oct 29 01:34:13 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf (10.222.0.90) Oct 29 01:34:13.336299 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: CRITICAL nova [None req-870c2f19-2388-451a-ae5c-d6ec7dbd3ba3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Unhandled error: OSError: write error Oct 29 01:34:13.336299 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: ERROR nova OSError: write error Oct 29 01:34:13.336299 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: ERROR nova Oct 29 01:34:13.336299 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 885/1860] 10.222.0.90 () {58 vars in 1415 bytes} [Fri Oct 29 01:32:13 2021] DELETE /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf => generated 0 bytes in 120268 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Oct 29 01:34:13.341234 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-10529b77-3cae-4c2f-a25b-894d7459b048 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:13.341863 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-10529b77-3cae-4c2f-a25b-894d7459b048 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:13.348144 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-10529b77-3cae-4c2f-a25b-894d7459b048 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:13.348592 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-10529b77-3cae-4c2f-a25b-894d7459b048 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:13.349369 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-10529b77-3cae-4c2f-a25b-894d7459b048 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:13.349809 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-10529b77-3cae-4c2f-a25b-894d7459b048 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:13.365921 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.wsgi [None req-44171799-00b2-430f-816a-60bf589af9a1 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-57d67c55-d7b1-4667-bf68-c14070f48f34) Oct 29 01:34:13.366566 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-44171799-00b2-430f-816a-60bf589af9a1 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-57d67c55-d7b1-4667-bf68-c14070f48f34) {{(pid=115747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:34:13.367401 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-44171799-00b2-430f-816a-60bf589af9a1 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "DELETE /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf" status: 400 len: 269 microversion: 2.1 time: 120.092727 Oct 29 01:34:13.368497 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: Fri Oct 29 01:34:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf (ip 10.222.0.90) !!! Oct 29 01:34:13.368497 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: Fri Oct 29 01:34:13 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf (10.222.0.90) Oct 29 01:34:13.368938 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: CRITICAL nova [None req-44171799-00b2-430f-816a-60bf589af9a1 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Unhandled error: OSError: write error Oct 29 01:34:13.368938 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: ERROR nova OSError: write error Oct 29 01:34:13.368938 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: ERROR nova Oct 29 01:34:13.369177 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 976/1861] 10.222.0.90 () {58 vars in 1415 bytes} [Fri Oct 29 01:32:13 2021] DELETE /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf => generated 0 bytes in 120095 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Oct 29 01:34:13.426583 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-10529b77-3cae-4c2f-a25b-894d7459b048 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:13.435003 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-10529b77-3cae-4c2f-a25b-894d7459b048 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1213 microversion: 2.1 time: 0.097764 Oct 29 01:34:13.435602 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: Fri Oct 29 01:34:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd (ip 10.222.0.90) !!! Oct 29 01:34:13.435602 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: Fri Oct 29 01:34:13 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd (10.222.0.90) Oct 29 01:34:13.436178 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: CRITICAL nova [None req-10529b77-3cae-4c2f-a25b-894d7459b048 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Unhandled error: OSError: write error Oct 29 01:34:13.436178 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: ERROR nova OSError: write error Oct 29 01:34:13.436178 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: ERROR nova Oct 29 01:34:13.436450 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 886/1862] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:34:13 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 0 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Oct 29 01:34:13.440913 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c945a13e-67d6-4dbd-83ad-1840327ba649 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:13.441398 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c945a13e-67d6-4dbd-83ad-1840327ba649 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:13.447528 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-137f2fbf-1901-4c6f-88e6-f4a04d7b6872 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:13.447712 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c945a13e-67d6-4dbd-83ad-1840327ba649 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:13.448010 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c945a13e-67d6-4dbd-83ad-1840327ba649 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:13.448271 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-137f2fbf-1901-4c6f-88e6-f4a04d7b6872 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:13.448769 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c945a13e-67d6-4dbd-83ad-1840327ba649 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:13.449202 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c945a13e-67d6-4dbd-83ad-1840327ba649 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:13.454744 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-137f2fbf-1901-4c6f-88e6-f4a04d7b6872 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:13.455198 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-137f2fbf-1901-4c6f-88e6-f4a04d7b6872 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:13.455967 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-137f2fbf-1901-4c6f-88e6-f4a04d7b6872 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:13.456405 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-137f2fbf-1901-4c6f-88e6-f4a04d7b6872 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:13.470048 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.wsgi [None req-137f2fbf-1901-4c6f-88e6-f4a04d7b6872 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] HTTP exception thrown: Instance 11a30efc-58bb-4139-a2ca-1712680c7fde could not be found. Oct 29 01:34:13.470668 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-137f2fbf-1901-4c6f-88e6-f4a04d7b6872 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Returning 404 to user: Instance 11a30efc-58bb-4139-a2ca-1712680c7fde could not be found. {{(pid=115747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:34:13.471499 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-137f2fbf-1901-4c6f-88e6-f4a04d7b6872 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 404 len: 111 microversion: 2.1 time: 0.101580 Oct 29 01:34:13.471996 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: Fri Oct 29 01:34:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde (ip 10.222.0.90) !!! Oct 29 01:34:13.471996 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: Fri Oct 29 01:34:13 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde (10.222.0.90) Oct 29 01:34:13.472569 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: CRITICAL nova [None req-137f2fbf-1901-4c6f-88e6-f4a04d7b6872 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Unhandled error: OSError: write error Oct 29 01:34:13.472569 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: ERROR nova OSError: write error Oct 29 01:34:13.472569 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: ERROR nova Oct 29 01:34:13.472834 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 977/1863] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:34:13 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 0 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Oct 29 01:34:13.476998 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-dfc9e92d-b951-4d2e-83df-79ca7bdaee54 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:13.477598 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-dfc9e92d-b951-4d2e-83df-79ca7bdaee54 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:13.483381 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dfc9e92d-b951-4d2e-83df-79ca7bdaee54 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:13.483832 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dfc9e92d-b951-4d2e-83df-79ca7bdaee54 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:13.484593 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dfc9e92d-b951-4d2e-83df-79ca7bdaee54 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:13.485026 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dfc9e92d-b951-4d2e-83df-79ca7bdaee54 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:13.545244 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-dfc9e92d-b951-4d2e-83df-79ca7bdaee54 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:13.552563 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-dfc9e92d-b951-4d2e-83df-79ca7bdaee54 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1213 microversion: 2.1 time: 0.078892 Oct 29 01:34:13.553130 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 978/1864] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:34:13 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:13.557845 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-3b168f54-ad9a-499a-8e6b-d59e106fe991 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:13.558454 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-3b168f54-ad9a-499a-8e6b-d59e106fe991 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:13.563649 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3b168f54-ad9a-499a-8e6b-d59e106fe991 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:13.564118 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3b168f54-ad9a-499a-8e6b-d59e106fe991 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:13.564872 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3b168f54-ad9a-499a-8e6b-d59e106fe991 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:13.565548 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3b168f54-ad9a-499a-8e6b-d59e106fe991 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:13.578077 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.wsgi [None req-3b168f54-ad9a-499a-8e6b-d59e106fe991 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] HTTP exception thrown: Instance 11a30efc-58bb-4139-a2ca-1712680c7fde could not be found. Oct 29 01:34:13.578673 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-3b168f54-ad9a-499a-8e6b-d59e106fe991 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Returning 404 to user: Instance 11a30efc-58bb-4139-a2ca-1712680c7fde could not be found. {{(pid=115747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:34:13.579451 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-3b168f54-ad9a-499a-8e6b-d59e106fe991 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 404 len: 111 microversion: 2.1 time: 0.025444 Oct 29 01:34:13.579949 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 979/1865] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:34:13 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:34:13.583942 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-98692214-5f6a-4e0f-96c4-ca563e86646c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:13.584415 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-98692214-5f6a-4e0f-96c4-ca563e86646c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:13.589639 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-98692214-5f6a-4e0f-96c4-ca563e86646c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:13.590073 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-98692214-5f6a-4e0f-96c4-ca563e86646c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:13.590846 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-98692214-5f6a-4e0f-96c4-ca563e86646c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:13.591270 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-98692214-5f6a-4e0f-96c4-ca563e86646c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:13.604229 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.wsgi [None req-98692214-5f6a-4e0f-96c4-ca563e86646c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] HTTP exception thrown: Instance 27a73464-dcac-4be6-a392-58d40a0296a8 could not be found. Oct 29 01:34:13.604789 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-98692214-5f6a-4e0f-96c4-ca563e86646c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Returning 404 to user: Instance 27a73464-dcac-4be6-a392-58d40a0296a8 could not be found. {{(pid=115747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:34:13.605577 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-98692214-5f6a-4e0f-96c4-ca563e86646c tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "DELETE /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 404 len: 111 microversion: 2.1 time: 0.024787 Oct 29 01:34:13.606076 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 980/1866] 10.222.0.90 () {58 vars in 1238 bytes} [Fri Oct 29 01:34:13 2021] DELETE /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:34:13.610218 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-675936e9-3034-41f0-910b-9e457abffafc tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:13.610720 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-675936e9-3034-41f0-910b-9e457abffafc tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:13.615951 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-675936e9-3034-41f0-910b-9e457abffafc tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:13.616388 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-675936e9-3034-41f0-910b-9e457abffafc tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:13.617124 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-675936e9-3034-41f0-910b-9e457abffafc tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:13.618124 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-675936e9-3034-41f0-910b-9e457abffafc tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:00.780218 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:36:00.780956 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: Fri Oct 29 01:36:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf (ip 10.222.0.90) !!! Oct 29 01:36:00.908952 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:36:00.909522 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: Fri Oct 29 01:36:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf (ip 10.222.0.90) !!! Oct 29 01:36:03.095862 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:36:03.096562 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: Fri Oct 29 01:36:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf (ip 10.222.0.90) !!! Oct 29 01:36:12.007167 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.objects.instance [None req-c945a13e-67d6-4dbd-83ad-1840327ba649 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lazy-loading 'services' on Instance uuid 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d {{(pid=115748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:36:12.047867 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.objects.instance [None req-675936e9-3034-41f0-910b-9e457abffafc tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lazy-loading 'services' on Instance uuid 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d {{(pid=115747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:36:13.466818 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.wsgi [None req-c945a13e-67d6-4dbd-83ad-1840327ba649 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-77b2bb4a-e611-4bd1-9dfc-e72948fe37ce) Oct 29 01:36:13.467824 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c945a13e-67d6-4dbd-83ad-1840327ba649 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-77b2bb4a-e611-4bd1-9dfc-e72948fe37ce) {{(pid=115748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:36:13.468877 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c945a13e-67d6-4dbd-83ad-1840327ba649 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "DELETE /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf" status: 400 len: 269 microversion: 2.1 time: 120.031586 Oct 29 01:36:13.469825 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: Fri Oct 29 01:36:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf (ip 10.222.0.90) !!! Oct 29 01:36:13.469825 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: Fri Oct 29 01:36:13 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf (10.222.0.90) Oct 29 01:36:13.471142 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: CRITICAL nova [None req-c945a13e-67d6-4dbd-83ad-1840327ba649 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Unhandled error: OSError: write error Oct 29 01:36:13.471142 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: ERROR nova OSError: write error Oct 29 01:36:13.471142 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: ERROR nova Oct 29 01:36:13.471618 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 887/1867] 10.222.0.90 () {58 vars in 1415 bytes} [Fri Oct 29 01:34:13 2021] DELETE /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf => generated 0 bytes in 120034 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Oct 29 01:36:13.477825 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c089cfcd-6e4e-49c9-9930-abcd5a4f354f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:13.478452 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c089cfcd-6e4e-49c9-9930-abcd5a4f354f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:13.485444 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c089cfcd-6e4e-49c9-9930-abcd5a4f354f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:13.485927 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c089cfcd-6e4e-49c9-9930-abcd5a4f354f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:13.488827 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c089cfcd-6e4e-49c9-9930-abcd5a4f354f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:13.488827 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c089cfcd-6e4e-49c9-9930-abcd5a4f354f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:13.501722 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.wsgi [None req-675936e9-3034-41f0-910b-9e457abffafc tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1e36dc64-d495-487a-8708-94a3f34aadf7) Oct 29 01:36:13.502328 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-675936e9-3034-41f0-910b-9e457abffafc tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1e36dc64-d495-487a-8708-94a3f34aadf7) {{(pid=115747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:36:13.503229 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-675936e9-3034-41f0-910b-9e457abffafc tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "DELETE /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf" status: 400 len: 269 microversion: 2.1 time: 119.896248 Oct 29 01:36:13.503740 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: Fri Oct 29 01:36:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf (ip 10.222.0.90) !!! Oct 29 01:36:13.503740 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: Fri Oct 29 01:36:13 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf (10.222.0.90) Oct 29 01:36:13.504526 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: CRITICAL nova [None req-675936e9-3034-41f0-910b-9e457abffafc tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Unhandled error: OSError: write error Oct 29 01:36:13.504526 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: ERROR nova OSError: write error Oct 29 01:36:13.504526 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: ERROR nova Oct 29 01:36:13.504526 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 981/1868] 10.222.0.90 () {58 vars in 1415 bytes} [Fri Oct 29 01:34:13 2021] DELETE /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf => generated 0 bytes in 119898 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Oct 29 01:36:13.512410 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c1d22a7c-78a7-453f-826c-d5f929f0157e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:13.513023 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c1d22a7c-78a7-453f-826c-d5f929f0157e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:13.520323 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c1d22a7c-78a7-453f-826c-d5f929f0157e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:13.520775 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c1d22a7c-78a7-453f-826c-d5f929f0157e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:13.522091 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c1d22a7c-78a7-453f-826c-d5f929f0157e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:13.522875 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c1d22a7c-78a7-453f-826c-d5f929f0157e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:13.538914 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.wsgi [None req-c1d22a7c-78a7-453f-826c-d5f929f0157e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] HTTP exception thrown: Instance 11a30efc-58bb-4139-a2ca-1712680c7fde could not be found. Oct 29 01:36:13.539506 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c1d22a7c-78a7-453f-826c-d5f929f0157e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Returning 404 to user: Instance 11a30efc-58bb-4139-a2ca-1712680c7fde could not be found. {{(pid=115747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:36:13.540650 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c1d22a7c-78a7-453f-826c-d5f929f0157e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 404 len: 111 microversion: 2.1 time: 0.035232 Oct 29 01:36:13.541163 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: Fri Oct 29 01:36:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde (ip 10.222.0.90) !!! Oct 29 01:36:13.541163 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: Fri Oct 29 01:36:13 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde (10.222.0.90) Oct 29 01:36:13.541730 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: CRITICAL nova [None req-c1d22a7c-78a7-453f-826c-d5f929f0157e tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Unhandled error: OSError: write error Oct 29 01:36:13.541730 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: ERROR nova OSError: write error Oct 29 01:36:13.541730 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: ERROR nova Oct 29 01:36:13.542002 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 982/1869] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:13 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 0 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Oct 29 01:36:13.555373 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-c089cfcd-6e4e-49c9-9930-abcd5a4f354f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:13.574031 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c089cfcd-6e4e-49c9-9930-abcd5a4f354f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1213 microversion: 2.1 time: 0.101400 Oct 29 01:36:13.574796 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: Fri Oct 29 01:36:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd (ip 10.222.0.90) !!! Oct 29 01:36:13.574796 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: Fri Oct 29 01:36:13 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd (10.222.0.90) Oct 29 01:36:13.575494 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: CRITICAL nova [None req-c089cfcd-6e4e-49c9-9930-abcd5a4f354f tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Unhandled error: OSError: write error Oct 29 01:36:13.575494 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: ERROR nova OSError: write error Oct 29 01:36:13.575494 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: ERROR nova Oct 29 01:36:13.575765 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 888/1870] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:13 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 0 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Oct 29 01:36:13.581177 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-18fe5585-696f-426b-92f5-a3113bd4ba46 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:13.581904 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-18fe5585-696f-426b-92f5-a3113bd4ba46 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:13.590059 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-18fe5585-696f-426b-92f5-a3113bd4ba46 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:13.590059 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-18fe5585-696f-426b-92f5-a3113bd4ba46 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:13.590439 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-18fe5585-696f-426b-92f5-a3113bd4ba46 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:13.591039 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-18fe5585-696f-426b-92f5-a3113bd4ba46 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:13.637440 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a6db246f-0fbe-45ea-a1f0-f96270a2fb76 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:13.637946 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a6db246f-0fbe-45ea-a1f0-f96270a2fb76 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:13.650229 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a6db246f-0fbe-45ea-a1f0-f96270a2fb76 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:13.650708 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a6db246f-0fbe-45ea-a1f0-f96270a2fb76 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:13.651479 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a6db246f-0fbe-45ea-a1f0-f96270a2fb76 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:13.652064 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a6db246f-0fbe-45ea-a1f0-f96270a2fb76 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:13.666692 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.wsgi [None req-a6db246f-0fbe-45ea-a1f0-f96270a2fb76 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] HTTP exception thrown: Instance 27a73464-dcac-4be6-a392-58d40a0296a8 could not be found. Oct 29 01:36:13.667399 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a6db246f-0fbe-45ea-a1f0-f96270a2fb76 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Returning 404 to user: Instance 27a73464-dcac-4be6-a392-58d40a0296a8 could not be found. {{(pid=115747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:36:13.668239 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a6db246f-0fbe-45ea-a1f0-f96270a2fb76 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "DELETE /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 404 len: 111 microversion: 2.1 time: 0.125522 Oct 29 01:36:13.668772 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 983/1871] 10.222.0.90 () {58 vars in 1238 bytes} [Fri Oct 29 01:36:13 2021] DELETE /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:36:13.673024 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-3aa8616d-9fbb-4ac7-ac79-f19c47a88a55 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:13.673628 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-3aa8616d-9fbb-4ac7-ac79-f19c47a88a55 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:13.680126 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3aa8616d-9fbb-4ac7-ac79-f19c47a88a55 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:13.680566 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3aa8616d-9fbb-4ac7-ac79-f19c47a88a55 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:13.681361 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3aa8616d-9fbb-4ac7-ac79-f19c47a88a55 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:13.681787 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3aa8616d-9fbb-4ac7-ac79-f19c47a88a55 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:13.743214 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-3aa8616d-9fbb-4ac7-ac79-f19c47a88a55 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:13.750755 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-3aa8616d-9fbb-4ac7-ac79-f19c47a88a55 tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1213 microversion: 2.1 time: 0.080971 Oct 29 01:36:13.751329 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 984/1872] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:13 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:13.813001 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [req-156dc930-6eb2-43c8-9d7d-38e72b99c80a req-5902884a-aa50-4109-9a11-97ad4d73e80d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd", "name": "network-vif-deleted", "tag": "8d56de6a-a409-4dde-8299-b4d26a45fc41"}]} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:36:13.815176 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:36:13.815176 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: warnings.warn(msg) Oct 29 01:36:13.822555 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-156dc930-6eb2-43c8-9d7d-38e72b99c80a req-5902884a-aa50-4109-9a11-97ad4d73e80d service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:13.823000 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-156dc930-6eb2-43c8-9d7d-38e72b99c80a req-5902884a-aa50-4109-9a11-97ad4d73e80d service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:13.836401 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.compute.server_external_events [req-156dc930-6eb2-43c8-9d7d-38e72b99c80a req-5902884a-aa50-4109-9a11-97ad4d73e80d service nova] Creating event network-vif-deleted:8d56de6a-a409-4dde-8299-b4d26a45fc41 for instance efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd on hv-cinder-81558 Oct 29 01:36:13.839768 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: ERROR oslo.messaging._drivers.impl_rabbit [req-156dc930-6eb2-43c8-9d7d-38e72b99c80a req-5902884a-aa50-4109-9a11-97ad4d73e80d service nova] [cc9a536e-968b-49fb-8659-b9f8e838aefb] AMQP server on 10.222.0.90:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 29 01:36:14.856792 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO oslo.messaging._drivers.impl_rabbit [req-156dc930-6eb2-43c8-9d7d-38e72b99c80a req-5902884a-aa50-4109-9a11-97ad4d73e80d service nova] [cc9a536e-968b-49fb-8659-b9f8e838aefb] Reconnected to AMQP server on 10.222.0.90:5672 via [amqp] client with port 45364. Oct 29 01:36:14.860763 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [req-156dc930-6eb2-43c8-9d7d-38e72b99c80a req-5902884a-aa50-4109-9a11-97ad4d73e80d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.107959 Oct 29 01:36:14.861648 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 985/1873] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:36:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:36:14.868663 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-add4466d-4863-454f-8beb-ec43f3ac4004 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:14.869347 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-add4466d-4863-454f-8beb-ec43f3ac4004 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:14.876332 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-add4466d-4863-454f-8beb-ec43f3ac4004 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:14.876809 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-add4466d-4863-454f-8beb-ec43f3ac4004 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:14.877656 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-add4466d-4863-454f-8beb-ec43f3ac4004 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:14.878019 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-add4466d-4863-454f-8beb-ec43f3ac4004 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:14.892289 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.wsgi [None req-add4466d-4863-454f-8beb-ec43f3ac4004 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] HTTP exception thrown: Instance 11a30efc-58bb-4139-a2ca-1712680c7fde could not be found. Oct 29 01:36:14.893364 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-add4466d-4863-454f-8beb-ec43f3ac4004 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Returning 404 to user: Instance 11a30efc-58bb-4139-a2ca-1712680c7fde could not be found. {{(pid=115747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:36:14.894179 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-add4466d-4863-454f-8beb-ec43f3ac4004 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 404 len: 111 microversion: 2.1 time: 0.030982 Oct 29 01:36:14.894774 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 986/1874] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:14 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:36:14.898977 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-0b8a0d4f-a7a8-44e7-9cb8-2231322a400d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:14.899487 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-0b8a0d4f-a7a8-44e7-9cb8-2231322a400d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:14.905283 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0b8a0d4f-a7a8-44e7-9cb8-2231322a400d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:14.905719 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0b8a0d4f-a7a8-44e7-9cb8-2231322a400d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:14.906513 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0b8a0d4f-a7a8-44e7-9cb8-2231322a400d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:14.906944 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0b8a0d4f-a7a8-44e7-9cb8-2231322a400d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:14.921438 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.wsgi [None req-0b8a0d4f-a7a8-44e7-9cb8-2231322a400d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] HTTP exception thrown: Instance 27a73464-dcac-4be6-a392-58d40a0296a8 could not be found. Oct 29 01:36:14.922022 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-0b8a0d4f-a7a8-44e7-9cb8-2231322a400d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Returning 404 to user: Instance 27a73464-dcac-4be6-a392-58d40a0296a8 could not be found. {{(pid=115747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:36:14.922884 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-0b8a0d4f-a7a8-44e7-9cb8-2231322a400d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "DELETE /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 404 len: 111 microversion: 2.1 time: 0.027230 Oct 29 01:36:14.923432 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 987/1875] 10.222.0.90 () {58 vars in 1238 bytes} [Fri Oct 29 01:36:14 2021] DELETE /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:36:14.927851 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ceac1f0a-afa0-4792-a206-3dd16c9b1d5d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:14.928369 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ceac1f0a-afa0-4792-a206-3dd16c9b1d5d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:14.934372 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ceac1f0a-afa0-4792-a206-3dd16c9b1d5d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:14.934857 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ceac1f0a-afa0-4792-a206-3dd16c9b1d5d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:14.935667 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ceac1f0a-afa0-4792-a206-3dd16c9b1d5d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:14.936103 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ceac1f0a-afa0-4792-a206-3dd16c9b1d5d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:42.297589 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:36:42.298171 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: Fri Oct 29 01:36:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf (ip 10.222.0.90) !!! Oct 29 01:37:27.809569 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:37:27.810236 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: Fri Oct 29 01:37:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf (ip 10.222.0.90) !!! Oct 29 01:38:12.197377 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.objects.instance [None req-18fe5585-696f-426b-92f5-a3113bd4ba46 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lazy-loading 'services' on Instance uuid 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d {{(pid=115748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:38:12.401853 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.objects.instance [None req-ceac1f0a-afa0-4792-a206-3dd16c9b1d5d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lazy-loading 'services' on Instance uuid 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d {{(pid=115747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:38:13.680685 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.wsgi [None req-18fe5585-696f-426b-92f5-a3113bd4ba46 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-24b3a6f5-8871-414d-90e0-1d0378c79a25) Oct 29 01:38:13.681339 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-18fe5585-696f-426b-92f5-a3113bd4ba46 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-24b3a6f5-8871-414d-90e0-1d0378c79a25) {{(pid=115748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:38:13.682741 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-18fe5585-696f-426b-92f5-a3113bd4ba46 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "DELETE /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf" status: 400 len: 269 microversion: 2.1 time: 120.106127 Oct 29 01:38:13.683360 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: Fri Oct 29 01:38:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf (ip 10.222.0.90) !!! Oct 29 01:38:13.683360 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: Fri Oct 29 01:38:13 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf (10.222.0.90) Oct 29 01:38:13.683856 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: CRITICAL nova [None req-18fe5585-696f-426b-92f5-a3113bd4ba46 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Unhandled error: OSError: write error Oct 29 01:38:13.683856 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: ERROR nova OSError: write error Oct 29 01:38:13.683856 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: ERROR nova Oct 29 01:38:13.684112 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 889/1876] 10.222.0.90 () {58 vars in 1415 bytes} [Fri Oct 29 01:36:13 2021] DELETE /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf => generated 0 bytes in 120108 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Oct 29 01:38:13.689109 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-8cd69355-826c-4f5d-b353-085cc9b2febf tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:13.689710 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-8cd69355-826c-4f5d-b353-085cc9b2febf tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:13.696173 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8cd69355-826c-4f5d-b353-085cc9b2febf tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:13.696615 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8cd69355-826c-4f5d-b353-085cc9b2febf tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:13.697382 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8cd69355-826c-4f5d-b353-085cc9b2febf tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:13.697810 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8cd69355-826c-4f5d-b353-085cc9b2febf tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:13.720462 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.wsgi [None req-ceac1f0a-afa0-4792-a206-3dd16c9b1d5d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ac709b34-f07f-46ad-b648-027e5d332b3f) Oct 29 01:38:13.720462 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ceac1f0a-afa0-4792-a206-3dd16c9b1d5d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ac709b34-f07f-46ad-b648-027e5d332b3f) {{(pid=115747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:38:13.720462 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ceac1f0a-afa0-4792-a206-3dd16c9b1d5d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "DELETE /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf" status: 400 len: 269 microversion: 2.1 time: 118.792555 Oct 29 01:38:13.720462 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: Fri Oct 29 01:38:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf (ip 10.222.0.90) !!! Oct 29 01:38:13.720462 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: Fri Oct 29 01:38:13 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf (10.222.0.90) Oct 29 01:38:13.723262 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: CRITICAL nova [None req-ceac1f0a-afa0-4792-a206-3dd16c9b1d5d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Unhandled error: OSError: write error Oct 29 01:38:13.723262 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: ERROR nova OSError: write error Oct 29 01:38:13.723262 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: ERROR nova Oct 29 01:38:13.723262 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 988/1877] 10.222.0.90 () {58 vars in 1415 bytes} [Fri Oct 29 01:36:14 2021] DELETE /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf => generated 0 bytes in 118794 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Oct 29 01:38:13.725376 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-3e20243b-fcc8-4527-9f64-7cd52df3c4fd tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:13.726409 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-3e20243b-fcc8-4527-9f64-7cd52df3c4fd tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:13.733909 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3e20243b-fcc8-4527-9f64-7cd52df3c4fd tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:13.734597 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3e20243b-fcc8-4527-9f64-7cd52df3c4fd tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:13.735483 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3e20243b-fcc8-4527-9f64-7cd52df3c4fd tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:13.736075 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3e20243b-fcc8-4527-9f64-7cd52df3c4fd tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:13.751867 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.wsgi [None req-3e20243b-fcc8-4527-9f64-7cd52df3c4fd tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] HTTP exception thrown: Instance 11a30efc-58bb-4139-a2ca-1712680c7fde could not be found. Oct 29 01:38:13.752473 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-3e20243b-fcc8-4527-9f64-7cd52df3c4fd tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Returning 404 to user: Instance 11a30efc-58bb-4139-a2ca-1712680c7fde could not be found. {{(pid=115747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:38:13.753604 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-3e20243b-fcc8-4527-9f64-7cd52df3c4fd tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 404 len: 111 microversion: 2.1 time: 0.034209 Oct 29 01:38:13.754078 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: Fri Oct 29 01:38:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde (ip 10.222.0.90) !!! Oct 29 01:38:13.754078 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: Fri Oct 29 01:38:13 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde (10.222.0.90) Oct 29 01:38:13.754734 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: CRITICAL nova [None req-3e20243b-fcc8-4527-9f64-7cd52df3c4fd tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Unhandled error: OSError: write error Oct 29 01:38:13.754734 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: ERROR nova OSError: write error Oct 29 01:38:13.754734 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: ERROR nova Oct 29 01:38:13.755019 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 989/1878] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:38:13 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 0 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Oct 29 01:38:13.763110 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ba772960-250e-4491-93ba-c7e09da93e92 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:13.763110 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ba772960-250e-4491-93ba-c7e09da93e92 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:13.767696 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ba772960-250e-4491-93ba-c7e09da93e92 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:13.768139 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ba772960-250e-4491-93ba-c7e09da93e92 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:13.768908 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ba772960-250e-4491-93ba-c7e09da93e92 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:13.769335 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ba772960-250e-4491-93ba-c7e09da93e92 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:13.769932 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-8cd69355-826c-4f5d-b353-085cc9b2febf tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:13.777968 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-8cd69355-826c-4f5d-b353-085cc9b2febf tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1213 microversion: 2.1 time: 0.093018 Oct 29 01:38:13.778886 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: Fri Oct 29 01:38:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd (ip 10.222.0.90) !!! Oct 29 01:38:13.778886 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: Fri Oct 29 01:38:13 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd (10.222.0.90) Oct 29 01:38:13.779277 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: CRITICAL nova [None req-8cd69355-826c-4f5d-b353-085cc9b2febf tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Unhandled error: OSError: write error Oct 29 01:38:13.779277 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: ERROR nova OSError: write error Oct 29 01:38:13.779277 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: ERROR nova Oct 29 01:38:13.779520 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 890/1879] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:38:13 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 0 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Oct 29 01:38:13.783836 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-32665a49-0b09-4c4c-a596-98f419332fd9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:13.784333 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-32665a49-0b09-4c4c-a596-98f419332fd9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:13.784585 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.wsgi [None req-ba772960-250e-4491-93ba-c7e09da93e92 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] HTTP exception thrown: Instance 27a73464-dcac-4be6-a392-58d40a0296a8 could not be found. Oct 29 01:38:13.785362 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ba772960-250e-4491-93ba-c7e09da93e92 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Returning 404 to user: Instance 27a73464-dcac-4be6-a392-58d40a0296a8 could not be found. {{(pid=115747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:38:13.786185 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ba772960-250e-4491-93ba-c7e09da93e92 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "DELETE /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 404 len: 111 microversion: 2.1 time: 0.030375 Oct 29 01:38:13.787082 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 990/1880] 10.222.0.90 () {58 vars in 1238 bytes} [Fri Oct 29 01:38:13 2021] DELETE /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:38:13.790384 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-32665a49-0b09-4c4c-a596-98f419332fd9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:13.791407 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-32665a49-0b09-4c4c-a596-98f419332fd9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:13.791539 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-5f192463-f7b1-464b-8b34-c91a24b14eee tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:13.792118 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-5f192463-f7b1-464b-8b34-c91a24b14eee tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:13.792260 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-32665a49-0b09-4c4c-a596-98f419332fd9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:13.792609 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-32665a49-0b09-4c4c-a596-98f419332fd9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:13.800687 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5f192463-f7b1-464b-8b34-c91a24b14eee tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:13.801144 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5f192463-f7b1-464b-8b34-c91a24b14eee tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:13.801977 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5f192463-f7b1-464b-8b34-c91a24b14eee tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:13.802438 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5f192463-f7b1-464b-8b34-c91a24b14eee tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:13.864501 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-5f192463-f7b1-464b-8b34-c91a24b14eee tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:13.872426 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-5f192463-f7b1-464b-8b34-c91a24b14eee tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1213 microversion: 2.1 time: 0.084713 Oct 29 01:38:13.873007 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 991/1881] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:38:13 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:13.877215 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-940dc1eb-ea6e-45d5-9b58-6411eeb79a17 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:13.877826 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-940dc1eb-ea6e-45d5-9b58-6411eeb79a17 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:13.883399 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-940dc1eb-ea6e-45d5-9b58-6411eeb79a17 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:13.883848 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-940dc1eb-ea6e-45d5-9b58-6411eeb79a17 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:13.884653 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-940dc1eb-ea6e-45d5-9b58-6411eeb79a17 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:13.885093 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-940dc1eb-ea6e-45d5-9b58-6411eeb79a17 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:13.898487 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.wsgi [None req-940dc1eb-ea6e-45d5-9b58-6411eeb79a17 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] HTTP exception thrown: Instance 11a30efc-58bb-4139-a2ca-1712680c7fde could not be found. Oct 29 01:38:13.899043 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-940dc1eb-ea6e-45d5-9b58-6411eeb79a17 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Returning 404 to user: Instance 11a30efc-58bb-4139-a2ca-1712680c7fde could not be found. {{(pid=115747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:38:13.899867 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-940dc1eb-ea6e-45d5-9b58-6411eeb79a17 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 404 len: 111 microversion: 2.1 time: 0.025960 Oct 29 01:38:13.900954 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 992/1882] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:38:13 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:38:13.905251 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-da6caa0f-7414-4533-9797-bbf50628a426 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:13.905740 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-da6caa0f-7414-4533-9797-bbf50628a426 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:13.911727 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-da6caa0f-7414-4533-9797-bbf50628a426 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:13.912175 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-da6caa0f-7414-4533-9797-bbf50628a426 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:13.912945 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-da6caa0f-7414-4533-9797-bbf50628a426 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:13.913382 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-da6caa0f-7414-4533-9797-bbf50628a426 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:13.927060 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.wsgi [None req-da6caa0f-7414-4533-9797-bbf50628a426 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] HTTP exception thrown: Instance 27a73464-dcac-4be6-a392-58d40a0296a8 could not be found. Oct 29 01:38:13.927651 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-da6caa0f-7414-4533-9797-bbf50628a426 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Returning 404 to user: Instance 27a73464-dcac-4be6-a392-58d40a0296a8 could not be found. {{(pid=115747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:38:13.928472 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-da6caa0f-7414-4533-9797-bbf50628a426 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "DELETE /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 404 len: 111 microversion: 2.1 time: 0.026625 Oct 29 01:38:13.929008 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 993/1883] 10.222.0.90 () {58 vars in 1238 bytes} [Fri Oct 29 01:38:13 2021] DELETE /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:38:13.933260 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-6dd8b038-c07c-430a-8467-55e1ee884feb tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:13.933862 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-6dd8b038-c07c-430a-8467-55e1ee884feb tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] [instance: efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:13.939402 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6dd8b038-c07c-430a-8467-55e1ee884feb tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:13.939846 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6dd8b038-c07c-430a-8467-55e1ee884feb tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:13.940602 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6dd8b038-c07c-430a-8467-55e1ee884feb tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:13.941035 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6dd8b038-c07c-430a-8467-55e1ee884feb tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:14.001276 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-6dd8b038-c07c-430a-8467-55e1ee884feb tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306798b38f4f419aaf5472650c2c1ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4db728610349e3b7f324f37a51b58c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:14.008739 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-6dd8b038-c07c-430a-8467-55e1ee884feb tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd" status: 200 len: 1213 microversion: 2.1 time: 0.078788 Oct 29 01:38:14.009317 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 994/1884] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:38:13 2021] GET /compute/v2.1/servers/efc9fb7b-3a7f-4f33-bb84-c642d77d4cfd => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:14.013828 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-38733f1f-c973-467c-b2a5-957306b37354 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:14.015112 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-38733f1f-c973-467c-b2a5-957306b37354 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:14.019926 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-38733f1f-c973-467c-b2a5-957306b37354 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:14.020376 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-38733f1f-c973-467c-b2a5-957306b37354 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:14.021284 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-38733f1f-c973-467c-b2a5-957306b37354 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:14.021713 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-38733f1f-c973-467c-b2a5-957306b37354 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:14.035523 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.wsgi [None req-38733f1f-c973-467c-b2a5-957306b37354 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] HTTP exception thrown: Instance 11a30efc-58bb-4139-a2ca-1712680c7fde could not be found. Oct 29 01:38:14.036117 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-38733f1f-c973-467c-b2a5-957306b37354 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Returning 404 to user: Instance 11a30efc-58bb-4139-a2ca-1712680c7fde could not be found. {{(pid=115747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:38:14.036937 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-38733f1f-c973-467c-b2a5-957306b37354 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 404 len: 111 microversion: 2.1 time: 0.026590 Oct 29 01:38:14.037487 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 995/1885] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:38:14 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:38:14.042661 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-8501f7d1-1d45-4ab3-9f54-35cb838ee8d8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:14.043156 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-8501f7d1-1d45-4ab3-9f54-35cb838ee8d8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:14.048807 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8501f7d1-1d45-4ab3-9f54-35cb838ee8d8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:14.049251 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8501f7d1-1d45-4ab3-9f54-35cb838ee8d8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:14.050019 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8501f7d1-1d45-4ab3-9f54-35cb838ee8d8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:14.050478 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8501f7d1-1d45-4ab3-9f54-35cb838ee8d8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:14.063822 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.wsgi [None req-8501f7d1-1d45-4ab3-9f54-35cb838ee8d8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] HTTP exception thrown: Instance 27a73464-dcac-4be6-a392-58d40a0296a8 could not be found. Oct 29 01:38:14.064402 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-8501f7d1-1d45-4ab3-9f54-35cb838ee8d8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Returning 404 to user: Instance 27a73464-dcac-4be6-a392-58d40a0296a8 could not be found. {{(pid=115747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:38:14.065245 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-8501f7d1-1d45-4ab3-9f54-35cb838ee8d8 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "DELETE /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 404 len: 111 microversion: 2.1 time: 0.026743 Oct 29 01:38:14.065786 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 996/1886] 10.222.0.90 () {58 vars in 1238 bytes} [Fri Oct 29 01:38:14 2021] DELETE /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:38:14.070114 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ace19277-988f-4322-af51-a255e191c74e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '.version_select at 0x7f6029b32700>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:14.090535 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ace19277-988f-4322-af51-a255e191c74e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1011925652" status: 202 len: 0 microversion: 2.1 time: 0.023556 Oct 29 01:38:14.091087 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 997/1887] 10.222.0.90 () {58 vars in 1253 bytes} [Fri Oct 29 01:38:14 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1011925652 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:38:14.095286 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d8320540-1602-488a-9476-bf071f9a1d1d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:14.095771 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d8320540-1602-488a-9476-bf071f9a1d1d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:14.101310 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d8320540-1602-488a-9476-bf071f9a1d1d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:14.101753 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d8320540-1602-488a-9476-bf071f9a1d1d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:14.102533 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d8320540-1602-488a-9476-bf071f9a1d1d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:14.102963 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d8320540-1602-488a-9476-bf071f9a1d1d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:14.116703 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.wsgi [None req-d8320540-1602-488a-9476-bf071f9a1d1d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] HTTP exception thrown: Instance 11a30efc-58bb-4139-a2ca-1712680c7fde could not be found. Oct 29 01:38:14.117282 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d8320540-1602-488a-9476-bf071f9a1d1d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Returning 404 to user: Instance 11a30efc-58bb-4139-a2ca-1712680c7fde could not be found. {{(pid=115747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:38:14.118082 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d8320540-1602-488a-9476-bf071f9a1d1d tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "DELETE /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 404 len: 111 microversion: 2.1 time: 0.026128 Oct 29 01:38:14.118638 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 998/1888] 10.222.0.90 () {58 vars in 1238 bytes} [Fri Oct 29 01:38:14 2021] DELETE /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:38:14.122726 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-5cb31406-9c62-405d-a547-0ef7f555fbc6 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:14.123202 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-5cb31406-9c62-405d-a547-0ef7f555fbc6 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:14.128512 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5cb31406-9c62-405d-a547-0ef7f555fbc6 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:14.128935 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5cb31406-9c62-405d-a547-0ef7f555fbc6 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:14.129677 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5cb31406-9c62-405d-a547-0ef7f555fbc6 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:14.130103 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5cb31406-9c62-405d-a547-0ef7f555fbc6 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:14.142573 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.wsgi [None req-5cb31406-9c62-405d-a547-0ef7f555fbc6 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] HTTP exception thrown: Instance 27a73464-dcac-4be6-a392-58d40a0296a8 could not be found. Oct 29 01:38:14.143141 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-5cb31406-9c62-405d-a547-0ef7f555fbc6 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Returning 404 to user: Instance 27a73464-dcac-4be6-a392-58d40a0296a8 could not be found. {{(pid=115747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:38:14.143924 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-5cb31406-9c62-405d-a547-0ef7f555fbc6 tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "DELETE /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 404 len: 111 microversion: 2.1 time: 0.024420 Oct 29 01:38:14.144427 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 999/1889] 10.222.0.90 () {58 vars in 1238 bytes} [Fri Oct 29 01:38:14 2021] DELETE /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:38:14.148486 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-6a8a5a6a-0679-4c72-b91a-ebe377bb242a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '.version_select at 0x7f602926bb80>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:14.171838 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.wsgi [None req-6a8a5a6a-0679-4c72-b91a-ebe377bb242a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] HTTP exception thrown: Keypair tempest-TestShelveInstance-1011925652 not found for user 306798b38f4f419aaf5472650c2c1ea5 Oct 29 01:38:14.172330 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-6a8a5a6a-0679-4c72-b91a-ebe377bb242a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Returning 404 to user: Keypair tempest-TestShelveInstance-1011925652 not found for user 306798b38f4f419aaf5472650c2c1ea5 {{(pid=115747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:38:14.173121 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-6a8a5a6a-0679-4c72-b91a-ebe377bb242a tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1011925652" status: 404 len: 143 microversion: 2.1 time: 0.027771 Oct 29 01:38:14.173632 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1000/1890] 10.222.0.90 () {58 vars in 1253 bytes} [Fri Oct 29 01:38:14 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1011925652 => generated 143 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:38:14.177690 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-045924f5-6448-4e31-89ea-07c46b431633 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:14.178170 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-045924f5-6448-4e31-89ea-07c46b431633 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:14.183642 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-045924f5-6448-4e31-89ea-07c46b431633 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:14.184080 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-045924f5-6448-4e31-89ea-07c46b431633 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:14.184833 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-045924f5-6448-4e31-89ea-07c46b431633 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:14.185261 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-045924f5-6448-4e31-89ea-07c46b431633 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:14.197885 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.wsgi [None req-045924f5-6448-4e31-89ea-07c46b431633 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] HTTP exception thrown: Instance 11a30efc-58bb-4139-a2ca-1712680c7fde could not be found. Oct 29 01:38:14.198538 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-045924f5-6448-4e31-89ea-07c46b431633 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Returning 404 to user: Instance 11a30efc-58bb-4139-a2ca-1712680c7fde could not be found. {{(pid=115747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:38:14.199572 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-045924f5-6448-4e31-89ea-07c46b431633 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "DELETE /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 404 len: 111 microversion: 2.1 time: 0.024832 Oct 29 01:38:14.200079 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1001/1891] 10.222.0.90 () {58 vars in 1238 bytes} [Fri Oct 29 01:38:14 2021] DELETE /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:38:14.204251 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-3d548a2a-0d51-413c-a8c0-7dce96b3350d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:14.204728 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-3d548a2a-0d51-413c-a8c0-7dce96b3350d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:14.210112 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3d548a2a-0d51-413c-a8c0-7dce96b3350d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:14.210588 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3d548a2a-0d51-413c-a8c0-7dce96b3350d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:14.211336 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3d548a2a-0d51-413c-a8c0-7dce96b3350d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:14.211762 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3d548a2a-0d51-413c-a8c0-7dce96b3350d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:14.224981 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.wsgi [None req-3d548a2a-0d51-413c-a8c0-7dce96b3350d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] HTTP exception thrown: Instance 27a73464-dcac-4be6-a392-58d40a0296a8 could not be found. Oct 29 01:38:14.225549 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-3d548a2a-0d51-413c-a8c0-7dce96b3350d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Returning 404 to user: Instance 27a73464-dcac-4be6-a392-58d40a0296a8 could not be found. {{(pid=115747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:38:14.226334 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-3d548a2a-0d51-413c-a8c0-7dce96b3350d tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "DELETE /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 404 len: 111 microversion: 2.1 time: 0.025412 Oct 29 01:38:14.226870 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1002/1892] 10.222.0.90 () {58 vars in 1238 bytes} [Fri Oct 29 01:38:14 2021] DELETE /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:38:14.232298 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f108de0e-08fc-45f9-882d-2e77f58c148e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Calling method '.version_select at 0x7f60292fd9d0>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:14.246435 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.wsgi [None req-f108de0e-08fc-45f9-882d-2e77f58c148e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] HTTP exception thrown: Keypair tempest-TestShelveInstance-1011925652 not found for user 306798b38f4f419aaf5472650c2c1ea5 Oct 29 01:38:14.247005 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f108de0e-08fc-45f9-882d-2e77f58c148e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] Returning 404 to user: Keypair tempest-TestShelveInstance-1011925652 not found for user 306798b38f4f419aaf5472650c2c1ea5 {{(pid=115747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:38:14.247803 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f108de0e-08fc-45f9-882d-2e77f58c148e tempest-TestShelveInstance-1400479463 tempest-TestShelveInstance-1400479463-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1011925652" status: 404 len: 143 microversion: 2.1 time: 0.020081 Oct 29 01:38:14.248328 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1003/1893] 10.222.0.90 () {58 vars in 1253 bytes} [Fri Oct 29 01:38:14 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1011925652 => generated 143 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:38:14.255050 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-e8e6e0e7-92da-45a2-b660-ea2ca9899f80 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:14.255050 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-e8e6e0e7-92da-45a2-b660-ea2ca9899f80 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:14.260679 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e8e6e0e7-92da-45a2-b660-ea2ca9899f80 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:14.261201 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e8e6e0e7-92da-45a2-b660-ea2ca9899f80 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:14.262059 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e8e6e0e7-92da-45a2-b660-ea2ca9899f80 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:14.262525 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e8e6e0e7-92da-45a2-b660-ea2ca9899f80 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:14.276316 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.wsgi [None req-e8e6e0e7-92da-45a2-b660-ea2ca9899f80 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] HTTP exception thrown: Instance 11a30efc-58bb-4139-a2ca-1712680c7fde could not be found. Oct 29 01:38:14.277077 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-e8e6e0e7-92da-45a2-b660-ea2ca9899f80 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Returning 404 to user: Instance 11a30efc-58bb-4139-a2ca-1712680c7fde could not be found. {{(pid=115747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:38:14.277905 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-e8e6e0e7-92da-45a2-b660-ea2ca9899f80 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "DELETE /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 404 len: 111 microversion: 2.1 time: 0.028700 Oct 29 01:38:14.278866 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1004/1894] 10.222.0.90 () {58 vars in 1238 bytes} [Fri Oct 29 01:38:14 2021] DELETE /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:38:14.282757 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-2cf921a7-5e09-4839-a77b-47073fa509da tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:14.283358 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-2cf921a7-5e09-4839-a77b-47073fa509da tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] [instance: 27a73464-dcac-4be6-a392-58d40a0296a8] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:14.289557 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2cf921a7-5e09-4839-a77b-47073fa509da tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:14.290072 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2cf921a7-5e09-4839-a77b-47073fa509da tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:14.290914 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2cf921a7-5e09-4839-a77b-47073fa509da tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:14.291534 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2cf921a7-5e09-4839-a77b-47073fa509da tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:14.310138 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.wsgi [None req-2cf921a7-5e09-4839-a77b-47073fa509da tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] HTTP exception thrown: Instance 27a73464-dcac-4be6-a392-58d40a0296a8 could not be found. Oct 29 01:38:14.310760 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-2cf921a7-5e09-4839-a77b-47073fa509da tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] Returning 404 to user: Instance 27a73464-dcac-4be6-a392-58d40a0296a8 could not be found. {{(pid=115747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:38:14.311587 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-2cf921a7-5e09-4839-a77b-47073fa509da tempest-AttachVolumeShelveTestJSON-1659566463 tempest-AttachVolumeShelveTestJSON-1659566463-project] 10.222.0.90 "GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8" status: 404 len: 111 microversion: 2.1 time: 0.032233 Oct 29 01:38:14.312137 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1005/1895] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:38:14 2021] GET /compute/v2.1/servers/27a73464-dcac-4be6-a392-58d40a0296a8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:38:14.316912 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-fbe8f209-523e-4654-8c52-22c190126d20 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:14.317328 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-fbe8f209-523e-4654-8c52-22c190126d20 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] [instance: 11a30efc-58bb-4139-a2ca-1712680c7fde] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:14.323917 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fbe8f209-523e-4654-8c52-22c190126d20 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:14.324629 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fbe8f209-523e-4654-8c52-22c190126d20 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:14.325411 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fbe8f209-523e-4654-8c52-22c190126d20 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:14.325903 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fbe8f209-523e-4654-8c52-22c190126d20 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:14.340808 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.wsgi [None req-fbe8f209-523e-4654-8c52-22c190126d20 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] HTTP exception thrown: Instance 11a30efc-58bb-4139-a2ca-1712680c7fde could not be found. Oct 29 01:38:14.341407 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-fbe8f209-523e-4654-8c52-22c190126d20 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Returning 404 to user: Instance 11a30efc-58bb-4139-a2ca-1712680c7fde could not be found. {{(pid=115747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:38:14.342299 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-fbe8f209-523e-4654-8c52-22c190126d20 tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde" status: 404 len: 111 microversion: 2.1 time: 0.029203 Oct 29 01:38:14.342882 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1006/1896] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:38:14 2021] GET /compute/v2.1/servers/11a30efc-58bb-4139-a2ca-1712680c7fde => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:38:25.305685 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-bb50377f-584b-4f10-abc4-f9e4cf4b1729 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'create', calling method: .version_select at 0x7f6029b34550>, body: {"keypair": {"name": "tempest-keypair-2049351198"}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:38:25.331652 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.quota [None req-bb50377f-584b-4f10-abc4-f9e4cf4b1729 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Getting quotas for project 9478c9b68c774f5cbffc9f7b559fc86e. Resources: {'key_pairs'} {{(pid=115747) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:38:25.336525 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.quota [None req-bb50377f-584b-4f10-abc4-f9e4cf4b1729 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Getting quotas for user aa2e7072a6214e9fb3b1fdc341b2d702 and project 9478c9b68c774f5cbffc9f7b559fc86e. Resources: {'key_pairs'} {{(pid=115747) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:38:25.765500 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.quota [None req-bb50377f-584b-4f10-abc4-f9e4cf4b1729 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Getting quotas for project 9478c9b68c774f5cbffc9f7b559fc86e. Resources: {'key_pairs'} {{(pid=115747) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:38:25.769125 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.quota [None req-bb50377f-584b-4f10-abc4-f9e4cf4b1729 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Getting quotas for user aa2e7072a6214e9fb3b1fdc341b2d702 and project 9478c9b68c774f5cbffc9f7b559fc86e. Resources: {'key_pairs'} {{(pid=115747) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:38:25.782720 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-bb50377f-584b-4f10-abc4-f9e4cf4b1729 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.620324 Oct 29 01:38:25.783315 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1007/1897] 10.222.0.90 () {60 vars in 1157 bytes} [Fri Oct 29 01:38:25 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:38:27.122541 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-bc614612-61d2-4680-9a0e-0e5ae544ea79 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1461509505", "imageRef": "3fef3f0d-d772-4999-b764-d6690634a06d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1372eaaf-0ff8-4c92-af45-6a6e8a255eb4"}], "security_groups": [{"name": "tempest-securitygroup--1407935878"}], "key_name": "tempest-keypair-2049351198", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:38:27.223981 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.network.neutron [None req-bc614612-61d2-4680-9a0e-0e5ae544ea79 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] validate_networks() for [('1372eaaf-0ff8-4c92-af45-6a6e8a255eb4', None, None, None, None, None)] {{(pid=115747) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 01:38:27.729873 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-bc614612-61d2-4680-9a0e-0e5ae544ea79 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Flavor limits 0:0:0 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:38:27.730608 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-bc614612-61d2-4680-9a0e-0e5ae544ea79 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Image limits 0:0:0 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:38:27.731142 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-bc614612-61d2-4680-9a0e-0e5ae544ea79 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Flavor pref 0:0:0 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:38:27.731534 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-bc614612-61d2-4680-9a0e-0e5ae544ea79 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Image pref 0:0:0 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:38:27.731981 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-bc614612-61d2-4680-9a0e-0e5ae544ea79 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:38:27.740989 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bc614612-61d2-4680-9a0e-0e5ae544ea79 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:27.741436 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bc614612-61d2-4680-9a0e-0e5ae544ea79 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:27.742240 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bc614612-61d2-4680-9a0e-0e5ae544ea79 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:27.742709 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-bc614612-61d2-4680-9a0e-0e5ae544ea79 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:27.760748 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.quota [None req-bc614612-61d2-4680-9a0e-0e5ae544ea79 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Getting quotas for project 9478c9b68c774f5cbffc9f7b559fc86e. Resources: {'instances', 'cores', 'ram'} {{(pid=115747) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:38:27.765042 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.quota [None req-bc614612-61d2-4680-9a0e-0e5ae544ea79 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Getting quotas for user aa2e7072a6214e9fb3b1fdc341b2d702 and project 9478c9b68c774f5cbffc9f7b559fc86e. Resources: {'instances', 'cores', 'ram'} {{(pid=115747) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:38:27.776211 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-bc614612-61d2-4680-9a0e-0e5ae544ea79 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Going to run 1 instances... {{(pid=115747) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 01:38:27.778468 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-bc614612-61d2-4680-9a0e-0e5ae544ea79 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3fef3f0d-d772-4999-b764-d6690634a06d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 01:38:27.837731 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-bc614612-61d2-4680-9a0e-0e5ae544ea79 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.719631 Oct 29 01:38:27.838604 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1008/1898] 10.222.0.90 () {60 vars in 1146 bytes} [Fri Oct 29 01:38:27 2021] POST /compute/v2.1/servers => generated 402 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 01:38:27.848376 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-83d7b60c-acb8-440b-876c-ff5e2dab886a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:27.848998 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-83d7b60c-acb8-440b-876c-ff5e2dab886a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:27.920470 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-83d7b60c-acb8-440b-876c-ff5e2dab886a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2e7072a6214e9fb3b1fdc341b2d702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9478c9b68c774f5cbffc9f7b559fc86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:27.929941 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-83d7b60c-acb8-440b-876c-ff5e2dab886a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "GET /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807" status: 200 len: 1238 microversion: 2.1 time: 0.085267 Oct 29 01:38:27.932699 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1009/1899] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:38:27 2021] GET /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807 => generated 1238 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:38:28.948857 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-19b5b608-c617-4b9f-9183-fab770df5484 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:28.950641 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-19b5b608-c617-4b9f-9183-fab770df5484 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:28.958188 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-19b5b608-c617-4b9f-9183-fab770df5484 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:28.959063 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-19b5b608-c617-4b9f-9183-fab770df5484 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:28.959433 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-19b5b608-c617-4b9f-9183-fab770df5484 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:28.959860 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-19b5b608-c617-4b9f-9183-fab770df5484 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:29.042045 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-19b5b608-c617-4b9f-9183-fab770df5484 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2e7072a6214e9fb3b1fdc341b2d702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9478c9b68c774f5cbffc9f7b559fc86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:29.049805 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-19b5b608-c617-4b9f-9183-fab770df5484 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "GET /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807" status: 200 len: 1290 microversion: 2.1 time: 0.105284 Oct 29 01:38:29.050479 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1010/1900] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:38:28 2021] GET /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807 => generated 1290 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:38:30.067323 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-de2437c3-18c0-46b7-bc6c-9ed346811c68 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:30.067933 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-de2437c3-18c0-46b7-bc6c-9ed346811c68 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:30.074149 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-de2437c3-18c0-46b7-bc6c-9ed346811c68 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:30.074888 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-de2437c3-18c0-46b7-bc6c-9ed346811c68 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:30.075663 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-de2437c3-18c0-46b7-bc6c-9ed346811c68 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:30.076099 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-de2437c3-18c0-46b7-bc6c-9ed346811c68 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:30.208925 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-de2437c3-18c0-46b7-bc6c-9ed346811c68 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2e7072a6214e9fb3b1fdc341b2d702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9478c9b68c774f5cbffc9f7b559fc86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:30.217028 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-de2437c3-18c0-46b7-bc6c-9ed346811c68 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "GET /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807" status: 200 len: 1364 microversion: 2.1 time: 0.153303 Oct 29 01:38:30.217800 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1011/1901] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:38:30 2021] GET /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:38:30.589749 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [req-ccfcb9b1-1e58-41ff-b8a7-2070011651ca req-0434fb09-c7c1-4df1-af3a-7ea2a228a453 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a271df91-65af-42bb-a06e-b3d97b359807", "tag": "cd073e79-275c-491d-8c38-18d39de4a7c2"}]} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:38:30.592076 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:38:30.592076 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: warnings.warn(msg) Oct 29 01:38:30.617725 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-ccfcb9b1-1e58-41ff-b8a7-2070011651ca req-0434fb09-c7c1-4df1-af3a-7ea2a228a453 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:30.619538 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-ccfcb9b1-1e58-41ff-b8a7-2070011651ca req-0434fb09-c7c1-4df1-af3a-7ea2a228a453 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:30.643521 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.compute.server_external_events [req-ccfcb9b1-1e58-41ff-b8a7-2070011651ca req-0434fb09-c7c1-4df1-af3a-7ea2a228a453 service nova] Creating event network-changed:cd073e79-275c-491d-8c38-18d39de4a7c2 for instance a271df91-65af-42bb-a06e-b3d97b359807 on hv-cinder-81558 Oct 29 01:38:30.649076 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [req-ccfcb9b1-1e58-41ff-b8a7-2070011651ca req-0434fb09-c7c1-4df1-af3a-7ea2a228a453 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063998 Oct 29 01:38:30.650920 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1012/1902] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:38:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:38:31.235123 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-34626ab6-5b14-44d7-86ed-9a71a3f24dab tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:31.235759 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-34626ab6-5b14-44d7-86ed-9a71a3f24dab tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:31.242358 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-34626ab6-5b14-44d7-86ed-9a71a3f24dab tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:31.242835 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-34626ab6-5b14-44d7-86ed-9a71a3f24dab tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:31.244119 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-34626ab6-5b14-44d7-86ed-9a71a3f24dab tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:31.244561 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-34626ab6-5b14-44d7-86ed-9a71a3f24dab tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:31.367226 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-34626ab6-5b14-44d7-86ed-9a71a3f24dab tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2e7072a6214e9fb3b1fdc341b2d702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9478c9b68c774f5cbffc9f7b559fc86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:31.375301 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-34626ab6-5b14-44d7-86ed-9a71a3f24dab tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "GET /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807" status: 200 len: 1364 microversion: 2.1 time: 0.144388 Oct 29 01:38:31.375885 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1013/1903] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:38:31 2021] GET /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807 => generated 1364 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:38:32.391539 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-3520e9ea-3e40-4c63-8970-85cc1e7156d6 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:32.392228 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-3520e9ea-3e40-4c63-8970-85cc1e7156d6 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:32.398527 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3520e9ea-3e40-4c63-8970-85cc1e7156d6 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:32.398971 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3520e9ea-3e40-4c63-8970-85cc1e7156d6 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:32.399745 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3520e9ea-3e40-4c63-8970-85cc1e7156d6 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:32.400172 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3520e9ea-3e40-4c63-8970-85cc1e7156d6 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:32.523563 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-3520e9ea-3e40-4c63-8970-85cc1e7156d6 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2e7072a6214e9fb3b1fdc341b2d702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9478c9b68c774f5cbffc9f7b559fc86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:32.530917 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-3520e9ea-3e40-4c63-8970-85cc1e7156d6 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "GET /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807" status: 200 len: 1364 microversion: 2.1 time: 0.143056 Oct 29 01:38:32.531482 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1014/1904] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:38:32 2021] GET /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807 => generated 1364 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:38:33.547356 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-860bdf0c-84b5-4ba6-b25d-6f0f5c355cc5 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:33.547980 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-860bdf0c-84b5-4ba6-b25d-6f0f5c355cc5 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:33.553806 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-860bdf0c-84b5-4ba6-b25d-6f0f5c355cc5 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:33.554274 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-860bdf0c-84b5-4ba6-b25d-6f0f5c355cc5 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:33.555083 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-860bdf0c-84b5-4ba6-b25d-6f0f5c355cc5 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:33.555513 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-860bdf0c-84b5-4ba6-b25d-6f0f5c355cc5 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:33.676341 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-860bdf0c-84b5-4ba6-b25d-6f0f5c355cc5 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2e7072a6214e9fb3b1fdc341b2d702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9478c9b68c774f5cbffc9f7b559fc86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:33.683911 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-860bdf0c-84b5-4ba6-b25d-6f0f5c355cc5 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "GET /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807" status: 200 len: 1364 microversion: 2.1 time: 0.140164 Oct 29 01:38:33.684493 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1015/1905] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:38:33 2021] GET /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807 => generated 1364 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:38:34.700581 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-edc9dd2e-107d-44cd-b44e-5c3ac958c14b tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:34.701205 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-edc9dd2e-107d-44cd-b44e-5c3ac958c14b tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:34.707403 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-edc9dd2e-107d-44cd-b44e-5c3ac958c14b tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:34.707859 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-edc9dd2e-107d-44cd-b44e-5c3ac958c14b tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:34.708625 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-edc9dd2e-107d-44cd-b44e-5c3ac958c14b tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:34.709089 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-edc9dd2e-107d-44cd-b44e-5c3ac958c14b tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:34.831877 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-edc9dd2e-107d-44cd-b44e-5c3ac958c14b tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2e7072a6214e9fb3b1fdc341b2d702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9478c9b68c774f5cbffc9f7b559fc86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:34.839964 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-edc9dd2e-107d-44cd-b44e-5c3ac958c14b tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "GET /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807" status: 200 len: 1364 microversion: 2.1 time: 0.143462 Oct 29 01:38:34.840537 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1016/1906] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:38:34 2021] GET /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807 => generated 1364 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:38:34.907062 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [req-a70dec78-fdbf-4989-a5bc-10ddb4c0fc9e req-1894cd99-a649-49f2-9a52-c2f489304eb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a271df91-65af-42bb-a06e-b3d97b359807", "name": "network-vif-plugged", "status": "completed", "tag": "cd073e79-275c-491d-8c38-18d39de4a7c2"}]} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:38:34.908620 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:38:34.908620 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: warnings.warn(msg) Oct 29 01:38:34.916039 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-a70dec78-fdbf-4989-a5bc-10ddb4c0fc9e req-1894cd99-a649-49f2-9a52-c2f489304eb9 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:34.916489 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-a70dec78-fdbf-4989-a5bc-10ddb4c0fc9e req-1894cd99-a649-49f2-9a52-c2f489304eb9 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:34.926945 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.compute.server_external_events [req-a70dec78-fdbf-4989-a5bc-10ddb4c0fc9e req-1894cd99-a649-49f2-9a52-c2f489304eb9 service nova] Creating event network-vif-plugged:cd073e79-275c-491d-8c38-18d39de4a7c2 for instance a271df91-65af-42bb-a06e-b3d97b359807 on hv-cinder-81558 Oct 29 01:38:34.931970 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [req-a70dec78-fdbf-4989-a5bc-10ddb4c0fc9e req-1894cd99-a649-49f2-9a52-c2f489304eb9 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090342 Oct 29 01:38:34.932582 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1017/1907] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:38:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:38:35.858169 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9aff9161-f587-490f-95b5-42322761f1ab tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:35.858891 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9aff9161-f587-490f-95b5-42322761f1ab tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:35.865046 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9aff9161-f587-490f-95b5-42322761f1ab tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:35.865500 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9aff9161-f587-490f-95b5-42322761f1ab tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:35.866265 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9aff9161-f587-490f-95b5-42322761f1ab tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:35.866724 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9aff9161-f587-490f-95b5-42322761f1ab tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:35.994304 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-9aff9161-f587-490f-95b5-42322761f1ab tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2e7072a6214e9fb3b1fdc341b2d702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9478c9b68c774f5cbffc9f7b559fc86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:36.001498 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9aff9161-f587-490f-95b5-42322761f1ab tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "GET /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807" status: 200 len: 1364 microversion: 2.1 time: 0.148343 Oct 29 01:38:36.002062 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1018/1908] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:38:35 2021] GET /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:38:37.017917 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-2fefac45-bd39-49bb-84ad-217c62891760 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:37.018602 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-2fefac45-bd39-49bb-84ad-217c62891760 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:37.025179 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2fefac45-bd39-49bb-84ad-217c62891760 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:37.025629 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2fefac45-bd39-49bb-84ad-217c62891760 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:37.026380 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2fefac45-bd39-49bb-84ad-217c62891760 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:37.026829 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2fefac45-bd39-49bb-84ad-217c62891760 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:37.148271 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-2fefac45-bd39-49bb-84ad-217c62891760 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2e7072a6214e9fb3b1fdc341b2d702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9478c9b68c774f5cbffc9f7b559fc86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:37.155965 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-2fefac45-bd39-49bb-84ad-217c62891760 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "GET /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807" status: 200 len: 1551 microversion: 2.1 time: 0.141647 Oct 29 01:38:37.156524 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1019/1909] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:38:37 2021] GET /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807 => generated 1551 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:38:37.171984 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-cf045f0c-4081-4658-a264-6962669e3832 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:37.172481 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-cf045f0c-4081-4658-a264-6962669e3832 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:37.178088 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cf045f0c-4081-4658-a264-6962669e3832 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:37.178561 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cf045f0c-4081-4658-a264-6962669e3832 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:37.179318 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cf045f0c-4081-4658-a264-6962669e3832 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:37.179744 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cf045f0c-4081-4658-a264-6962669e3832 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:37.258811 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-cf045f0c-4081-4658-a264-6962669e3832 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "GET /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090197 Oct 29 01:38:37.259960 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1020/1910] 10.222.0.90 () {58 vars in 1274 bytes} [Fri Oct 29 01:38:37 2021] GET /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:38:38.441560 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-616853ee-da93-4edc-adb6-dfb7b1e79fe4 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:38:38.442515 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-616853ee-da93-4edc-adb6-dfb7b1e79fe4 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:38.448570 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-616853ee-da93-4edc-adb6-dfb7b1e79fe4 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:38.449028 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-616853ee-da93-4edc-adb6-dfb7b1e79fe4 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:38.450057 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-616853ee-da93-4edc-adb6-dfb7b1e79fe4 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:38.450518 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-616853ee-da93-4edc-adb6-dfb7b1e79fe4 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:38.534235 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-616853ee-da93-4edc-adb6-dfb7b1e79fe4 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action" status: 200 len: 14 microversion: 2.1 time: 0.096724 Oct 29 01:38:38.535191 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1021/1911] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:38:38 2021] POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 01:38:38.597505 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [req-680b0ad0-51b3-4ca1-93e6-6c9942bfd63a req-2e70a32a-38fc-4c28-940d-b9fb0bdaca58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a271df91-65af-42bb-a06e-b3d97b359807", "tag": "cd073e79-275c-491d-8c38-18d39de4a7c2"}]} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:38:38.599007 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:38:38.599007 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: warnings.warn(msg) Oct 29 01:38:38.607599 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-680b0ad0-51b3-4ca1-93e6-6c9942bfd63a req-2e70a32a-38fc-4c28-940d-b9fb0bdaca58 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:38.608039 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-680b0ad0-51b3-4ca1-93e6-6c9942bfd63a req-2e70a32a-38fc-4c28-940d-b9fb0bdaca58 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:38.618365 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.compute.server_external_events [req-680b0ad0-51b3-4ca1-93e6-6c9942bfd63a req-2e70a32a-38fc-4c28-940d-b9fb0bdaca58 service nova] Creating event network-changed:cd073e79-275c-491d-8c38-18d39de4a7c2 for instance a271df91-65af-42bb-a06e-b3d97b359807 on hv-cinder-81558 Oct 29 01:38:38.623314 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [req-680b0ad0-51b3-4ca1-93e6-6c9942bfd63a req-2e70a32a-38fc-4c28-940d-b9fb0bdaca58 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086643 Oct 29 01:38:38.624161 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1022/1912] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:38:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:38:39.546791 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b8b76864-b1f5-48eb-82b0-9aacd5bfd1fc tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:38:39.547798 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b8b76864-b1f5-48eb-82b0-9aacd5bfd1fc tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:39.554377 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b8b76864-b1f5-48eb-82b0-9aacd5bfd1fc tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:39.554881 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b8b76864-b1f5-48eb-82b0-9aacd5bfd1fc tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:39.555650 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b8b76864-b1f5-48eb-82b0-9aacd5bfd1fc tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:39.556658 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b8b76864-b1f5-48eb-82b0-9aacd5bfd1fc tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:39.645885 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b8b76864-b1f5-48eb-82b0-9aacd5bfd1fc tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action" status: 200 len: 14 microversion: 2.1 time: 0.103097 Oct 29 01:38:39.648988 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1023/1913] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:38:39 2021] POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 01:38:40.657354 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-2338d77b-8cdd-43c5-9585-248ef0ac11c8 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:38:40.658352 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-2338d77b-8cdd-43c5-9585-248ef0ac11c8 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:40.666164 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2338d77b-8cdd-43c5-9585-248ef0ac11c8 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:40.666637 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2338d77b-8cdd-43c5-9585-248ef0ac11c8 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:40.667409 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2338d77b-8cdd-43c5-9585-248ef0ac11c8 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:40.667841 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2338d77b-8cdd-43c5-9585-248ef0ac11c8 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:40.754870 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-2338d77b-8cdd-43c5-9585-248ef0ac11c8 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action" status: 200 len: 14 microversion: 2.1 time: 0.101400 Oct 29 01:38:40.755516 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1024/1914] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:38:40 2021] POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 01:38:41.766736 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d96c0ed6-26ac-476d-bed3-5fae43c38439 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:38:41.767741 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d96c0ed6-26ac-476d-bed3-5fae43c38439 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:41.774569 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d96c0ed6-26ac-476d-bed3-5fae43c38439 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:41.775591 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d96c0ed6-26ac-476d-bed3-5fae43c38439 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:41.776414 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d96c0ed6-26ac-476d-bed3-5fae43c38439 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:41.776847 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d96c0ed6-26ac-476d-bed3-5fae43c38439 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:41.864361 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d96c0ed6-26ac-476d-bed3-5fae43c38439 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action" status: 200 len: 14 microversion: 2.1 time: 0.101468 Oct 29 01:38:41.865244 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1025/1915] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:38:41 2021] POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 01:38:42.876482 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-7507819e-2f12-4a47-a57e-f26a8eb4e55c tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:38:42.877487 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-7507819e-2f12-4a47-a57e-f26a8eb4e55c tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:42.884394 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7507819e-2f12-4a47-a57e-f26a8eb4e55c tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:42.884838 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7507819e-2f12-4a47-a57e-f26a8eb4e55c tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:42.885590 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7507819e-2f12-4a47-a57e-f26a8eb4e55c tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:42.886021 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7507819e-2f12-4a47-a57e-f26a8eb4e55c tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:42.968592 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-7507819e-2f12-4a47-a57e-f26a8eb4e55c tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action" status: 200 len: 14 microversion: 2.1 time: 0.095988 Oct 29 01:38:42.969279 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1026/1916] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:38:42 2021] POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 01:38:43.980709 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-baabdc68-3c10-4527-8e34-63d8d3d07b7a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:38:43.981624 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-baabdc68-3c10-4527-8e34-63d8d3d07b7a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:43.988839 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-baabdc68-3c10-4527-8e34-63d8d3d07b7a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:43.989279 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-baabdc68-3c10-4527-8e34-63d8d3d07b7a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:43.990064 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-baabdc68-3c10-4527-8e34-63d8d3d07b7a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:43.990531 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-baabdc68-3c10-4527-8e34-63d8d3d07b7a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:44.076037 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-baabdc68-3c10-4527-8e34-63d8d3d07b7a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action" status: 200 len: 14 microversion: 2.1 time: 0.099927 Oct 29 01:38:44.076671 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1027/1917] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:38:43 2021] POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:38:45.087742 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-4225b677-9033-428a-b17a-c384f4fdd856 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:38:45.088752 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-4225b677-9033-428a-b17a-c384f4fdd856 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:45.095786 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4225b677-9033-428a-b17a-c384f4fdd856 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:45.096240 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4225b677-9033-428a-b17a-c384f4fdd856 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:45.097048 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4225b677-9033-428a-b17a-c384f4fdd856 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:45.097482 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4225b677-9033-428a-b17a-c384f4fdd856 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:45.182870 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-4225b677-9033-428a-b17a-c384f4fdd856 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action" status: 200 len: 14 microversion: 2.1 time: 0.099005 Oct 29 01:38:45.183516 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1028/1918] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:38:45 2021] POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 01:38:46.194461 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9ce7c2fa-f3ae-4d02-a35b-6362273d38dc tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:38:46.195390 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9ce7c2fa-f3ae-4d02-a35b-6362273d38dc tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:46.203258 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9ce7c2fa-f3ae-4d02-a35b-6362273d38dc tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:46.203701 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9ce7c2fa-f3ae-4d02-a35b-6362273d38dc tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:46.204470 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9ce7c2fa-f3ae-4d02-a35b-6362273d38dc tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:46.204897 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9ce7c2fa-f3ae-4d02-a35b-6362273d38dc tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:46.294470 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9ce7c2fa-f3ae-4d02-a35b-6362273d38dc tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action" status: 200 len: 14 microversion: 2.1 time: 0.103804 Oct 29 01:38:46.295427 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1029/1919] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:38:46 2021] POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 01:38:47.307025 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b965698a-da03-4f07-a30b-4f5c3f65c6be tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:38:47.307958 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b965698a-da03-4f07-a30b-4f5c3f65c6be tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:47.315101 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b965698a-da03-4f07-a30b-4f5c3f65c6be tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:47.315541 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b965698a-da03-4f07-a30b-4f5c3f65c6be tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:47.316314 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b965698a-da03-4f07-a30b-4f5c3f65c6be tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:47.316744 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b965698a-da03-4f07-a30b-4f5c3f65c6be tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:47.402178 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b965698a-da03-4f07-a30b-4f5c3f65c6be tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action" status: 200 len: 14 microversion: 2.1 time: 0.099682 Oct 29 01:38:47.403088 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1030/1920] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:38:47 2021] POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 01:38:48.413477 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-84deb3a6-4b0d-47f7-97e7-a01aa6da23c3 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:38:48.414511 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-84deb3a6-4b0d-47f7-97e7-a01aa6da23c3 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:48.421684 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-84deb3a6-4b0d-47f7-97e7-a01aa6da23c3 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:48.422134 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-84deb3a6-4b0d-47f7-97e7-a01aa6da23c3 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:48.423005 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-84deb3a6-4b0d-47f7-97e7-a01aa6da23c3 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:48.423397 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-84deb3a6-4b0d-47f7-97e7-a01aa6da23c3 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:48.523096 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-84deb3a6-4b0d-47f7-97e7-a01aa6da23c3 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action" status: 200 len: 5108 microversion: 2.1 time: 0.113392 Oct 29 01:38:48.523744 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1031/1921] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:38:48 2021] POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action => generated 5108 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:38:49.534490 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-8b8a5de8-c582-4739-ac5a-a9089206929d tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:38:49.535417 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-8b8a5de8-c582-4739-ac5a-a9089206929d tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:49.542303 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8b8a5de8-c582-4739-ac5a-a9089206929d tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:49.542769 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8b8a5de8-c582-4739-ac5a-a9089206929d tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:49.543522 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8b8a5de8-c582-4739-ac5a-a9089206929d tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:49.543950 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8b8a5de8-c582-4739-ac5a-a9089206929d tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:49.638825 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-8b8a5de8-c582-4739-ac5a-a9089206929d tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action" status: 200 len: 15025 microversion: 2.1 time: 0.108226 Oct 29 01:38:49.639503 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1032/1922] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:38:49 2021] POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action => generated 15025 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:38:50.650905 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-4bddd841-5b46-42d2-bc66-5588953392c7 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:38:50.651899 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-4bddd841-5b46-42d2-bc66-5588953392c7 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:50.658767 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4bddd841-5b46-42d2-bc66-5588953392c7 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:50.659207 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4bddd841-5b46-42d2-bc66-5588953392c7 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:50.660135 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4bddd841-5b46-42d2-bc66-5588953392c7 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:50.660565 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4bddd841-5b46-42d2-bc66-5588953392c7 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:50.770670 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-4bddd841-5b46-42d2-bc66-5588953392c7 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action" status: 200 len: 18449 microversion: 2.1 time: 0.124587 Oct 29 01:38:50.771320 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1033/1923] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:38:50 2021] POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action => generated 18449 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:38:51.782668 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ec476aeb-41bd-4de0-88bb-86edb8b6c52e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:38:51.783810 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ec476aeb-41bd-4de0-88bb-86edb8b6c52e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:51.792692 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ec476aeb-41bd-4de0-88bb-86edb8b6c52e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:51.793145 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ec476aeb-41bd-4de0-88bb-86edb8b6c52e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:51.793953 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ec476aeb-41bd-4de0-88bb-86edb8b6c52e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:51.794379 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ec476aeb-41bd-4de0-88bb-86edb8b6c52e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:51.893889 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ec476aeb-41bd-4de0-88bb-86edb8b6c52e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action" status: 200 len: 19342 microversion: 2.1 time: 0.115155 Oct 29 01:38:51.894595 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1034/1924] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:38:51 2021] POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action => generated 19342 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:38:52.906315 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-8b9271be-de7d-4278-8996-47e83f632673 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:38:52.907345 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-8b9271be-de7d-4278-8996-47e83f632673 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:52.914183 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8b9271be-de7d-4278-8996-47e83f632673 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:52.914659 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8b9271be-de7d-4278-8996-47e83f632673 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:52.916134 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8b9271be-de7d-4278-8996-47e83f632673 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:52.916562 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8b9271be-de7d-4278-8996-47e83f632673 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:53.007316 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-8b9271be-de7d-4278-8996-47e83f632673 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action" status: 200 len: 22118 microversion: 2.1 time: 0.105007 Oct 29 01:38:53.008023 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1035/1925] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:38:52 2021] POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action => generated 22118 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:38:54.020182 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-4252edce-16e9-49ef-899c-def64d6734ca tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:38:54.021189 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-4252edce-16e9-49ef-899c-def64d6734ca tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:54.028240 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4252edce-16e9-49ef-899c-def64d6734ca tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:54.028715 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4252edce-16e9-49ef-899c-def64d6734ca tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:54.029491 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4252edce-16e9-49ef-899c-def64d6734ca tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:54.029928 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4252edce-16e9-49ef-899c-def64d6734ca tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:54.129857 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-4252edce-16e9-49ef-899c-def64d6734ca tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action" status: 200 len: 23603 microversion: 2.1 time: 0.113469 Oct 29 01:38:54.130543 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1036/1926] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:38:54 2021] POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action => generated 23603 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:38:55.141697 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-1c9ba6b4-6e72-40db-8ccf-2cfe1ac9be15 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:38:55.142799 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-1c9ba6b4-6e72-40db-8ccf-2cfe1ac9be15 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:55.149822 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1c9ba6b4-6e72-40db-8ccf-2cfe1ac9be15 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:55.150269 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1c9ba6b4-6e72-40db-8ccf-2cfe1ac9be15 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:55.151084 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1c9ba6b4-6e72-40db-8ccf-2cfe1ac9be15 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:55.151515 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1c9ba6b4-6e72-40db-8ccf-2cfe1ac9be15 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:55.262689 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-1c9ba6b4-6e72-40db-8ccf-2cfe1ac9be15 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action" status: 200 len: 25148 microversion: 2.1 time: 0.124744 Oct 29 01:38:55.263263 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1037/1927] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:38:55 2021] POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action => generated 25148 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:38:56.275807 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-0f5a61ed-bc71-4099-8a99-f4fce828816a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:38:56.276821 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-0f5a61ed-bc71-4099-8a99-f4fce828816a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:56.284231 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0f5a61ed-bc71-4099-8a99-f4fce828816a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:56.284681 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0f5a61ed-bc71-4099-8a99-f4fce828816a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:56.285457 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0f5a61ed-bc71-4099-8a99-f4fce828816a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:56.285888 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0f5a61ed-bc71-4099-8a99-f4fce828816a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:56.398724 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-0f5a61ed-bc71-4099-8a99-f4fce828816a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action" status: 200 len: 26542 microversion: 2.1 time: 0.127596 Oct 29 01:38:56.399425 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1038/1928] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:38:56 2021] POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action => generated 26542 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:38:57.410722 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9c9c580f-47e0-483e-a55d-cd0bc2ef71ef tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:38:57.411632 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9c9c580f-47e0-483e-a55d-cd0bc2ef71ef tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:57.419296 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9c9c580f-47e0-483e-a55d-cd0bc2ef71ef tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:57.419739 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9c9c580f-47e0-483e-a55d-cd0bc2ef71ef tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:57.420500 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9c9c580f-47e0-483e-a55d-cd0bc2ef71ef tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:57.421022 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9c9c580f-47e0-483e-a55d-cd0bc2ef71ef tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:57.519908 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9c9c580f-47e0-483e-a55d-cd0bc2ef71ef tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action" status: 200 len: 27577 microversion: 2.1 time: 0.113115 Oct 29 01:38:57.520832 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1039/1929] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:38:57 2021] POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action => generated 27577 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:38:58.531650 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ee86613e-52e8-4817-a3da-7abe599e98c4 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:38:58.532652 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ee86613e-52e8-4817-a3da-7abe599e98c4 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:58.539807 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ee86613e-52e8-4817-a3da-7abe599e98c4 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:58.540769 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ee86613e-52e8-4817-a3da-7abe599e98c4 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:58.541546 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ee86613e-52e8-4817-a3da-7abe599e98c4 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:58.541977 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ee86613e-52e8-4817-a3da-7abe599e98c4 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:58.653963 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ee86613e-52e8-4817-a3da-7abe599e98c4 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action" status: 200 len: 28031 microversion: 2.1 time: 0.126279 Oct 29 01:38:58.654678 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1040/1930] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:38:58 2021] POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action => generated 28031 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:38:59.665909 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-e83cf1c3-6cdf-4fab-97ee-56087d74721a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:38:59.666926 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-e83cf1c3-6cdf-4fab-97ee-56087d74721a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:59.673606 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e83cf1c3-6cdf-4fab-97ee-56087d74721a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:59.674045 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e83cf1c3-6cdf-4fab-97ee-56087d74721a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:59.674840 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e83cf1c3-6cdf-4fab-97ee-56087d74721a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:59.675264 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e83cf1c3-6cdf-4fab-97ee-56087d74721a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:59.771210 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-e83cf1c3-6cdf-4fab-97ee-56087d74721a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action" status: 200 len: 28220 microversion: 2.1 time: 0.109291 Oct 29 01:38:59.772036 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1041/1931] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:38:59 2021] POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action => generated 28220 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:39:00.783327 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-546894bc-7033-402a-ba7c-0fc101661239 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:00.784316 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-546894bc-7033-402a-ba7c-0fc101661239 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:39:00.791091 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-546894bc-7033-402a-ba7c-0fc101661239 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:00.791536 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-546894bc-7033-402a-ba7c-0fc101661239 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:00.792288 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-546894bc-7033-402a-ba7c-0fc101661239 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:00.792719 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-546894bc-7033-402a-ba7c-0fc101661239 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:00.882929 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-546894bc-7033-402a-ba7c-0fc101661239 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action" status: 200 len: 28220 microversion: 2.1 time: 0.103437 Oct 29 01:39:00.883547 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1042/1932] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:39:00 2021] POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action => generated 28220 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:39:01.896227 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-1660f4d8-4d42-478e-b7c6-e6c2c543b4a1 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:01.897234 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-1660f4d8-4d42-478e-b7c6-e6c2c543b4a1 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:39:01.904816 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1660f4d8-4d42-478e-b7c6-e6c2c543b4a1 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:01.905185 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1660f4d8-4d42-478e-b7c6-e6c2c543b4a1 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:01.906774 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1660f4d8-4d42-478e-b7c6-e6c2c543b4a1 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:01.907289 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1660f4d8-4d42-478e-b7c6-e6c2c543b4a1 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:02.002156 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-1660f4d8-4d42-478e-b7c6-e6c2c543b4a1 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action" status: 200 len: 28511 microversion: 2.1 time: 0.110349 Oct 29 01:39:02.002834 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1043/1933] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:39:01 2021] POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action => generated 28511 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:39:03.014124 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f0ef96bc-ded5-4377-b983-d02b36e4ef6a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:03.015153 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f0ef96bc-ded5-4377-b983-d02b36e4ef6a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:39:03.022213 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f0ef96bc-ded5-4377-b983-d02b36e4ef6a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:03.022681 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f0ef96bc-ded5-4377-b983-d02b36e4ef6a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:03.023432 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f0ef96bc-ded5-4377-b983-d02b36e4ef6a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:03.023938 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f0ef96bc-ded5-4377-b983-d02b36e4ef6a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:03.121089 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f0ef96bc-ded5-4377-b983-d02b36e4ef6a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action" status: 200 len: 28679 microversion: 2.1 time: 0.110820 Oct 29 01:39:03.121740 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1044/1934] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:39:03 2021] POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action => generated 28679 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:39:04.133085 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ea0f6494-eb64-46f7-ab20-80bb8055e5c5 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:04.134699 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ea0f6494-eb64-46f7-ab20-80bb8055e5c5 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:39:04.141467 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ea0f6494-eb64-46f7-ab20-80bb8055e5c5 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:04.141915 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ea0f6494-eb64-46f7-ab20-80bb8055e5c5 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:04.142698 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ea0f6494-eb64-46f7-ab20-80bb8055e5c5 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:04.143126 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ea0f6494-eb64-46f7-ab20-80bb8055e5c5 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:04.231511 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ea0f6494-eb64-46f7-ab20-80bb8055e5c5 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action" status: 200 len: 28679 microversion: 2.1 time: 0.102225 Oct 29 01:39:04.232054 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1045/1935] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:39:04 2021] POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action => generated 28679 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:39:05.244575 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c09bc94e-8869-4cdc-8441-64110691fb3f tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:05.245548 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c09bc94e-8869-4cdc-8441-64110691fb3f tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:39:05.252456 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c09bc94e-8869-4cdc-8441-64110691fb3f tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:05.252898 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c09bc94e-8869-4cdc-8441-64110691fb3f tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:05.253665 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c09bc94e-8869-4cdc-8441-64110691fb3f tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:05.254245 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c09bc94e-8869-4cdc-8441-64110691fb3f tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:05.346598 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c09bc94e-8869-4cdc-8441-64110691fb3f tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action" status: 200 len: 28679 microversion: 2.1 time: 0.106709 Oct 29 01:39:05.347269 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1046/1936] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:39:05 2021] POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action => generated 28679 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:39:06.358834 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b9880f6a-7678-4021-9476-47f612ddf56c tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:06.359833 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b9880f6a-7678-4021-9476-47f612ddf56c tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:39:06.366611 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b9880f6a-7678-4021-9476-47f612ddf56c tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:06.367063 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b9880f6a-7678-4021-9476-47f612ddf56c tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:06.367822 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b9880f6a-7678-4021-9476-47f612ddf56c tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:06.368843 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b9880f6a-7678-4021-9476-47f612ddf56c tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:06.469041 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b9880f6a-7678-4021-9476-47f612ddf56c tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action" status: 200 len: 28791 microversion: 2.1 time: 0.114081 Oct 29 01:39:06.469689 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1047/1937] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:39:06 2021] POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action => generated 28791 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:39:07.482504 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c7a0aca9-f902-4f03-a3d4-3d26065a7d4a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:07.483504 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c7a0aca9-f902-4f03-a3d4-3d26065a7d4a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:39:07.490514 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c7a0aca9-f902-4f03-a3d4-3d26065a7d4a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:07.490963 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c7a0aca9-f902-4f03-a3d4-3d26065a7d4a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:07.491726 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c7a0aca9-f902-4f03-a3d4-3d26065a7d4a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:07.492160 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c7a0aca9-f902-4f03-a3d4-3d26065a7d4a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:07.589220 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c7a0aca9-f902-4f03-a3d4-3d26065a7d4a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action" status: 200 len: 30753 microversion: 2.1 time: 0.110727 Oct 29 01:39:07.589877 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1048/1938] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:39:07 2021] POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action => generated 30753 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:39:08.601149 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f46c4a47-e468-431f-aee7-63c75b819ebe tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:08.602178 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f46c4a47-e468-431f-aee7-63c75b819ebe tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:39:08.608946 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f46c4a47-e468-431f-aee7-63c75b819ebe tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:08.609391 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f46c4a47-e468-431f-aee7-63c75b819ebe tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:08.610177 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f46c4a47-e468-431f-aee7-63c75b819ebe tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:08.610634 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f46c4a47-e468-431f-aee7-63c75b819ebe tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:08.709034 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f46c4a47-e468-431f-aee7-63c75b819ebe tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action" status: 200 len: 32414 microversion: 2.1 time: 0.111855 Oct 29 01:39:08.709908 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1049/1939] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:39:08 2021] POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action => generated 32414 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:39:09.721137 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-8c2745c3-b1d5-4f56-9354-51de6812a81b tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:09.722130 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-8c2745c3-b1d5-4f56-9354-51de6812a81b tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:39:09.728983 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8c2745c3-b1d5-4f56-9354-51de6812a81b tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:09.729427 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8c2745c3-b1d5-4f56-9354-51de6812a81b tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:09.730176 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8c2745c3-b1d5-4f56-9354-51de6812a81b tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:09.730637 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8c2745c3-b1d5-4f56-9354-51de6812a81b tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:09.888888 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-8c2745c3-b1d5-4f56-9354-51de6812a81b tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action" status: 200 len: 33387 microversion: 2.1 time: 0.171612 Oct 29 01:39:09.889875 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1050/1940] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:39:09 2021] POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action => generated 33387 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:39:10.901705 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-4cdd1b12-a531-4cb9-9b29-b8c9cdf7a3a1 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:10.902749 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-4cdd1b12-a531-4cb9-9b29-b8c9cdf7a3a1 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:39:10.909597 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4cdd1b12-a531-4cb9-9b29-b8c9cdf7a3a1 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:10.910051 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4cdd1b12-a531-4cb9-9b29-b8c9cdf7a3a1 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:10.910837 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4cdd1b12-a531-4cb9-9b29-b8c9cdf7a3a1 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:10.911269 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4cdd1b12-a531-4cb9-9b29-b8c9cdf7a3a1 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:11.007232 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-4cdd1b12-a531-4cb9-9b29-b8c9cdf7a3a1 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action" status: 200 len: 34186 microversion: 2.1 time: 0.109912 Oct 29 01:39:11.008166 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1051/1941] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:39:10 2021] POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action => generated 34186 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:39:12.019929 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b06bf89b-9cf7-4d3c-b893-15aec782ad0e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:12.020921 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b06bf89b-9cf7-4d3c-b893-15aec782ad0e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:39:12.027710 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b06bf89b-9cf7-4d3c-b893-15aec782ad0e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:12.028515 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b06bf89b-9cf7-4d3c-b893-15aec782ad0e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:12.029262 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b06bf89b-9cf7-4d3c-b893-15aec782ad0e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:12.029690 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b06bf89b-9cf7-4d3c-b893-15aec782ad0e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:12.125444 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b06bf89b-9cf7-4d3c-b893-15aec782ad0e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action" status: 200 len: 35578 microversion: 2.1 time: 0.109444 Oct 29 01:39:12.126105 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1052/1942] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:39:12 2021] POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action => generated 35578 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:39:13.138100 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-88c41359-4c17-4513-a097-f47aa9554c5b tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:13.139128 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-88c41359-4c17-4513-a097-f47aa9554c5b tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:39:13.146125 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-88c41359-4c17-4513-a097-f47aa9554c5b tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:13.146607 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-88c41359-4c17-4513-a097-f47aa9554c5b tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:13.147365 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-88c41359-4c17-4513-a097-f47aa9554c5b tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:13.147797 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-88c41359-4c17-4513-a097-f47aa9554c5b tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:13.250656 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-88c41359-4c17-4513-a097-f47aa9554c5b tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action" status: 200 len: 38130 microversion: 2.1 time: 0.116883 Oct 29 01:39:13.251250 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1053/1943] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:39:13 2021] POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action => generated 38130 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:39:14.263364 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f1b28e05-53db-4c0b-9a45-8b079c071cf9 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:14.264288 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f1b28e05-53db-4c0b-9a45-8b079c071cf9 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:39:14.271133 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f1b28e05-53db-4c0b-9a45-8b079c071cf9 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:14.271585 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f1b28e05-53db-4c0b-9a45-8b079c071cf9 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:14.272346 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f1b28e05-53db-4c0b-9a45-8b079c071cf9 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:14.272779 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f1b28e05-53db-4c0b-9a45-8b079c071cf9 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:14.374166 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f1b28e05-53db-4c0b-9a45-8b079c071cf9 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action" status: 200 len: 38211 microversion: 2.1 time: 0.115217 Oct 29 01:39:14.374855 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1054/1944] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:39:14 2021] POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action => generated 38211 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:39:15.387311 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ef35aec2-582a-4581-8f26-3f52922f9f1a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:15.388371 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ef35aec2-582a-4581-8f26-3f52922f9f1a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:39:15.395158 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ef35aec2-582a-4581-8f26-3f52922f9f1a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:15.395602 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ef35aec2-582a-4581-8f26-3f52922f9f1a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:15.396354 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ef35aec2-582a-4581-8f26-3f52922f9f1a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:15.396784 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ef35aec2-582a-4581-8f26-3f52922f9f1a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:15.485560 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ef35aec2-582a-4581-8f26-3f52922f9f1a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action" status: 200 len: 38211 microversion: 2.1 time: 0.102772 Oct 29 01:39:15.486186 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1055/1945] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:39:15 2021] POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action => generated 38211 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:39:16.498301 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c6951838-d2d7-43b3-986c-0df2cd158a8f tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:16.499361 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c6951838-d2d7-43b3-986c-0df2cd158a8f tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:39:16.506232 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c6951838-d2d7-43b3-986c-0df2cd158a8f tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:16.506716 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c6951838-d2d7-43b3-986c-0df2cd158a8f tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:16.507478 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c6951838-d2d7-43b3-986c-0df2cd158a8f tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:16.507907 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c6951838-d2d7-43b3-986c-0df2cd158a8f tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:16.600871 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c6951838-d2d7-43b3-986c-0df2cd158a8f tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action" status: 200 len: 38211 microversion: 2.1 time: 0.106590 Oct 29 01:39:16.601532 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1056/1946] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:39:16 2021] POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action => generated 38211 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:39:17.613458 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-dd4d1f54-ac08-4742-8111-ea4afe3a9292 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:17.614492 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-dd4d1f54-ac08-4742-8111-ea4afe3a9292 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:39:17.621323 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dd4d1f54-ac08-4742-8111-ea4afe3a9292 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:17.621752 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dd4d1f54-ac08-4742-8111-ea4afe3a9292 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:17.622530 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dd4d1f54-ac08-4742-8111-ea4afe3a9292 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:17.622958 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dd4d1f54-ac08-4742-8111-ea4afe3a9292 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:17.715114 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-dd4d1f54-ac08-4742-8111-ea4afe3a9292 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action" status: 200 len: 38225 microversion: 2.1 time: 0.105471 Oct 29 01:39:17.715769 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1057/1947] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:39:17 2021] POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action => generated 38225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:39:18.727896 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-8daa3265-3320-4778-afa2-fcf720dff567 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:18.728885 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-8daa3265-3320-4778-afa2-fcf720dff567 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:39:18.735619 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8daa3265-3320-4778-afa2-fcf720dff567 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:18.736056 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8daa3265-3320-4778-afa2-fcf720dff567 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:18.736804 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8daa3265-3320-4778-afa2-fcf720dff567 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:18.737230 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8daa3265-3320-4778-afa2-fcf720dff567 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:18.829390 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-8daa3265-3320-4778-afa2-fcf720dff567 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action" status: 200 len: 38341 microversion: 2.1 time: 0.105805 Oct 29 01:39:18.829963 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1058/1948] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:39:18 2021] POST /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/action => generated 38341 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:39:18.839867 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-908ce3bd-4cfd-4941-aa04-6c651d14652c tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:18.840439 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-908ce3bd-4cfd-4941-aa04-6c651d14652c tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:39:18.847151 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-908ce3bd-4cfd-4941-aa04-6c651d14652c tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:18.847595 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-908ce3bd-4cfd-4941-aa04-6c651d14652c tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:18.848349 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-908ce3bd-4cfd-4941-aa04-6c651d14652c tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:18.848780 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-908ce3bd-4cfd-4941-aa04-6c651d14652c tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:18.872486 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-908ce3bd-4cfd-4941-aa04-6c651d14652c tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "GET /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/ips" status: 200 len: 147 microversion: 2.1 time: 0.036427 Oct 29 01:39:18.873069 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1059/1949] 10.222.0.90 () {58 vars in 1247 bytes} [Fri Oct 29 01:39:18 2021] GET /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807/ips => generated 147 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:39:20.926337 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:39:20.926944 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: Fri Oct 29 01:39:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf (ip 10.222.0.90) !!! Oct 29 01:39:23.114305 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:39:23.114945 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: Fri Oct 29 01:39:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf (ip 10.222.0.90) !!! Oct 29 01:40:02.315783 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:40:02.316468 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: Fri Oct 29 01:40:02 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf (ip 10.222.0.90) !!! Oct 29 01:40:12.767096 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.objects.instance [None req-32665a49-0b09-4c4c-a596-98f419332fd9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lazy-loading 'services' on Instance uuid 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d {{(pid=115748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:40:13.863623 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.wsgi [None req-32665a49-0b09-4c4c-a596-98f419332fd9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6132d2f2-e4a9-4073-9c4d-11c0beb8b34f) Oct 29 01:40:13.864240 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-32665a49-0b09-4c4c-a596-98f419332fd9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6132d2f2-e4a9-4073-9c4d-11c0beb8b34f) {{(pid=115748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:40:13.865058 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-32665a49-0b09-4c4c-a596-98f419332fd9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "DELETE /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf" status: 400 len: 269 microversion: 2.1 time: 120.084789 Oct 29 01:40:13.865564 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: Fri Oct 29 01:40:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf (ip 10.222.0.90) !!! Oct 29 01:40:13.865564 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: Fri Oct 29 01:40:13 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf (10.222.0.90) Oct 29 01:40:13.866402 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: CRITICAL nova [None req-32665a49-0b09-4c4c-a596-98f419332fd9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Unhandled error: OSError: write error Oct 29 01:40:13.866402 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: ERROR nova OSError: write error Oct 29 01:40:13.866402 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: ERROR nova Oct 29 01:40:13.866686 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 891/1950] 10.222.0.90 () {58 vars in 1415 bytes} [Fri Oct 29 01:38:13 2021] DELETE /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d/os-volume_attachments/83b8cfc7-3e81-413f-9854-1aaebf9058bf => generated 0 bytes in 120087 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Oct 29 01:40:47.827933 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:40:47.828530 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: Fri Oct 29 01:40:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 29 01:41:00.807497 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:41:00.808109 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: Fri Oct 29 01:41:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 29 01:42:13.563390 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e413c88e-9bb9-4b55-ad87-c29a2819600c] AMQP server on 10.222.0.90:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 29 01:42:13.567614 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-cdd882d4-b16d-4383-9c53-3bec22dcca68 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:13.568110 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-cdd882d4-b16d-4383-9c53-3bec22dcca68 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:42:13.574375 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cdd882d4-b16d-4383-9c53-3bec22dcca68 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:13.574856 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cdd882d4-b16d-4383-9c53-3bec22dcca68 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:13.575614 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cdd882d4-b16d-4383-9c53-3bec22dcca68 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:13.576049 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cdd882d4-b16d-4383-9c53-3bec22dcca68 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:13.600967 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-cdd882d4-b16d-4383-9c53-3bec22dcca68 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Going to try to terminate instance {{(pid=115747) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 01:42:13.679301 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-cdd882d4-b16d-4383-9c53-3bec22dcca68 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "DELETE /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 204 len: 0 microversion: 2.1 time: 0.117708 Oct 29 01:42:13.679886 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1060/1951] 10.222.0.90 () {58 vars in 1238 bytes} [Fri Oct 29 01:42:13 2021] DELETE /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:42:13.687391 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: ERROR oslo.messaging._drivers.impl_rabbit [-] [282d919e-4d8a-4145-9e72-cb56a005dd66] AMQP server on 10.222.0.90:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 29 01:42:13.691341 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-26c439a3-cb54-4afd-ac74-27dc84ffffa6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:13.692002 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-26c439a3-cb54-4afd-ac74-27dc84ffffa6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:42:13.699076 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-26c439a3-cb54-4afd-ac74-27dc84ffffa6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:13.699527 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-26c439a3-cb54-4afd-ac74-27dc84ffffa6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:13.700291 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-26c439a3-cb54-4afd-ac74-27dc84ffffa6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:13.700733 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-26c439a3-cb54-4afd-ac74-27dc84ffffa6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:13.820675 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-26c439a3-cb54-4afd-ac74-27dc84ffffa6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:13.828552 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-26c439a3-cb54-4afd-ac74-27dc84ffffa6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.143508 Oct 29 01:42:13.829123 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 892/1952] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:42:13 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:42:14.846685 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-e0c42b30-9983-48ac-a26c-6bf7f4ad37dc tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:14.847377 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-e0c42b30-9983-48ac-a26c-6bf7f4ad37dc tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:42:14.864715 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e0c42b30-9983-48ac-a26c-6bf7f4ad37dc tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:14.865155 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e0c42b30-9983-48ac-a26c-6bf7f4ad37dc tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:14.866121 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e0c42b30-9983-48ac-a26c-6bf7f4ad37dc tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:14.866582 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e0c42b30-9983-48ac-a26c-6bf7f4ad37dc tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:14.871833 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO oslo.messaging._drivers.impl_rabbit [-] [e413c88e-9bb9-4b55-ad87-c29a2819600c] Reconnected to AMQP server on 10.222.0.90:5672 via [amqp] client with port 45778. Oct 29 01:42:15.042374 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-e0c42b30-9983-48ac-a26c-6bf7f4ad37dc tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:15.049918 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-e0c42b30-9983-48ac-a26c-6bf7f4ad37dc tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.207342 Oct 29 01:42:15.050487 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1061/1953] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:42:14 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:16.066333 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-785fcdc9-d8f1-4615-81b2-49841bf8c576 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:16.066971 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-785fcdc9-d8f1-4615-81b2-49841bf8c576 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:42:16.083869 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-785fcdc9-d8f1-4615-81b2-49841bf8c576 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:16.084323 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-785fcdc9-d8f1-4615-81b2-49841bf8c576 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:16.085102 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-785fcdc9-d8f1-4615-81b2-49841bf8c576 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:16.085537 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-785fcdc9-d8f1-4615-81b2-49841bf8c576 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:16.090979 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO oslo.messaging._drivers.impl_rabbit [-] [282d919e-4d8a-4145-9e72-cb56a005dd66] Reconnected to AMQP server on 10.222.0.90:5672 via [amqp] client with port 45790. Oct 29 01:42:16.204641 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-785fcdc9-d8f1-4615-81b2-49841bf8c576 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:16.212373 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-785fcdc9-d8f1-4615-81b2-49841bf8c576 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.149640 Oct 29 01:42:16.212877 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 893/1954] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:42:16 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:17.229568 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-48afbcb4-9358-4e93-a6f6-39fbf64f18ef tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:17.230141 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-48afbcb4-9358-4e93-a6f6-39fbf64f18ef tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:42:17.236915 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-48afbcb4-9358-4e93-a6f6-39fbf64f18ef tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:17.237563 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-48afbcb4-9358-4e93-a6f6-39fbf64f18ef tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:17.238336 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-48afbcb4-9358-4e93-a6f6-39fbf64f18ef tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:17.238802 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-48afbcb4-9358-4e93-a6f6-39fbf64f18ef tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:17.358173 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-48afbcb4-9358-4e93-a6f6-39fbf64f18ef tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:17.365734 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-48afbcb4-9358-4e93-a6f6-39fbf64f18ef tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.140585 Oct 29 01:42:17.366290 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1062/1955] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:42:17 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:18.382682 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-567a9feb-4a3b-4615-a071-f97ba67247b2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:18.383297 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-567a9feb-4a3b-4615-a071-f97ba67247b2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:42:18.389416 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-567a9feb-4a3b-4615-a071-f97ba67247b2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:18.389858 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-567a9feb-4a3b-4615-a071-f97ba67247b2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:18.390650 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-567a9feb-4a3b-4615-a071-f97ba67247b2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:18.391087 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-567a9feb-4a3b-4615-a071-f97ba67247b2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:18.514931 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-567a9feb-4a3b-4615-a071-f97ba67247b2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:18.523021 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-567a9feb-4a3b-4615-a071-f97ba67247b2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.144258 Oct 29 01:42:18.523594 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 894/1956] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:42:18 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:19.539712 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-3981d3f1-e246-4f36-99ca-73bc367fd846 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:19.540357 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-3981d3f1-e246-4f36-99ca-73bc367fd846 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:42:19.549165 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3981d3f1-e246-4f36-99ca-73bc367fd846 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:19.549618 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3981d3f1-e246-4f36-99ca-73bc367fd846 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:19.550464 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3981d3f1-e246-4f36-99ca-73bc367fd846 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:19.550912 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3981d3f1-e246-4f36-99ca-73bc367fd846 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:19.668350 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-3981d3f1-e246-4f36-99ca-73bc367fd846 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:19.676067 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-3981d3f1-e246-4f36-99ca-73bc367fd846 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.140057 Oct 29 01:42:19.676630 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1063/1957] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:42:19 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:20.692804 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-1965f845-b71c-4188-a85c-bd8b567c50b8 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:20.693411 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-1965f845-b71c-4188-a85c-bd8b567c50b8 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:42:20.699755 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1965f845-b71c-4188-a85c-bd8b567c50b8 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:20.700197 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1965f845-b71c-4188-a85c-bd8b567c50b8 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:20.701006 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1965f845-b71c-4188-a85c-bd8b567c50b8 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:20.701460 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1965f845-b71c-4188-a85c-bd8b567c50b8 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:20.819371 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-1965f845-b71c-4188-a85c-bd8b567c50b8 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:20.826996 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-1965f845-b71c-4188-a85c-bd8b567c50b8 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.137887 Oct 29 01:42:20.827805 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 895/1958] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:42:20 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:21.844022 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a891409e-74d9-4148-942e-87ec1ac78da5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:21.844629 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a891409e-74d9-4148-942e-87ec1ac78da5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:42:21.851038 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a891409e-74d9-4148-942e-87ec1ac78da5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:21.851553 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a891409e-74d9-4148-942e-87ec1ac78da5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:21.852248 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a891409e-74d9-4148-942e-87ec1ac78da5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:21.852676 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a891409e-74d9-4148-942e-87ec1ac78da5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:21.978308 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-a891409e-74d9-4148-942e-87ec1ac78da5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:21.986112 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a891409e-74d9-4148-942e-87ec1ac78da5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.145789 Oct 29 01:42:21.986802 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1064/1959] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:42:21 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:23.003657 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c02372ee-3415-4915-a825-9009df541566 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:23.004380 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c02372ee-3415-4915-a825-9009df541566 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:42:23.011781 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c02372ee-3415-4915-a825-9009df541566 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:23.012295 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c02372ee-3415-4915-a825-9009df541566 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:23.013429 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c02372ee-3415-4915-a825-9009df541566 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:23.013980 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c02372ee-3415-4915-a825-9009df541566 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:23.137878 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-c02372ee-3415-4915-a825-9009df541566 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:23.145517 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c02372ee-3415-4915-a825-9009df541566 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.145689 Oct 29 01:42:23.146075 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 896/1960] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:42:22 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:24.162642 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-fd9e4f03-6bf8-4363-845f-611d608baaa4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:24.163256 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-fd9e4f03-6bf8-4363-845f-611d608baaa4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:42:24.169448 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fd9e4f03-6bf8-4363-845f-611d608baaa4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:24.169900 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fd9e4f03-6bf8-4363-845f-611d608baaa4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:24.170720 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fd9e4f03-6bf8-4363-845f-611d608baaa4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:24.171157 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fd9e4f03-6bf8-4363-845f-611d608baaa4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:24.289302 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-fd9e4f03-6bf8-4363-845f-611d608baaa4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:24.297096 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-fd9e4f03-6bf8-4363-845f-611d608baaa4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.138004 Oct 29 01:42:24.297655 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1065/1961] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:42:24 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:25.312769 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-97059712-52a0-49dd-99bc-d378fca6e8b4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:25.313304 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-97059712-52a0-49dd-99bc-d378fca6e8b4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:42:25.319564 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-97059712-52a0-49dd-99bc-d378fca6e8b4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:25.320012 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-97059712-52a0-49dd-99bc-d378fca6e8b4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:25.320769 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-97059712-52a0-49dd-99bc-d378fca6e8b4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:25.321201 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-97059712-52a0-49dd-99bc-d378fca6e8b4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:25.443542 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-97059712-52a0-49dd-99bc-d378fca6e8b4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:25.451946 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-97059712-52a0-49dd-99bc-d378fca6e8b4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.142838 Oct 29 01:42:25.452764 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 897/1962] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:42:25 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:26.468876 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c56404b1-6138-4b17-bbee-61b5b0f69527 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:26.469435 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c56404b1-6138-4b17-bbee-61b5b0f69527 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:42:26.475649 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c56404b1-6138-4b17-bbee-61b5b0f69527 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:26.476090 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c56404b1-6138-4b17-bbee-61b5b0f69527 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:26.476845 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c56404b1-6138-4b17-bbee-61b5b0f69527 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:26.477276 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c56404b1-6138-4b17-bbee-61b5b0f69527 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:26.594437 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c56404b1-6138-4b17-bbee-61b5b0f69527 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:26.602024 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c56404b1-6138-4b17-bbee-61b5b0f69527 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.136875 Oct 29 01:42:26.602613 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1066/1963] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:42:26 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:27.618741 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-08c16fe8-9b31-4067-bd46-12b3d0691357 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:27.619894 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-08c16fe8-9b31-4067-bd46-12b3d0691357 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:42:27.626164 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-08c16fe8-9b31-4067-bd46-12b3d0691357 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:27.626644 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-08c16fe8-9b31-4067-bd46-12b3d0691357 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:27.627404 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-08c16fe8-9b31-4067-bd46-12b3d0691357 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:27.627837 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-08c16fe8-9b31-4067-bd46-12b3d0691357 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:27.749289 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-08c16fe8-9b31-4067-bd46-12b3d0691357 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:27.757000 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-08c16fe8-9b31-4067-bd46-12b3d0691357 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.141916 Oct 29 01:42:27.757571 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 898/1964] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:42:27 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:28.773748 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-2e10154c-306d-46fc-98d2-32faefdf3301 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:28.774363 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-2e10154c-306d-46fc-98d2-32faefdf3301 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:42:28.781419 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2e10154c-306d-46fc-98d2-32faefdf3301 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:28.781901 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2e10154c-306d-46fc-98d2-32faefdf3301 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:28.782685 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2e10154c-306d-46fc-98d2-32faefdf3301 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:28.783147 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2e10154c-306d-46fc-98d2-32faefdf3301 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:28.903628 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-2e10154c-306d-46fc-98d2-32faefdf3301 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:28.911677 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-2e10154c-306d-46fc-98d2-32faefdf3301 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.141507 Oct 29 01:42:28.912185 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1067/1965] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:42:28 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:29.929122 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-75cf732e-d218-49ba-9a53-04ac08fcb45f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:29.929753 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-75cf732e-d218-49ba-9a53-04ac08fcb45f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:42:29.935958 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-75cf732e-d218-49ba-9a53-04ac08fcb45f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:29.936398 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-75cf732e-d218-49ba-9a53-04ac08fcb45f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:29.937146 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-75cf732e-d218-49ba-9a53-04ac08fcb45f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:29.937570 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-75cf732e-d218-49ba-9a53-04ac08fcb45f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:30.056863 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-75cf732e-d218-49ba-9a53-04ac08fcb45f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:30.064539 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-75cf732e-d218-49ba-9a53-04ac08fcb45f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.139894 Oct 29 01:42:30.065090 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 899/1966] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:42:29 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:31.081047 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-85e130e9-b1e1-4341-88f3-afd0779a4773 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:31.081679 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-85e130e9-b1e1-4341-88f3-afd0779a4773 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:42:31.088408 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-85e130e9-b1e1-4341-88f3-afd0779a4773 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:31.088855 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-85e130e9-b1e1-4341-88f3-afd0779a4773 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:31.089606 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-85e130e9-b1e1-4341-88f3-afd0779a4773 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:31.090038 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-85e130e9-b1e1-4341-88f3-afd0779a4773 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:31.206033 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-85e130e9-b1e1-4341-88f3-afd0779a4773 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:31.214407 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-85e130e9-b1e1-4341-88f3-afd0779a4773 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.137152 Oct 29 01:42:31.214931 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1068/1967] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:42:31 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:32.231881 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e45a5475-b600-479b-80d7-d70daac83dff tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:32.232431 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-e45a5475-b600-479b-80d7-d70daac83dff tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:42:32.239294 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e45a5475-b600-479b-80d7-d70daac83dff tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:32.239734 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e45a5475-b600-479b-80d7-d70daac83dff tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:32.240483 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e45a5475-b600-479b-80d7-d70daac83dff tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:32.240906 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e45a5475-b600-479b-80d7-d70daac83dff tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:32.371398 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-e45a5475-b600-479b-80d7-d70daac83dff tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:32.379506 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-e45a5475-b600-479b-80d7-d70daac83dff tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.151851 Oct 29 01:42:32.380069 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 900/1968] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:42:32 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:33.396374 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d49889da-c7d9-4c15-986d-6f24d72da482 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:33.396977 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d49889da-c7d9-4c15-986d-6f24d72da482 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:42:33.403145 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d49889da-c7d9-4c15-986d-6f24d72da482 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:33.403587 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d49889da-c7d9-4c15-986d-6f24d72da482 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:33.404342 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d49889da-c7d9-4c15-986d-6f24d72da482 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:33.404841 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d49889da-c7d9-4c15-986d-6f24d72da482 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:33.524167 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-d49889da-c7d9-4c15-986d-6f24d72da482 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:33.532021 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d49889da-c7d9-4c15-986d-6f24d72da482 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.139365 Oct 29 01:42:33.532599 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1069/1969] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:42:33 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:34.548713 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-a310c3d5-af3a-4a2f-811a-7e238d60bd32 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:34.549334 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-a310c3d5-af3a-4a2f-811a-7e238d60bd32 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:42:34.555535 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a310c3d5-af3a-4a2f-811a-7e238d60bd32 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:34.555973 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a310c3d5-af3a-4a2f-811a-7e238d60bd32 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:34.556782 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a310c3d5-af3a-4a2f-811a-7e238d60bd32 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:34.557883 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a310c3d5-af3a-4a2f-811a-7e238d60bd32 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:34.677738 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-a310c3d5-af3a-4a2f-811a-7e238d60bd32 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:34.686086 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-a310c3d5-af3a-4a2f-811a-7e238d60bd32 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.140953 Oct 29 01:42:34.686674 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 901/1970] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:42:34 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:35.703881 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-84f6e7d7-2a69-44d4-8903-69bc2a4176a2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:35.704428 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-84f6e7d7-2a69-44d4-8903-69bc2a4176a2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:42:35.710542 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-84f6e7d7-2a69-44d4-8903-69bc2a4176a2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:35.710986 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-84f6e7d7-2a69-44d4-8903-69bc2a4176a2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:35.711742 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-84f6e7d7-2a69-44d4-8903-69bc2a4176a2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:35.712172 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-84f6e7d7-2a69-44d4-8903-69bc2a4176a2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:35.836235 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-84f6e7d7-2a69-44d4-8903-69bc2a4176a2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:35.844087 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-84f6e7d7-2a69-44d4-8903-69bc2a4176a2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.144326 Oct 29 01:42:35.844651 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1070/1971] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:42:35 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:36.860951 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-eda6fc66-e298-4c29-ac59-11bfbed06250 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:36.861565 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-eda6fc66-e298-4c29-ac59-11bfbed06250 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:42:36.867856 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-eda6fc66-e298-4c29-ac59-11bfbed06250 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:36.868306 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-eda6fc66-e298-4c29-ac59-11bfbed06250 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:36.869083 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-eda6fc66-e298-4c29-ac59-11bfbed06250 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:36.869498 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-eda6fc66-e298-4c29-ac59-11bfbed06250 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:36.989322 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-eda6fc66-e298-4c29-ac59-11bfbed06250 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:36.996981 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-eda6fc66-e298-4c29-ac59-11bfbed06250 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.139741 Oct 29 01:42:36.997638 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 902/1972] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:42:36 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:38.013889 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a86e11f2-3cd7-40ea-954c-4deb309f8427 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:38.014604 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a86e11f2-3cd7-40ea-954c-4deb309f8427 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:42:38.020874 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a86e11f2-3cd7-40ea-954c-4deb309f8427 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:38.021365 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a86e11f2-3cd7-40ea-954c-4deb309f8427 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:38.022113 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a86e11f2-3cd7-40ea-954c-4deb309f8427 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:38.022575 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a86e11f2-3cd7-40ea-954c-4deb309f8427 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:38.145129 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-a86e11f2-3cd7-40ea-954c-4deb309f8427 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:38.153424 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a86e11f2-3cd7-40ea-954c-4deb309f8427 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.143183 Oct 29 01:42:38.154019 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1071/1973] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:42:38 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:39.170405 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-fc4da809-c265-4eeb-81ca-d883812a8dee tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:39.171019 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-fc4da809-c265-4eeb-81ca-d883812a8dee tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:42:39.177214 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fc4da809-c265-4eeb-81ca-d883812a8dee tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:39.177660 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fc4da809-c265-4eeb-81ca-d883812a8dee tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:39.178428 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fc4da809-c265-4eeb-81ca-d883812a8dee tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:39.178866 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fc4da809-c265-4eeb-81ca-d883812a8dee tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:39.300293 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-fc4da809-c265-4eeb-81ca-d883812a8dee tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:39.308633 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-fc4da809-c265-4eeb-81ca-d883812a8dee tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.142342 Oct 29 01:42:39.309194 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 903/1974] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:42:39 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:40.325989 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-6dbf6635-c779-48bf-80e3-838ba5411128 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:40.326578 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-6dbf6635-c779-48bf-80e3-838ba5411128 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:42:40.333045 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6dbf6635-c779-48bf-80e3-838ba5411128 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:40.333495 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6dbf6635-c779-48bf-80e3-838ba5411128 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:40.334247 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6dbf6635-c779-48bf-80e3-838ba5411128 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:40.334704 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6dbf6635-c779-48bf-80e3-838ba5411128 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:40.453144 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-6dbf6635-c779-48bf-80e3-838ba5411128 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:40.460870 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-6dbf6635-c779-48bf-80e3-838ba5411128 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.139257 Oct 29 01:42:40.461421 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1072/1975] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:42:40 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:40.943709 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:42:40.944218 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: Fri Oct 29 01:42:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 29 01:42:41.477780 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-3da7f6d3-0783-4d06-930c-da8d230a43c2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:41.478323 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-3da7f6d3-0783-4d06-930c-da8d230a43c2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:42:41.485351 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3da7f6d3-0783-4d06-930c-da8d230a43c2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:41.485794 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3da7f6d3-0783-4d06-930c-da8d230a43c2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:41.486577 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3da7f6d3-0783-4d06-930c-da8d230a43c2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:41.487006 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3da7f6d3-0783-4d06-930c-da8d230a43c2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:41.605199 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-3da7f6d3-0783-4d06-930c-da8d230a43c2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:41.612971 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-3da7f6d3-0783-4d06-930c-da8d230a43c2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.138946 Oct 29 01:42:41.613525 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 904/1976] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:42:41 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:42.630127 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-fa7f17ce-ae3d-4703-9075-cbb578579601 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:42.630839 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-fa7f17ce-ae3d-4703-9075-cbb578579601 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:42:42.638737 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fa7f17ce-ae3d-4703-9075-cbb578579601 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:42.639193 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fa7f17ce-ae3d-4703-9075-cbb578579601 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:42.639959 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fa7f17ce-ae3d-4703-9075-cbb578579601 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:42.640397 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fa7f17ce-ae3d-4703-9075-cbb578579601 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:42.765016 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-fa7f17ce-ae3d-4703-9075-cbb578579601 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:42.772697 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-fa7f17ce-ae3d-4703-9075-cbb578579601 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.146277 Oct 29 01:42:42.773285 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1073/1977] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:42:42 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:43.131561 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:42:43.132082 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: Fri Oct 29 01:42:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 29 01:42:43.790337 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-de262f6b-8e92-43a8-a776-7fd8faa91ac3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:43.791427 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-de262f6b-8e92-43a8-a776-7fd8faa91ac3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:42:43.797777 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-de262f6b-8e92-43a8-a776-7fd8faa91ac3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:43.798218 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-de262f6b-8e92-43a8-a776-7fd8faa91ac3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:43.799069 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-de262f6b-8e92-43a8-a776-7fd8faa91ac3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:43.799498 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-de262f6b-8e92-43a8-a776-7fd8faa91ac3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:43.922749 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-de262f6b-8e92-43a8-a776-7fd8faa91ac3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:43.930808 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-de262f6b-8e92-43a8-a776-7fd8faa91ac3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.144163 Oct 29 01:42:43.931400 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 905/1978] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:42:43 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:44.948623 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9c63e0ef-77fb-4d14-bfe4-b6a1290a49e3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:44.949184 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9c63e0ef-77fb-4d14-bfe4-b6a1290a49e3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:42:44.955236 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9c63e0ef-77fb-4d14-bfe4-b6a1290a49e3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:44.955681 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9c63e0ef-77fb-4d14-bfe4-b6a1290a49e3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:44.956437 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9c63e0ef-77fb-4d14-bfe4-b6a1290a49e3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:44.956874 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9c63e0ef-77fb-4d14-bfe4-b6a1290a49e3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:45.076741 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-9c63e0ef-77fb-4d14-bfe4-b6a1290a49e3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:45.084749 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9c63e0ef-77fb-4d14-bfe4-b6a1290a49e3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.140710 Oct 29 01:42:45.085304 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1074/1979] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:42:44 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:46.100905 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-acb20649-70a2-4cdd-8082-7add0e0a8428 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:46.101512 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-acb20649-70a2-4cdd-8082-7add0e0a8428 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:42:46.107984 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-acb20649-70a2-4cdd-8082-7add0e0a8428 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:46.108430 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-acb20649-70a2-4cdd-8082-7add0e0a8428 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:46.109187 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-acb20649-70a2-4cdd-8082-7add0e0a8428 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:46.109619 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-acb20649-70a2-4cdd-8082-7add0e0a8428 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:46.234057 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-acb20649-70a2-4cdd-8082-7add0e0a8428 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:46.241806 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-acb20649-70a2-4cdd-8082-7add0e0a8428 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.144679 Oct 29 01:42:46.242360 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 906/1980] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:42:46 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:47.258088 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-5f574327-cfbf-4811-ac0b-621e0a3f00e1 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:47.258715 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-5f574327-cfbf-4811-ac0b-621e0a3f00e1 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:42:47.264841 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5f574327-cfbf-4811-ac0b-621e0a3f00e1 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:47.265281 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5f574327-cfbf-4811-ac0b-621e0a3f00e1 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:47.266023 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5f574327-cfbf-4811-ac0b-621e0a3f00e1 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:47.266469 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5f574327-cfbf-4811-ac0b-621e0a3f00e1 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:47.387428 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-5f574327-cfbf-4811-ac0b-621e0a3f00e1 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:47.395065 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-5f574327-cfbf-4811-ac0b-621e0a3f00e1 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.140550 Oct 29 01:42:47.395628 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1075/1981] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:42:47 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:48.412091 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-98b937d8-bf1a-4aa3-8efa-678a5494eb16 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:48.412692 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-98b937d8-bf1a-4aa3-8efa-678a5494eb16 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:42:48.418883 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-98b937d8-bf1a-4aa3-8efa-678a5494eb16 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:48.419323 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-98b937d8-bf1a-4aa3-8efa-678a5494eb16 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:48.420079 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-98b937d8-bf1a-4aa3-8efa-678a5494eb16 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:48.420505 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-98b937d8-bf1a-4aa3-8efa-678a5494eb16 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:48.543770 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-98b937d8-bf1a-4aa3-8efa-678a5494eb16 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:48.551441 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-98b937d8-bf1a-4aa3-8efa-678a5494eb16 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.143048 Oct 29 01:42:48.551997 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 907/1982] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:42:48 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:49.568359 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-8bd549af-dc91-46cb-a225-3821f48321d8 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:49.568894 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-8bd549af-dc91-46cb-a225-3821f48321d8 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:42:49.575806 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8bd549af-dc91-46cb-a225-3821f48321d8 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:49.576247 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8bd549af-dc91-46cb-a225-3821f48321d8 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:49.576994 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8bd549af-dc91-46cb-a225-3821f48321d8 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:49.577713 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8bd549af-dc91-46cb-a225-3821f48321d8 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:49.700402 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-8bd549af-dc91-46cb-a225-3821f48321d8 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:49.708362 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-8bd549af-dc91-46cb-a225-3821f48321d8 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.143768 Oct 29 01:42:49.708932 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1076/1983] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:42:49 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:50.725261 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-fbc030a6-9eeb-4187-b88b-dc1d7e407568 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:50.725867 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-fbc030a6-9eeb-4187-b88b-dc1d7e407568 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:42:50.732040 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fbc030a6-9eeb-4187-b88b-dc1d7e407568 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:50.732484 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fbc030a6-9eeb-4187-b88b-dc1d7e407568 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:50.733232 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fbc030a6-9eeb-4187-b88b-dc1d7e407568 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:50.733658 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fbc030a6-9eeb-4187-b88b-dc1d7e407568 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:50.861548 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-fbc030a6-9eeb-4187-b88b-dc1d7e407568 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:50.869751 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-fbc030a6-9eeb-4187-b88b-dc1d7e407568 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.148242 Oct 29 01:42:50.870305 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 908/1984] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:42:50 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:51.889595 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-faa574a4-d252-4cdb-b3d0-191c4b58e68e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:51.890181 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-faa574a4-d252-4cdb-b3d0-191c4b58e68e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:42:51.896323 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-faa574a4-d252-4cdb-b3d0-191c4b58e68e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:51.896762 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-faa574a4-d252-4cdb-b3d0-191c4b58e68e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:51.897507 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-faa574a4-d252-4cdb-b3d0-191c4b58e68e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:51.897933 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-faa574a4-d252-4cdb-b3d0-191c4b58e68e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:52.018306 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-faa574a4-d252-4cdb-b3d0-191c4b58e68e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:52.026971 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-faa574a4-d252-4cdb-b3d0-191c4b58e68e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.142428 Oct 29 01:42:52.027567 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1077/1985] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:42:51 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:53.043728 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-8e84e211-bfa2-4ba2-80e7-b5177d96f65f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:53.044331 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-8e84e211-bfa2-4ba2-80e7-b5177d96f65f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:42:53.050526 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8e84e211-bfa2-4ba2-80e7-b5177d96f65f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:53.050972 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8e84e211-bfa2-4ba2-80e7-b5177d96f65f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:53.051725 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8e84e211-bfa2-4ba2-80e7-b5177d96f65f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:53.052155 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8e84e211-bfa2-4ba2-80e7-b5177d96f65f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:53.172953 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-8e84e211-bfa2-4ba2-80e7-b5177d96f65f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:53.180694 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-8e84e211-bfa2-4ba2-80e7-b5177d96f65f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.140592 Oct 29 01:42:53.181758 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 909/1986] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:42:53 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:54.197611 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-526956f3-3a25-4b99-9a2e-cc6ee5eae057 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:54.198334 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-526956f3-3a25-4b99-9a2e-cc6ee5eae057 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:42:54.204734 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-526956f3-3a25-4b99-9a2e-cc6ee5eae057 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:54.205176 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-526956f3-3a25-4b99-9a2e-cc6ee5eae057 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:54.205920 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-526956f3-3a25-4b99-9a2e-cc6ee5eae057 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:54.206347 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-526956f3-3a25-4b99-9a2e-cc6ee5eae057 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:54.324634 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-526956f3-3a25-4b99-9a2e-cc6ee5eae057 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:54.332465 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-526956f3-3a25-4b99-9a2e-cc6ee5eae057 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.138523 Oct 29 01:42:54.333023 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1078/1987] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:42:54 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:55.349028 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2f4bfc00-eeed-4c80-bfc7-50a2a38c0be7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:55.349638 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2f4bfc00-eeed-4c80-bfc7-50a2a38c0be7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:42:55.356326 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2f4bfc00-eeed-4c80-bfc7-50a2a38c0be7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:55.356766 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2f4bfc00-eeed-4c80-bfc7-50a2a38c0be7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:55.357518 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2f4bfc00-eeed-4c80-bfc7-50a2a38c0be7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:55.357948 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2f4bfc00-eeed-4c80-bfc7-50a2a38c0be7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:55.475018 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-2f4bfc00-eeed-4c80-bfc7-50a2a38c0be7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:55.483215 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2f4bfc00-eeed-4c80-bfc7-50a2a38c0be7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.137734 Oct 29 01:42:55.483761 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 910/1988] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:42:55 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:56.500444 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-8d7a784b-1d6f-46b6-9015-1c28ea410d4d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:56.501049 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-8d7a784b-1d6f-46b6-9015-1c28ea410d4d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:42:56.507113 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8d7a784b-1d6f-46b6-9015-1c28ea410d4d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:56.507553 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8d7a784b-1d6f-46b6-9015-1c28ea410d4d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:56.508299 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8d7a784b-1d6f-46b6-9015-1c28ea410d4d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:56.508754 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8d7a784b-1d6f-46b6-9015-1c28ea410d4d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:56.630125 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-8d7a784b-1d6f-46b6-9015-1c28ea410d4d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:56.637930 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-8d7a784b-1d6f-46b6-9015-1c28ea410d4d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.141038 Oct 29 01:42:56.638529 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1079/1989] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:42:56 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:57.655500 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-52ee51c7-8e4a-43c2-ab8c-f8ac43a4cf29 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:57.656049 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-52ee51c7-8e4a-43c2-ab8c-f8ac43a4cf29 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:42:57.662197 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-52ee51c7-8e4a-43c2-ab8c-f8ac43a4cf29 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:57.662664 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-52ee51c7-8e4a-43c2-ab8c-f8ac43a4cf29 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:57.663424 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-52ee51c7-8e4a-43c2-ab8c-f8ac43a4cf29 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:57.663848 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-52ee51c7-8e4a-43c2-ab8c-f8ac43a4cf29 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:57.792876 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-52ee51c7-8e4a-43c2-ab8c-f8ac43a4cf29 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:57.801252 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-52ee51c7-8e4a-43c2-ab8c-f8ac43a4cf29 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.149613 Oct 29 01:42:57.801816 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 911/1990] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:42:57 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:58.817006 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c198524a-7288-49fb-848b-d9011d245e6f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:58.817617 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c198524a-7288-49fb-848b-d9011d245e6f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:42:58.824282 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c198524a-7288-49fb-848b-d9011d245e6f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:58.824904 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c198524a-7288-49fb-848b-d9011d245e6f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:58.825658 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c198524a-7288-49fb-848b-d9011d245e6f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:58.826089 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c198524a-7288-49fb-848b-d9011d245e6f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:58.943474 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c198524a-7288-49fb-848b-d9011d245e6f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:58.951534 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c198524a-7288-49fb-848b-d9011d245e6f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.138129 Oct 29 01:42:58.952128 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1080/1991] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:42:58 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:59.968791 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-43fadae7-7516-4028-a39f-08d0ede02d6d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:59.969404 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-43fadae7-7516-4028-a39f-08d0ede02d6d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:42:59.975638 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-43fadae7-7516-4028-a39f-08d0ede02d6d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:59.976083 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-43fadae7-7516-4028-a39f-08d0ede02d6d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:42:59.976839 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-43fadae7-7516-4028-a39f-08d0ede02d6d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:42:59.977269 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-43fadae7-7516-4028-a39f-08d0ede02d6d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:00.098705 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-43fadae7-7516-4028-a39f-08d0ede02d6d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:00.106682 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-43fadae7-7516-4028-a39f-08d0ede02d6d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.141515 Oct 29 01:43:00.107244 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 912/1992] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:42:59 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:01.124121 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d5655345-2b67-4af2-8625-065a27bc9ff0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:01.124720 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d5655345-2b67-4af2-8625-065a27bc9ff0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:01.130950 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d5655345-2b67-4af2-8625-065a27bc9ff0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:01.131420 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d5655345-2b67-4af2-8625-065a27bc9ff0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:01.132164 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d5655345-2b67-4af2-8625-065a27bc9ff0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:01.132591 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d5655345-2b67-4af2-8625-065a27bc9ff0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:01.253746 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-d5655345-2b67-4af2-8625-065a27bc9ff0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:01.262343 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d5655345-2b67-4af2-8625-065a27bc9ff0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.141886 Oct 29 01:43:01.263303 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1081/1993] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:01 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:02.281571 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f35ce45e-e53b-485d-b894-f97b9f15e08d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:02.282134 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f35ce45e-e53b-485d-b894-f97b9f15e08d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:02.288288 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f35ce45e-e53b-485d-b894-f97b9f15e08d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:02.288732 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f35ce45e-e53b-485d-b894-f97b9f15e08d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:02.289492 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f35ce45e-e53b-485d-b894-f97b9f15e08d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:02.289920 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f35ce45e-e53b-485d-b894-f97b9f15e08d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:02.409444 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-f35ce45e-e53b-485d-b894-f97b9f15e08d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:02.417162 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f35ce45e-e53b-485d-b894-f97b9f15e08d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.139394 Oct 29 01:43:02.417731 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 913/1994] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:02 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:03.432938 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-028c1756-47b3-4618-9337-b79ba3b4d43a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:03.433566 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-028c1756-47b3-4618-9337-b79ba3b4d43a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:03.439768 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-028c1756-47b3-4618-9337-b79ba3b4d43a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:03.440216 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-028c1756-47b3-4618-9337-b79ba3b4d43a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:03.440970 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-028c1756-47b3-4618-9337-b79ba3b4d43a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:03.441401 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-028c1756-47b3-4618-9337-b79ba3b4d43a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:03.563587 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-028c1756-47b3-4618-9337-b79ba3b4d43a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:03.571220 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-028c1756-47b3-4618-9337-b79ba3b4d43a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.142062 Oct 29 01:43:03.571776 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1082/1995] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:03 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:04.588854 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-6f98b8ce-92a4-4bfd-a61a-eb1aeb7f5eb6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:04.589456 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-6f98b8ce-92a4-4bfd-a61a-eb1aeb7f5eb6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:04.595683 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6f98b8ce-92a4-4bfd-a61a-eb1aeb7f5eb6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:04.596123 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6f98b8ce-92a4-4bfd-a61a-eb1aeb7f5eb6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:04.596870 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6f98b8ce-92a4-4bfd-a61a-eb1aeb7f5eb6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:04.597295 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6f98b8ce-92a4-4bfd-a61a-eb1aeb7f5eb6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:04.715970 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-6f98b8ce-92a4-4bfd-a61a-eb1aeb7f5eb6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:04.723636 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-6f98b8ce-92a4-4bfd-a61a-eb1aeb7f5eb6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.139060 Oct 29 01:43:04.724197 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 914/1996] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:04 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:05.740450 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-83fc5a49-28be-4c5a-afce-04e1312eb20f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:05.741039 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-83fc5a49-28be-4c5a-afce-04e1312eb20f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:05.747455 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-83fc5a49-28be-4c5a-afce-04e1312eb20f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:05.748465 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-83fc5a49-28be-4c5a-afce-04e1312eb20f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:05.748830 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-83fc5a49-28be-4c5a-afce-04e1312eb20f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:05.749249 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-83fc5a49-28be-4c5a-afce-04e1312eb20f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:05.868438 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-83fc5a49-28be-4c5a-afce-04e1312eb20f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:05.876305 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-83fc5a49-28be-4c5a-afce-04e1312eb20f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.139547 Oct 29 01:43:05.876862 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1083/1997] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:05 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:06.893779 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-6fb2fb33-427a-4045-bb02-efc4d1a2c509 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:06.894382 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-6fb2fb33-427a-4045-bb02-efc4d1a2c509 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:06.902333 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6fb2fb33-427a-4045-bb02-efc4d1a2c509 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:06.902824 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6fb2fb33-427a-4045-bb02-efc4d1a2c509 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:06.903591 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6fb2fb33-427a-4045-bb02-efc4d1a2c509 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:06.904020 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6fb2fb33-427a-4045-bb02-efc4d1a2c509 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:07.024876 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-6fb2fb33-427a-4045-bb02-efc4d1a2c509 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:07.033118 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-6fb2fb33-427a-4045-bb02-efc4d1a2c509 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.144117 Oct 29 01:43:07.033682 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 915/1998] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:06 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:08.048949 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b901a74f-81b0-4a83-8de9-4fa46ddf261b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:08.049477 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b901a74f-81b0-4a83-8de9-4fa46ddf261b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:08.055623 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b901a74f-81b0-4a83-8de9-4fa46ddf261b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:08.056068 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b901a74f-81b0-4a83-8de9-4fa46ddf261b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:08.056822 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b901a74f-81b0-4a83-8de9-4fa46ddf261b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:08.057254 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b901a74f-81b0-4a83-8de9-4fa46ddf261b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:08.175608 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-b901a74f-81b0-4a83-8de9-4fa46ddf261b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:08.183494 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b901a74f-81b0-4a83-8de9-4fa46ddf261b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.138297 Oct 29 01:43:08.184144 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1084/1999] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:08 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:09.200701 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-df899429-ca09-4615-8dd7-b3013b145e06 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:09.201302 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-df899429-ca09-4615-8dd7-b3013b145e06 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:09.207840 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-df899429-ca09-4615-8dd7-b3013b145e06 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:09.208327 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-df899429-ca09-4615-8dd7-b3013b145e06 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:09.209035 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-df899429-ca09-4615-8dd7-b3013b145e06 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:09.209468 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-df899429-ca09-4615-8dd7-b3013b145e06 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:09.330706 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-df899429-ca09-4615-8dd7-b3013b145e06 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:09.339002 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-df899429-ca09-4615-8dd7-b3013b145e06 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.141967 Oct 29 01:43:09.339563 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 916/2000] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:09 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:43:10.356220 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-e8f08d7c-2449-4614-a19d-224bb97d5f5a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:10.356835 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-e8f08d7c-2449-4614-a19d-224bb97d5f5a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:10.363022 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e8f08d7c-2449-4614-a19d-224bb97d5f5a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:10.363472 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e8f08d7c-2449-4614-a19d-224bb97d5f5a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:10.364231 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e8f08d7c-2449-4614-a19d-224bb97d5f5a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:10.364662 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e8f08d7c-2449-4614-a19d-224bb97d5f5a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:10.485317 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-e8f08d7c-2449-4614-a19d-224bb97d5f5a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:10.493039 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-e8f08d7c-2449-4614-a19d-224bb97d5f5a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.141136 Oct 29 01:43:10.493603 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1085/2001] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:10 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:11.508707 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-a6805a3c-494f-4585-83b6-799f561db69b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:11.509312 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-a6805a3c-494f-4585-83b6-799f561db69b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:11.515570 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a6805a3c-494f-4585-83b6-799f561db69b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:11.516016 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a6805a3c-494f-4585-83b6-799f561db69b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:11.516771 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a6805a3c-494f-4585-83b6-799f561db69b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:11.517201 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a6805a3c-494f-4585-83b6-799f561db69b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:11.634969 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-a6805a3c-494f-4585-83b6-799f561db69b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:11.642597 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-a6805a3c-494f-4585-83b6-799f561db69b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.137500 Oct 29 01:43:11.643155 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 917/2002] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:11 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:12.660001 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-5114a8e6-bfa8-46d9-85ee-9eb782f8beea tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:12.660565 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-5114a8e6-bfa8-46d9-85ee-9eb782f8beea tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:12.667105 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5114a8e6-bfa8-46d9-85ee-9eb782f8beea tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:12.667546 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5114a8e6-bfa8-46d9-85ee-9eb782f8beea tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:12.668300 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5114a8e6-bfa8-46d9-85ee-9eb782f8beea tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:12.668726 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5114a8e6-bfa8-46d9-85ee-9eb782f8beea tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:12.787626 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-5114a8e6-bfa8-46d9-85ee-9eb782f8beea tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:12.795506 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-5114a8e6-bfa8-46d9-85ee-9eb782f8beea tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.139229 Oct 29 01:43:12.796066 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1086/2003] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:12 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:13.812890 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2a4c2e8c-7850-40fe-8fd3-61339c011af6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:13.813417 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2a4c2e8c-7850-40fe-8fd3-61339c011af6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:13.819602 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2a4c2e8c-7850-40fe-8fd3-61339c011af6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:13.820048 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2a4c2e8c-7850-40fe-8fd3-61339c011af6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:13.820808 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2a4c2e8c-7850-40fe-8fd3-61339c011af6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:13.821244 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2a4c2e8c-7850-40fe-8fd3-61339c011af6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:13.946361 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-2a4c2e8c-7850-40fe-8fd3-61339c011af6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:13.954384 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2a4c2e8c-7850-40fe-8fd3-61339c011af6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.145271 Oct 29 01:43:13.954977 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 918/2004] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:13 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:14.972941 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-cf3760a8-73cf-4d63-9c18-a145f263e936 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:14.973552 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-cf3760a8-73cf-4d63-9c18-a145f263e936 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:14.981668 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cf3760a8-73cf-4d63-9c18-a145f263e936 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:14.982108 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cf3760a8-73cf-4d63-9c18-a145f263e936 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:14.982892 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cf3760a8-73cf-4d63-9c18-a145f263e936 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:14.983312 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cf3760a8-73cf-4d63-9c18-a145f263e936 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:15.101532 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-cf3760a8-73cf-4d63-9c18-a145f263e936 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:15.109650 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-cf3760a8-73cf-4d63-9c18-a145f263e936 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.140487 Oct 29 01:43:15.110245 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1087/2005] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:14 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:16.126843 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-fb5dea0b-a11c-4dcf-919e-bb74d4238539 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:16.127508 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-fb5dea0b-a11c-4dcf-919e-bb74d4238539 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:16.133252 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fb5dea0b-a11c-4dcf-919e-bb74d4238539 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:16.133696 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fb5dea0b-a11c-4dcf-919e-bb74d4238539 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:16.134475 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fb5dea0b-a11c-4dcf-919e-bb74d4238539 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:16.134994 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fb5dea0b-a11c-4dcf-919e-bb74d4238539 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:16.252483 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-fb5dea0b-a11c-4dcf-919e-bb74d4238539 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:16.260968 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-fb5dea0b-a11c-4dcf-919e-bb74d4238539 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.137394 Oct 29 01:43:16.261539 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 919/2006] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:16 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:17.277980 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b6f43d51-645b-425f-af4f-969b5b03088a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:17.278564 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b6f43d51-645b-425f-af4f-969b5b03088a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:17.284976 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b6f43d51-645b-425f-af4f-969b5b03088a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:17.285427 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b6f43d51-645b-425f-af4f-969b5b03088a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:17.286187 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b6f43d51-645b-425f-af4f-969b5b03088a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:17.286653 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b6f43d51-645b-425f-af4f-969b5b03088a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:17.409861 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-b6f43d51-645b-425f-af4f-969b5b03088a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:17.417960 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b6f43d51-645b-425f-af4f-969b5b03088a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.143763 Oct 29 01:43:17.418547 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1088/2007] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:17 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:18.434962 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-bec3223c-3514-4509-b9ed-a8f135488adb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:18.435562 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-bec3223c-3514-4509-b9ed-a8f135488adb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:18.441804 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bec3223c-3514-4509-b9ed-a8f135488adb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:18.442242 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bec3223c-3514-4509-b9ed-a8f135488adb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:18.443022 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bec3223c-3514-4509-b9ed-a8f135488adb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:18.443450 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bec3223c-3514-4509-b9ed-a8f135488adb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:18.561635 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-bec3223c-3514-4509-b9ed-a8f135488adb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:18.569217 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-bec3223c-3514-4509-b9ed-a8f135488adb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.138353 Oct 29 01:43:18.569775 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 920/2008] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:18 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:19.586700 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-e2d09394-f7a6-4a64-a62e-58c9d0b5b0ae tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:19.587229 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-e2d09394-f7a6-4a64-a62e-58c9d0b5b0ae tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:19.594121 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e2d09394-f7a6-4a64-a62e-58c9d0b5b0ae tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:19.594601 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e2d09394-f7a6-4a64-a62e-58c9d0b5b0ae tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:19.595358 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e2d09394-f7a6-4a64-a62e-58c9d0b5b0ae tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:19.595787 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e2d09394-f7a6-4a64-a62e-58c9d0b5b0ae tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:19.712283 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-e2d09394-f7a6-4a64-a62e-58c9d0b5b0ae tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:19.720662 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-e2d09394-f7a6-4a64-a62e-58c9d0b5b0ae tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.137723 Oct 29 01:43:19.721225 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1089/2009] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:19 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:20.737674 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-6698edfd-4f68-4467-8c05-56e2d7f0850e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:20.738233 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-6698edfd-4f68-4467-8c05-56e2d7f0850e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:20.744938 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6698edfd-4f68-4467-8c05-56e2d7f0850e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:20.745410 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6698edfd-4f68-4467-8c05-56e2d7f0850e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:20.746161 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6698edfd-4f68-4467-8c05-56e2d7f0850e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:20.746621 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6698edfd-4f68-4467-8c05-56e2d7f0850e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:20.880828 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-6698edfd-4f68-4467-8c05-56e2d7f0850e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:20.888585 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-6698edfd-4f68-4467-8c05-56e2d7f0850e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.154614 Oct 29 01:43:20.889148 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 921/2010] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:20 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:21.905165 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-0bc4e8fe-1e7a-47d3-bac0-990d9c8d59cd tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:21.905772 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-0bc4e8fe-1e7a-47d3-bac0-990d9c8d59cd tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:21.911910 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0bc4e8fe-1e7a-47d3-bac0-990d9c8d59cd tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:21.912414 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0bc4e8fe-1e7a-47d3-bac0-990d9c8d59cd tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:21.913193 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0bc4e8fe-1e7a-47d3-bac0-990d9c8d59cd tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:21.913623 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0bc4e8fe-1e7a-47d3-bac0-990d9c8d59cd tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:22.031338 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-0bc4e8fe-1e7a-47d3-bac0-990d9c8d59cd tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:22.038929 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-0bc4e8fe-1e7a-47d3-bac0-990d9c8d59cd tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.137315 Oct 29 01:43:22.039485 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1090/2011] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:21 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:22.334437 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:43:22.335010 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: Fri Oct 29 01:43:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 29 01:43:23.055730 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-014e3e64-fcfd-4c97-ab0c-8a53141c3b72 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:23.056338 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-014e3e64-fcfd-4c97-ab0c-8a53141c3b72 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:23.063259 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-014e3e64-fcfd-4c97-ab0c-8a53141c3b72 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:23.063708 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-014e3e64-fcfd-4c97-ab0c-8a53141c3b72 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:23.064467 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-014e3e64-fcfd-4c97-ab0c-8a53141c3b72 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:23.064898 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-014e3e64-fcfd-4c97-ab0c-8a53141c3b72 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:23.185776 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-014e3e64-fcfd-4c97-ab0c-8a53141c3b72 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:23.193459 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-014e3e64-fcfd-4c97-ab0c-8a53141c3b72 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.141353 Oct 29 01:43:23.194020 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 922/2012] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:23 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:24.211372 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-68ec8ff3-7067-445b-a1fd-471d4a80c20b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:24.211926 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-68ec8ff3-7067-445b-a1fd-471d4a80c20b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:24.218797 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-68ec8ff3-7067-445b-a1fd-471d4a80c20b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:24.219238 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-68ec8ff3-7067-445b-a1fd-471d4a80c20b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:24.219992 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-68ec8ff3-7067-445b-a1fd-471d4a80c20b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:24.220450 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-68ec8ff3-7067-445b-a1fd-471d4a80c20b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:24.341940 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-68ec8ff3-7067-445b-a1fd-471d4a80c20b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:24.349671 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-68ec8ff3-7067-445b-a1fd-471d4a80c20b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.142040 Oct 29 01:43:24.350225 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1091/2013] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:24 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:25.366016 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f66dc1e9-edd2-4170-835e-c85d9b1f439f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:25.366667 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f66dc1e9-edd2-4170-835e-c85d9b1f439f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:25.374787 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f66dc1e9-edd2-4170-835e-c85d9b1f439f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:25.375227 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f66dc1e9-edd2-4170-835e-c85d9b1f439f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:25.375986 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f66dc1e9-edd2-4170-835e-c85d9b1f439f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:25.376413 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f66dc1e9-edd2-4170-835e-c85d9b1f439f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:25.495091 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-f66dc1e9-edd2-4170-835e-c85d9b1f439f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:25.503039 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f66dc1e9-edd2-4170-835e-c85d9b1f439f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.140642 Oct 29 01:43:25.503607 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 923/2014] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:25 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:26.520095 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9d3882b5-2df5-4e35-a1bf-d909984da94a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:26.520722 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9d3882b5-2df5-4e35-a1bf-d909984da94a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:26.527564 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9d3882b5-2df5-4e35-a1bf-d909984da94a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:26.528007 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9d3882b5-2df5-4e35-a1bf-d909984da94a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:26.528764 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9d3882b5-2df5-4e35-a1bf-d909984da94a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:26.529199 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9d3882b5-2df5-4e35-a1bf-d909984da94a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:26.646767 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-9d3882b5-2df5-4e35-a1bf-d909984da94a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:26.654441 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9d3882b5-2df5-4e35-a1bf-d909984da94a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.137981 Oct 29 01:43:26.655000 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1092/2015] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:26 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:27.671786 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-acb7fc69-9cd1-4072-bd4d-4442cc7a8d3a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:27.672391 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-acb7fc69-9cd1-4072-bd4d-4442cc7a8d3a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:27.678762 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-acb7fc69-9cd1-4072-bd4d-4442cc7a8d3a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:27.679207 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-acb7fc69-9cd1-4072-bd4d-4442cc7a8d3a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:27.679988 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-acb7fc69-9cd1-4072-bd4d-4442cc7a8d3a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:27.680414 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-acb7fc69-9cd1-4072-bd4d-4442cc7a8d3a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:27.801745 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-acb7fc69-9cd1-4072-bd4d-4442cc7a8d3a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:27.809548 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-acb7fc69-9cd1-4072-bd4d-4442cc7a8d3a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.141346 Oct 29 01:43:27.810110 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 924/2016] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:27 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:28.827592 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9bb0a43e-575f-41bb-a0ea-43c14a8e5bf8 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:28.828182 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9bb0a43e-575f-41bb-a0ea-43c14a8e5bf8 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:28.834791 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9bb0a43e-575f-41bb-a0ea-43c14a8e5bf8 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:28.835233 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9bb0a43e-575f-41bb-a0ea-43c14a8e5bf8 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:28.836067 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9bb0a43e-575f-41bb-a0ea-43c14a8e5bf8 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:28.836493 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9bb0a43e-575f-41bb-a0ea-43c14a8e5bf8 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:28.977775 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-9bb0a43e-575f-41bb-a0ea-43c14a8e5bf8 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:28.985591 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9bb0a43e-575f-41bb-a0ea-43c14a8e5bf8 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.161978 Oct 29 01:43:28.986152 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1093/2017] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:28 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:30.003092 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-780c62ca-cd15-4bd2-a13a-aed8f4905619 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:30.003700 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-780c62ca-cd15-4bd2-a13a-aed8f4905619 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:30.015489 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-780c62ca-cd15-4bd2-a13a-aed8f4905619 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:30.015928 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-780c62ca-cd15-4bd2-a13a-aed8f4905619 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:30.016701 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-780c62ca-cd15-4bd2-a13a-aed8f4905619 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:30.017130 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-780c62ca-cd15-4bd2-a13a-aed8f4905619 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:30.136143 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-780c62ca-cd15-4bd2-a13a-aed8f4905619 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:30.143936 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-780c62ca-cd15-4bd2-a13a-aed8f4905619 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.144594 Oct 29 01:43:30.144502 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 925/2018] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:29 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:31.160725 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-afe0c1bb-9121-4dd3-9cf7-37408924ccd2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:31.161347 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-afe0c1bb-9121-4dd3-9cf7-37408924ccd2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:31.167530 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-afe0c1bb-9121-4dd3-9cf7-37408924ccd2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:31.167973 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-afe0c1bb-9121-4dd3-9cf7-37408924ccd2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:31.168719 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-afe0c1bb-9121-4dd3-9cf7-37408924ccd2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:31.169150 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-afe0c1bb-9121-4dd3-9cf7-37408924ccd2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:31.292678 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-afe0c1bb-9121-4dd3-9cf7-37408924ccd2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:31.301761 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-afe0c1bb-9121-4dd3-9cf7-37408924ccd2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.144672 Oct 29 01:43:31.302321 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1094/2019] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:31 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:32.319103 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-aea09863-0505-494d-b292-5fc337c414fe tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:32.319625 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-aea09863-0505-494d-b292-5fc337c414fe tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:32.326320 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-aea09863-0505-494d-b292-5fc337c414fe tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:32.326808 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-aea09863-0505-494d-b292-5fc337c414fe tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:32.327838 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-aea09863-0505-494d-b292-5fc337c414fe tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:32.328274 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-aea09863-0505-494d-b292-5fc337c414fe tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:32.449815 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-aea09863-0505-494d-b292-5fc337c414fe tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:32.457656 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-aea09863-0505-494d-b292-5fc337c414fe tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.142323 Oct 29 01:43:32.458210 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 926/2020] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:32 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:33.475121 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-6523787d-2846-4edf-b944-ac414d2266db tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:33.475733 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-6523787d-2846-4edf-b944-ac414d2266db tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:33.482568 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6523787d-2846-4edf-b944-ac414d2266db tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:33.483021 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6523787d-2846-4edf-b944-ac414d2266db tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:33.483785 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6523787d-2846-4edf-b944-ac414d2266db tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:33.484216 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6523787d-2846-4edf-b944-ac414d2266db tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:33.601185 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-6523787d-2846-4edf-b944-ac414d2266db tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:33.609649 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-6523787d-2846-4edf-b944-ac414d2266db tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.138095 Oct 29 01:43:33.610233 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1095/2021] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:33 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:34.626504 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f53d5271-3d77-4fde-8fa6-dd2e48896d5d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:34.627110 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f53d5271-3d77-4fde-8fa6-dd2e48896d5d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:34.633307 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f53d5271-3d77-4fde-8fa6-dd2e48896d5d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:34.633752 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f53d5271-3d77-4fde-8fa6-dd2e48896d5d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:34.634544 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f53d5271-3d77-4fde-8fa6-dd2e48896d5d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:34.634978 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f53d5271-3d77-4fde-8fa6-dd2e48896d5d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:34.757030 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-f53d5271-3d77-4fde-8fa6-dd2e48896d5d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:34.764664 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f53d5271-3d77-4fde-8fa6-dd2e48896d5d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.141780 Oct 29 01:43:34.765222 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 927/2022] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:34 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:35.782094 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d897242f-fa2d-4898-ac77-c7d6a01c2634 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:35.782672 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d897242f-fa2d-4898-ac77-c7d6a01c2634 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:35.788885 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d897242f-fa2d-4898-ac77-c7d6a01c2634 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:35.789324 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d897242f-fa2d-4898-ac77-c7d6a01c2634 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:35.790067 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d897242f-fa2d-4898-ac77-c7d6a01c2634 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:35.791170 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d897242f-fa2d-4898-ac77-c7d6a01c2634 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:35.907715 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-d897242f-fa2d-4898-ac77-c7d6a01c2634 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:35.916083 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d897242f-fa2d-4898-ac77-c7d6a01c2634 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.137520 Oct 29 01:43:35.916651 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1096/2023] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:35 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:36.932907 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-b1f1d148-bbcf-4716-a043-d9e34da917a4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:36.933511 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-b1f1d148-bbcf-4716-a043-d9e34da917a4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:36.939773 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b1f1d148-bbcf-4716-a043-d9e34da917a4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:36.940218 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b1f1d148-bbcf-4716-a043-d9e34da917a4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:36.940974 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b1f1d148-bbcf-4716-a043-d9e34da917a4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:36.941402 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b1f1d148-bbcf-4716-a043-d9e34da917a4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:37.059378 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-b1f1d148-bbcf-4716-a043-d9e34da917a4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:37.066968 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-b1f1d148-bbcf-4716-a043-d9e34da917a4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.137806 Oct 29 01:43:37.067528 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 928/2024] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:36 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:38.084598 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-38d464df-f3a5-4dd9-baf4-6194ffcf7bfe tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:38.085196 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-38d464df-f3a5-4dd9-baf4-6194ffcf7bfe tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:38.091367 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-38d464df-f3a5-4dd9-baf4-6194ffcf7bfe tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:38.091812 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-38d464df-f3a5-4dd9-baf4-6194ffcf7bfe tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:38.092561 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-38d464df-f3a5-4dd9-baf4-6194ffcf7bfe tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:38.092995 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-38d464df-f3a5-4dd9-baf4-6194ffcf7bfe tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:38.216031 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-38d464df-f3a5-4dd9-baf4-6194ffcf7bfe tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:38.223697 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-38d464df-f3a5-4dd9-baf4-6194ffcf7bfe tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.142958 Oct 29 01:43:38.224261 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1097/2025] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:38 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:39.240959 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-54939c62-30c1-4e7b-b5f0-d9917d65cbdb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:39.241509 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-54939c62-30c1-4e7b-b5f0-d9917d65cbdb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:39.247680 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-54939c62-30c1-4e7b-b5f0-d9917d65cbdb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:39.248120 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-54939c62-30c1-4e7b-b5f0-d9917d65cbdb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:39.248867 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-54939c62-30c1-4e7b-b5f0-d9917d65cbdb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:39.249290 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-54939c62-30c1-4e7b-b5f0-d9917d65cbdb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:39.369256 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-54939c62-30c1-4e7b-b5f0-d9917d65cbdb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:39.377450 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-54939c62-30c1-4e7b-b5f0-d9917d65cbdb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.140271 Oct 29 01:43:39.378011 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 929/2026] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:39 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:40.394852 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-dcab7da3-08b3-47e6-ab6e-87dd0f9e23c7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:40.395454 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-dcab7da3-08b3-47e6-ab6e-87dd0f9e23c7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:40.401954 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dcab7da3-08b3-47e6-ab6e-87dd0f9e23c7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:40.402414 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dcab7da3-08b3-47e6-ab6e-87dd0f9e23c7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:40.403164 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dcab7da3-08b3-47e6-ab6e-87dd0f9e23c7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:40.403589 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dcab7da3-08b3-47e6-ab6e-87dd0f9e23c7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:40.520747 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-dcab7da3-08b3-47e6-ab6e-87dd0f9e23c7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:40.528517 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-dcab7da3-08b3-47e6-ab6e-87dd0f9e23c7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.137203 Oct 29 01:43:40.529073 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1098/2027] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:40 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:41.545403 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-730a7aa7-1831-442f-9dd3-9c6914a97348 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:41.546037 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-730a7aa7-1831-442f-9dd3-9c6914a97348 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:41.552258 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-730a7aa7-1831-442f-9dd3-9c6914a97348 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:41.552704 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-730a7aa7-1831-442f-9dd3-9c6914a97348 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:41.553463 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-730a7aa7-1831-442f-9dd3-9c6914a97348 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:41.553893 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-730a7aa7-1831-442f-9dd3-9c6914a97348 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:41.674967 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-730a7aa7-1831-442f-9dd3-9c6914a97348 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:41.683232 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-730a7aa7-1831-442f-9dd3-9c6914a97348 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.141475 Oct 29 01:43:41.683799 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 930/2028] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:41 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:42.700605 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-7005f4ac-f743-4ae5-80db-c12f0d642af6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:42.701206 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-7005f4ac-f743-4ae5-80db-c12f0d642af6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:42.707635 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7005f4ac-f743-4ae5-80db-c12f0d642af6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:42.708078 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7005f4ac-f743-4ae5-80db-c12f0d642af6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:42.708821 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7005f4ac-f743-4ae5-80db-c12f0d642af6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:42.709250 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7005f4ac-f743-4ae5-80db-c12f0d642af6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:42.827495 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-7005f4ac-f743-4ae5-80db-c12f0d642af6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:42.835039 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-7005f4ac-f743-4ae5-80db-c12f0d642af6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.138636 Oct 29 01:43:42.835590 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1099/2029] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:42 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:43.852292 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-348bb40a-96ae-4830-b42a-531688dc6d84 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:43.852890 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-348bb40a-96ae-4830-b42a-531688dc6d84 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:43.859289 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-348bb40a-96ae-4830-b42a-531688dc6d84 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:43.859767 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-348bb40a-96ae-4830-b42a-531688dc6d84 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:43.860572 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-348bb40a-96ae-4830-b42a-531688dc6d84 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:43.861014 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-348bb40a-96ae-4830-b42a-531688dc6d84 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:43.985678 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-348bb40a-96ae-4830-b42a-531688dc6d84 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:43.993318 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-348bb40a-96ae-4830-b42a-531688dc6d84 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.144748 Oct 29 01:43:43.994366 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 931/2030] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:43 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:45.011523 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a4aa215f-ed96-4aee-8cfb-b070324ee995 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:45.012583 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a4aa215f-ed96-4aee-8cfb-b070324ee995 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:45.019660 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a4aa215f-ed96-4aee-8cfb-b070324ee995 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:45.019866 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a4aa215f-ed96-4aee-8cfb-b070324ee995 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:45.020626 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a4aa215f-ed96-4aee-8cfb-b070324ee995 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:45.021052 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a4aa215f-ed96-4aee-8cfb-b070324ee995 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:45.142532 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-a4aa215f-ed96-4aee-8cfb-b070324ee995 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:45.150152 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a4aa215f-ed96-4aee-8cfb-b070324ee995 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.143471 Oct 29 01:43:45.150730 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1100/2031] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:45 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:46.166990 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-36e9c53d-b1bb-48e4-98a3-6c3421df2e86 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:46.167542 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-36e9c53d-b1bb-48e4-98a3-6c3421df2e86 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:46.173333 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-36e9c53d-b1bb-48e4-98a3-6c3421df2e86 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:46.173779 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-36e9c53d-b1bb-48e4-98a3-6c3421df2e86 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:46.174575 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-36e9c53d-b1bb-48e4-98a3-6c3421df2e86 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:46.175009 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-36e9c53d-b1bb-48e4-98a3-6c3421df2e86 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:46.292539 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-36e9c53d-b1bb-48e4-98a3-6c3421df2e86 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:46.300252 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-36e9c53d-b1bb-48e4-98a3-6c3421df2e86 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.137803 Oct 29 01:43:46.300821 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 932/2032] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:46 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:47.316952 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-e3ef86a1-83b8-4c39-8eba-3efabba3bfc5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:47.317477 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-e3ef86a1-83b8-4c39-8eba-3efabba3bfc5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:47.323677 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e3ef86a1-83b8-4c39-8eba-3efabba3bfc5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:47.324111 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e3ef86a1-83b8-4c39-8eba-3efabba3bfc5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:47.324856 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e3ef86a1-83b8-4c39-8eba-3efabba3bfc5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:47.325280 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e3ef86a1-83b8-4c39-8eba-3efabba3bfc5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:47.442601 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-e3ef86a1-83b8-4c39-8eba-3efabba3bfc5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:47.450256 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-e3ef86a1-83b8-4c39-8eba-3efabba3bfc5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.136978 Oct 29 01:43:47.450948 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1101/2033] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:47 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:48.467337 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-af2be4a6-5d54-490d-b1d8-97404df4111b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:48.467863 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-af2be4a6-5d54-490d-b1d8-97404df4111b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:48.473973 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-af2be4a6-5d54-490d-b1d8-97404df4111b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:48.474434 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-af2be4a6-5d54-490d-b1d8-97404df4111b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:48.475183 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-af2be4a6-5d54-490d-b1d8-97404df4111b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:48.475610 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-af2be4a6-5d54-490d-b1d8-97404df4111b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:48.597866 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-af2be4a6-5d54-490d-b1d8-97404df4111b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:48.605499 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-af2be4a6-5d54-490d-b1d8-97404df4111b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.141864 Oct 29 01:43:48.606058 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 933/2034] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:48 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:43:49.621768 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f456015c-9159-4ae5-aa9c-e7f2875da2c0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:49.622373 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f456015c-9159-4ae5-aa9c-e7f2875da2c0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:49.628608 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f456015c-9159-4ae5-aa9c-e7f2875da2c0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:49.629050 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f456015c-9159-4ae5-aa9c-e7f2875da2c0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:49.629802 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f456015c-9159-4ae5-aa9c-e7f2875da2c0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:49.630262 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f456015c-9159-4ae5-aa9c-e7f2875da2c0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:49.749028 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-f456015c-9159-4ae5-aa9c-e7f2875da2c0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:49.756698 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f456015c-9159-4ae5-aa9c-e7f2875da2c0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.138688 Oct 29 01:43:49.757264 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1102/2035] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:49 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:50.774489 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e5fbaa4c-6579-4a54-8f65-b6b31e490f81 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:50.775112 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-e5fbaa4c-6579-4a54-8f65-b6b31e490f81 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:50.781294 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e5fbaa4c-6579-4a54-8f65-b6b31e490f81 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:50.781732 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e5fbaa4c-6579-4a54-8f65-b6b31e490f81 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:50.782500 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e5fbaa4c-6579-4a54-8f65-b6b31e490f81 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:50.782946 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e5fbaa4c-6579-4a54-8f65-b6b31e490f81 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:50.902124 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-e5fbaa4c-6579-4a54-8f65-b6b31e490f81 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:50.909879 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-e5fbaa4c-6579-4a54-8f65-b6b31e490f81 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.139147 Oct 29 01:43:50.910457 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 934/2036] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:50 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:51.927578 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-52d439d5-a781-41fa-95b9-e12a141e02cb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:51.928189 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-52d439d5-a781-41fa-95b9-e12a141e02cb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:51.934349 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-52d439d5-a781-41fa-95b9-e12a141e02cb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:51.934833 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-52d439d5-a781-41fa-95b9-e12a141e02cb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:51.935588 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-52d439d5-a781-41fa-95b9-e12a141e02cb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:51.936013 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-52d439d5-a781-41fa-95b9-e12a141e02cb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:52.057556 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-52d439d5-a781-41fa-95b9-e12a141e02cb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:52.065217 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-52d439d5-a781-41fa-95b9-e12a141e02cb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.141265 Oct 29 01:43:52.065780 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1103/2037] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:51 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:53.082474 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-6b9edbd8-c1a7-4b4f-8b3f-421e98f478cc tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:53.083076 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-6b9edbd8-c1a7-4b4f-8b3f-421e98f478cc tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:53.089672 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6b9edbd8-c1a7-4b4f-8b3f-421e98f478cc tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:53.090116 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6b9edbd8-c1a7-4b4f-8b3f-421e98f478cc tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:53.090892 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6b9edbd8-c1a7-4b4f-8b3f-421e98f478cc tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:53.091316 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6b9edbd8-c1a7-4b4f-8b3f-421e98f478cc tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:53.209800 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-6b9edbd8-c1a7-4b4f-8b3f-421e98f478cc tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:53.217992 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-6b9edbd8-c1a7-4b4f-8b3f-421e98f478cc tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.139139 Oct 29 01:43:53.218580 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 935/2038] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:53 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:54.234863 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9d6cc0e2-fae7-4717-b73a-a7c6dde99724 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:54.235408 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9d6cc0e2-fae7-4717-b73a-a7c6dde99724 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:54.241576 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9d6cc0e2-fae7-4717-b73a-a7c6dde99724 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:54.242021 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9d6cc0e2-fae7-4717-b73a-a7c6dde99724 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:54.242810 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9d6cc0e2-fae7-4717-b73a-a7c6dde99724 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:54.243248 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9d6cc0e2-fae7-4717-b73a-a7c6dde99724 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:54.362891 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-9d6cc0e2-fae7-4717-b73a-a7c6dde99724 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:54.370566 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9d6cc0e2-fae7-4717-b73a-a7c6dde99724 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.139456 Oct 29 01:43:54.371120 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1104/2039] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:54 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:55.387915 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-13194a6a-9583-4146-b649-557bb73348c1 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:55.388519 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-13194a6a-9583-4146-b649-557bb73348c1 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:55.394663 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-13194a6a-9583-4146-b649-557bb73348c1 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:55.395107 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-13194a6a-9583-4146-b649-557bb73348c1 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:55.395859 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-13194a6a-9583-4146-b649-557bb73348c1 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:55.396285 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-13194a6a-9583-4146-b649-557bb73348c1 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:55.518656 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-13194a6a-9583-4146-b649-557bb73348c1 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:55.526267 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-13194a6a-9583-4146-b649-557bb73348c1 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.142636 Oct 29 01:43:55.526859 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 936/2040] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:55 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:56.542471 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a245e453-6055-43c8-84d7-167ae1aedb24 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:56.543080 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a245e453-6055-43c8-84d7-167ae1aedb24 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:56.549748 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a245e453-6055-43c8-84d7-167ae1aedb24 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:56.550197 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a245e453-6055-43c8-84d7-167ae1aedb24 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:56.550994 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a245e453-6055-43c8-84d7-167ae1aedb24 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:56.551423 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a245e453-6055-43c8-84d7-167ae1aedb24 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:56.671362 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-a245e453-6055-43c8-84d7-167ae1aedb24 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:56.682435 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a245e453-6055-43c8-84d7-167ae1aedb24 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.143680 Oct 29 01:43:56.683007 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1105/2041] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:56 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:57.699553 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-58cd9ec6-933e-47a7-ac01-440a4f396e53 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:57.700164 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-58cd9ec6-933e-47a7-ac01-440a4f396e53 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:57.706582 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-58cd9ec6-933e-47a7-ac01-440a4f396e53 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:57.707035 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-58cd9ec6-933e-47a7-ac01-440a4f396e53 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:57.707821 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-58cd9ec6-933e-47a7-ac01-440a4f396e53 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:57.708249 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-58cd9ec6-933e-47a7-ac01-440a4f396e53 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:57.826511 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-58cd9ec6-933e-47a7-ac01-440a4f396e53 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:57.834439 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-58cd9ec6-933e-47a7-ac01-440a4f396e53 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.138918 Oct 29 01:43:57.835005 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 937/2042] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:57 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:58.851818 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-663d06c5-58e2-472b-b11f-f76eddfd8deb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:58.852416 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-663d06c5-58e2-472b-b11f-f76eddfd8deb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:43:58.859264 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-663d06c5-58e2-472b-b11f-f76eddfd8deb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:58.859733 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-663d06c5-58e2-472b-b11f-f76eddfd8deb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:58.860474 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-663d06c5-58e2-472b-b11f-f76eddfd8deb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:43:58.860903 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-663d06c5-58e2-472b-b11f-f76eddfd8deb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:43:58.981688 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-663d06c5-58e2-472b-b11f-f76eddfd8deb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:58.989353 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-663d06c5-58e2-472b-b11f-f76eddfd8deb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.141149 Oct 29 01:43:58.989904 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1106/2043] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:43:58 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:00.006078 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-8e1e8745-fd70-4afa-b8c0-16c97d64113b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:00.006739 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-8e1e8745-fd70-4afa-b8c0-16c97d64113b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:00.012928 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8e1e8745-fd70-4afa-b8c0-16c97d64113b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:00.013365 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8e1e8745-fd70-4afa-b8c0-16c97d64113b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:00.014110 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8e1e8745-fd70-4afa-b8c0-16c97d64113b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:00.014580 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8e1e8745-fd70-4afa-b8c0-16c97d64113b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:00.132801 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-8e1e8745-fd70-4afa-b8c0-16c97d64113b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:00.140529 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-8e1e8745-fd70-4afa-b8c0-16c97d64113b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.138067 Oct 29 01:44:00.141096 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 938/2044] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:00 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:01.156702 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-fe897268-8593-46a9-9659-256c2cc8f6f3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:01.157287 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-fe897268-8593-46a9-9659-256c2cc8f6f3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:01.163427 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fe897268-8593-46a9-9659-256c2cc8f6f3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:01.163869 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fe897268-8593-46a9-9659-256c2cc8f6f3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:01.164613 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fe897268-8593-46a9-9659-256c2cc8f6f3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:01.165040 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fe897268-8593-46a9-9659-256c2cc8f6f3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:01.287764 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-fe897268-8593-46a9-9659-256c2cc8f6f3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:01.295518 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-fe897268-8593-46a9-9659-256c2cc8f6f3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.142410 Oct 29 01:44:01.296079 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1107/2045] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:01 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:02.312840 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-41d06daf-3b0f-4e45-b8e2-641af056de66 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:02.313457 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-41d06daf-3b0f-4e45-b8e2-641af056de66 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:02.320332 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-41d06daf-3b0f-4e45-b8e2-641af056de66 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:02.320783 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-41d06daf-3b0f-4e45-b8e2-641af056de66 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:02.321548 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-41d06daf-3b0f-4e45-b8e2-641af056de66 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:02.321988 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-41d06daf-3b0f-4e45-b8e2-641af056de66 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:02.446743 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-41d06daf-3b0f-4e45-b8e2-641af056de66 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:02.454774 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-41d06daf-3b0f-4e45-b8e2-641af056de66 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.145474 Oct 29 01:44:02.455340 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 939/2046] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:02 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:03.471962 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-6ea7853c-8839-4849-9a64-5bbb6e6205bb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:03.472573 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-6ea7853c-8839-4849-9a64-5bbb6e6205bb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:03.478747 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6ea7853c-8839-4849-9a64-5bbb6e6205bb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:03.479190 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6ea7853c-8839-4849-9a64-5bbb6e6205bb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:03.479939 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6ea7853c-8839-4849-9a64-5bbb6e6205bb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:03.480371 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6ea7853c-8839-4849-9a64-5bbb6e6205bb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:03.598687 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-6ea7853c-8839-4849-9a64-5bbb6e6205bb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:03.607336 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-6ea7853c-8839-4849-9a64-5bbb6e6205bb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.138919 Oct 29 01:44:03.607895 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1108/2047] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:03 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:04.625082 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-96ef005b-b6f0-492d-8372-b7183c9e6fa1 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:04.625685 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-96ef005b-b6f0-492d-8372-b7183c9e6fa1 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:04.631805 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-96ef005b-b6f0-492d-8372-b7183c9e6fa1 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:04.632247 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-96ef005b-b6f0-492d-8372-b7183c9e6fa1 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:04.632996 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-96ef005b-b6f0-492d-8372-b7183c9e6fa1 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:04.633422 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-96ef005b-b6f0-492d-8372-b7183c9e6fa1 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:04.751109 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-96ef005b-b6f0-492d-8372-b7183c9e6fa1 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:04.758862 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-96ef005b-b6f0-492d-8372-b7183c9e6fa1 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.137642 Oct 29 01:44:04.759917 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 940/2048] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:04 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:05.776849 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-40404711-16f7-44cf-99f5-330f061df87d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:05.777400 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-40404711-16f7-44cf-99f5-330f061df87d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:05.783517 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-40404711-16f7-44cf-99f5-330f061df87d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:05.783956 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-40404711-16f7-44cf-99f5-330f061df87d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:05.784699 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-40404711-16f7-44cf-99f5-330f061df87d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:05.785124 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-40404711-16f7-44cf-99f5-330f061df87d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:05.907093 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-40404711-16f7-44cf-99f5-330f061df87d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:05.914999 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-40404711-16f7-44cf-99f5-330f061df87d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.142332 Oct 29 01:44:05.915581 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1109/2049] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:05 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:06.931040 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-832cbd07-9a27-411d-8fc8-a9aa35abd785 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:06.932370 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-832cbd07-9a27-411d-8fc8-a9aa35abd785 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:06.938713 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-832cbd07-9a27-411d-8fc8-a9aa35abd785 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:06.939165 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-832cbd07-9a27-411d-8fc8-a9aa35abd785 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:06.939925 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-832cbd07-9a27-411d-8fc8-a9aa35abd785 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:06.940389 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-832cbd07-9a27-411d-8fc8-a9aa35abd785 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:07.059206 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-832cbd07-9a27-411d-8fc8-a9aa35abd785 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:07.066913 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-832cbd07-9a27-411d-8fc8-a9aa35abd785 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.139532 Oct 29 01:44:07.067470 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 941/2050] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:06 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:07.845622 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:44:07.846176 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: Fri Oct 29 01:44:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 29 01:44:08.083903 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ad8fcb96-ad92-41ca-906c-c5a4aa10bb54 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:08.084417 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ad8fcb96-ad92-41ca-906c-c5a4aa10bb54 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:08.090659 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ad8fcb96-ad92-41ca-906c-c5a4aa10bb54 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:08.091112 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ad8fcb96-ad92-41ca-906c-c5a4aa10bb54 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:08.091875 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ad8fcb96-ad92-41ca-906c-c5a4aa10bb54 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:08.092311 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ad8fcb96-ad92-41ca-906c-c5a4aa10bb54 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:08.212737 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-ad8fcb96-ad92-41ca-906c-c5a4aa10bb54 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:08.220627 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ad8fcb96-ad92-41ca-906c-c5a4aa10bb54 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.140525 Oct 29 01:44:08.221181 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1110/2051] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:08 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:09.237842 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-82a9460c-e5f4-4423-9005-ad4e791bc3cc tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:09.238490 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-82a9460c-e5f4-4423-9005-ad4e791bc3cc tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:09.245293 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-82a9460c-e5f4-4423-9005-ad4e791bc3cc tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:09.245738 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-82a9460c-e5f4-4423-9005-ad4e791bc3cc tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:09.246524 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-82a9460c-e5f4-4423-9005-ad4e791bc3cc tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:09.246962 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-82a9460c-e5f4-4423-9005-ad4e791bc3cc tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:09.365622 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-82a9460c-e5f4-4423-9005-ad4e791bc3cc tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:09.373718 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-82a9460c-e5f4-4423-9005-ad4e791bc3cc tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.139503 Oct 29 01:44:09.374284 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 942/2052] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:09 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:10.391431 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-39e17143-0d6d-4b8e-a04b-d40e3ad6c563 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:10.392060 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-39e17143-0d6d-4b8e-a04b-d40e3ad6c563 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:10.398241 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-39e17143-0d6d-4b8e-a04b-d40e3ad6c563 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:10.398719 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-39e17143-0d6d-4b8e-a04b-d40e3ad6c563 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:10.399480 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-39e17143-0d6d-4b8e-a04b-d40e3ad6c563 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:10.399912 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-39e17143-0d6d-4b8e-a04b-d40e3ad6c563 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:10.518917 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-39e17143-0d6d-4b8e-a04b-d40e3ad6c563 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:10.527304 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-39e17143-0d6d-4b8e-a04b-d40e3ad6c563 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.139531 Oct 29 01:44:10.527863 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1111/2053] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:10 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:11.544681 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-8ccb3cd9-4511-4b52-b512-cac16e435b87 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:11.545220 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-8ccb3cd9-4511-4b52-b512-cac16e435b87 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:11.551433 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8ccb3cd9-4511-4b52-b512-cac16e435b87 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:11.551884 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8ccb3cd9-4511-4b52-b512-cac16e435b87 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:11.552667 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8ccb3cd9-4511-4b52-b512-cac16e435b87 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:11.553100 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8ccb3cd9-4511-4b52-b512-cac16e435b87 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:11.675525 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-8ccb3cd9-4511-4b52-b512-cac16e435b87 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:11.683216 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-8ccb3cd9-4511-4b52-b512-cac16e435b87 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.142857 Oct 29 01:44:11.683785 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 943/2054] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:11 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:12.700703 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-776533d8-f7e5-4d73-b831-94e7badc78e6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:12.701436 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-776533d8-f7e5-4d73-b831-94e7badc78e6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:12.707617 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-776533d8-f7e5-4d73-b831-94e7badc78e6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:12.708068 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-776533d8-f7e5-4d73-b831-94e7badc78e6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:12.708832 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-776533d8-f7e5-4d73-b831-94e7badc78e6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:12.709264 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-776533d8-f7e5-4d73-b831-94e7badc78e6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:12.834751 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-776533d8-f7e5-4d73-b831-94e7badc78e6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:12.842376 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-776533d8-f7e5-4d73-b831-94e7badc78e6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.146067 Oct 29 01:44:12.842956 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1112/2055] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:12 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:13.858632 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e641650a-6375-439c-be46-c77f7b8a3ab3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:13.859236 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-e641650a-6375-439c-be46-c77f7b8a3ab3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:13.865087 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e641650a-6375-439c-be46-c77f7b8a3ab3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:13.865536 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e641650a-6375-439c-be46-c77f7b8a3ab3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:13.866290 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e641650a-6375-439c-be46-c77f7b8a3ab3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:13.866745 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e641650a-6375-439c-be46-c77f7b8a3ab3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:13.988510 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-e641650a-6375-439c-be46-c77f7b8a3ab3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:13.996719 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-e641650a-6375-439c-be46-c77f7b8a3ab3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1559 microversion: 2.1 time: 0.141715 Oct 29 01:44:13.997277 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 944/2056] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:13 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:15.020147 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-e3b3762f-5cee-483b-8a6c-b03ca8392a04 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:15.020741 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-e3b3762f-5cee-483b-8a6c-b03ca8392a04 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:15.028819 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e3b3762f-5cee-483b-8a6c-b03ca8392a04 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:15.029271 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e3b3762f-5cee-483b-8a6c-b03ca8392a04 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:15.030173 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e3b3762f-5cee-483b-8a6c-b03ca8392a04 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:15.030529 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e3b3762f-5cee-483b-8a6c-b03ca8392a04 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:15.095529 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-e3b3762f-5cee-483b-8a6c-b03ca8392a04 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:15.103474 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-e3b3762f-5cee-483b-8a6c-b03ca8392a04 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1517 microversion: 2.1 time: 0.091980 Oct 29 01:44:15.104208 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1113/2057] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:15 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1517 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:15.139709 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [req-3b669f19-12c8-4c12-a0fa-05e27e33e96a req-381d5107-e985-40de-bca7-882f4620a304 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97b0ab6c-d7cb-4e53-9288-3b6b2040a24d", "name": "network-vif-deleted", "tag": "b603e09e-bba1-4da7-9338-7f280edb3e9c"}]} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:44:15.141245 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:44:15.141245 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: warnings.warn(msg) Oct 29 01:44:15.148028 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-3b669f19-12c8-4c12-a0fa-05e27e33e96a req-381d5107-e985-40de-bca7-882f4620a304 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:15.148460 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-3b669f19-12c8-4c12-a0fa-05e27e33e96a req-381d5107-e985-40de-bca7-882f4620a304 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:15.159353 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.compute.server_external_events [req-3b669f19-12c8-4c12-a0fa-05e27e33e96a req-381d5107-e985-40de-bca7-882f4620a304 service nova] Creating event network-vif-deleted:b603e09e-bba1-4da7-9338-7f280edb3e9c for instance 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d on hv-cinder-81558 Oct 29 01:44:15.166273 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [req-3b669f19-12c8-4c12-a0fa-05e27e33e96a req-381d5107-e985-40de-bca7-882f4620a304 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096959 Oct 29 01:44:15.167147 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 945/2058] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:44:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:44:16.120317 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-79356c17-b6a6-4f2e-a345-ceaa3bf981e7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:16.120937 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-79356c17-b6a6-4f2e-a345-ceaa3bf981e7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:16.127075 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-79356c17-b6a6-4f2e-a345-ceaa3bf981e7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:16.127518 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-79356c17-b6a6-4f2e-a345-ceaa3bf981e7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:16.128265 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-79356c17-b6a6-4f2e-a345-ceaa3bf981e7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:16.128696 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-79356c17-b6a6-4f2e-a345-ceaa3bf981e7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:16.190862 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-79356c17-b6a6-4f2e-a345-ceaa3bf981e7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:16.198676 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-79356c17-b6a6-4f2e-a345-ceaa3bf981e7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.082116 Oct 29 01:44:16.199264 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1114/2059] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:16 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:17.216375 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-162e06d8-a3c6-4129-bad2-dc26fece957a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:17.216978 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-162e06d8-a3c6-4129-bad2-dc26fece957a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:17.223100 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-162e06d8-a3c6-4129-bad2-dc26fece957a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:17.223539 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-162e06d8-a3c6-4129-bad2-dc26fece957a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:17.224285 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-162e06d8-a3c6-4129-bad2-dc26fece957a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:17.224708 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-162e06d8-a3c6-4129-bad2-dc26fece957a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:17.285238 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-162e06d8-a3c6-4129-bad2-dc26fece957a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:17.293413 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-162e06d8-a3c6-4129-bad2-dc26fece957a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.081202 Oct 29 01:44:17.293967 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 946/2060] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:17 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:18.311256 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c970b76d-bd25-420f-befc-e61fecddea1f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:18.311863 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c970b76d-bd25-420f-befc-e61fecddea1f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:18.318254 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c970b76d-bd25-420f-befc-e61fecddea1f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:18.318729 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c970b76d-bd25-420f-befc-e61fecddea1f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:18.319482 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c970b76d-bd25-420f-befc-e61fecddea1f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:18.319907 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c970b76d-bd25-420f-befc-e61fecddea1f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:18.378599 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c970b76d-bd25-420f-befc-e61fecddea1f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:18.387120 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c970b76d-bd25-420f-befc-e61fecddea1f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.080852 Oct 29 01:44:18.387680 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1115/2061] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:18 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:44:19.404325 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-0f54e5c9-d19f-4c5a-8a12-df7adfedd64c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:19.404980 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-0f54e5c9-d19f-4c5a-8a12-df7adfedd64c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:19.411376 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0f54e5c9-d19f-4c5a-8a12-df7adfedd64c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:19.411818 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0f54e5c9-d19f-4c5a-8a12-df7adfedd64c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:19.412583 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0f54e5c9-d19f-4c5a-8a12-df7adfedd64c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:19.413006 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0f54e5c9-d19f-4c5a-8a12-df7adfedd64c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:19.471224 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-0f54e5c9-d19f-4c5a-8a12-df7adfedd64c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:19.478817 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-0f54e5c9-d19f-4c5a-8a12-df7adfedd64c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.078703 Oct 29 01:44:19.479367 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 947/2062] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:19 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:20.495630 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ba154280-99a2-4b3e-8692-c55e11b64cc0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:20.496375 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ba154280-99a2-4b3e-8692-c55e11b64cc0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:20.503917 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ba154280-99a2-4b3e-8692-c55e11b64cc0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:20.504360 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ba154280-99a2-4b3e-8692-c55e11b64cc0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:20.505114 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ba154280-99a2-4b3e-8692-c55e11b64cc0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:20.505536 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ba154280-99a2-4b3e-8692-c55e11b64cc0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:20.563896 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-ba154280-99a2-4b3e-8692-c55e11b64cc0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:20.571493 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ba154280-99a2-4b3e-8692-c55e11b64cc0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.080011 Oct 29 01:44:20.572719 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1116/2063] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:20 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:20.825510 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:44:20.825681 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: Fri Oct 29 01:44:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 29 01:44:21.589785 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-ff873cb0-b1fc-4e3c-8183-770f0d2f6b89 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:21.590420 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-ff873cb0-b1fc-4e3c-8183-770f0d2f6b89 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:21.597036 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ff873cb0-b1fc-4e3c-8183-770f0d2f6b89 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:21.597490 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ff873cb0-b1fc-4e3c-8183-770f0d2f6b89 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:21.598269 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ff873cb0-b1fc-4e3c-8183-770f0d2f6b89 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:21.598758 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ff873cb0-b1fc-4e3c-8183-770f0d2f6b89 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:21.657511 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-ff873cb0-b1fc-4e3c-8183-770f0d2f6b89 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:21.665392 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-ff873cb0-b1fc-4e3c-8183-770f0d2f6b89 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.079754 Oct 29 01:44:21.665966 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 948/2064] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:21 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:22.682714 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-1dd2231f-ec0f-451f-8904-aff1ebaed754 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:22.683374 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-1dd2231f-ec0f-451f-8904-aff1ebaed754 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:22.689915 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1dd2231f-ec0f-451f-8904-aff1ebaed754 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:22.690358 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1dd2231f-ec0f-451f-8904-aff1ebaed754 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:22.691161 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1dd2231f-ec0f-451f-8904-aff1ebaed754 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:22.691586 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1dd2231f-ec0f-451f-8904-aff1ebaed754 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:22.755672 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-1dd2231f-ec0f-451f-8904-aff1ebaed754 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:22.763345 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-1dd2231f-ec0f-451f-8904-aff1ebaed754 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.085085 Oct 29 01:44:22.763895 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1117/2065] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:22 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:23.779725 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-065d83ed-3e0a-426d-8e64-12ec927f8dc7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:23.780328 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-065d83ed-3e0a-426d-8e64-12ec927f8dc7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:23.786612 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-065d83ed-3e0a-426d-8e64-12ec927f8dc7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:23.787058 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-065d83ed-3e0a-426d-8e64-12ec927f8dc7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:23.787810 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-065d83ed-3e0a-426d-8e64-12ec927f8dc7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:23.788234 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-065d83ed-3e0a-426d-8e64-12ec927f8dc7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:23.851104 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-065d83ed-3e0a-426d-8e64-12ec927f8dc7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:23.859558 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-065d83ed-3e0a-426d-8e64-12ec927f8dc7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.083483 Oct 29 01:44:23.860128 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 949/2066] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:23 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:24.876885 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-3d9012a4-700a-4b94-818d-7215854d6863 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:24.877496 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-3d9012a4-700a-4b94-818d-7215854d6863 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:24.883780 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3d9012a4-700a-4b94-818d-7215854d6863 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:24.884162 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3d9012a4-700a-4b94-818d-7215854d6863 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:24.884919 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3d9012a4-700a-4b94-818d-7215854d6863 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:24.885355 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3d9012a4-700a-4b94-818d-7215854d6863 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:24.945555 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-3d9012a4-700a-4b94-818d-7215854d6863 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:24.953468 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-3d9012a4-700a-4b94-818d-7215854d6863 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.080289 Oct 29 01:44:24.954382 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1118/2067] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:24 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:25.970126 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-beb6491c-2a98-4d45-9603-ecda0f68fd84 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:25.970803 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-beb6491c-2a98-4d45-9603-ecda0f68fd84 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:25.977100 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-beb6491c-2a98-4d45-9603-ecda0f68fd84 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:25.977624 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-beb6491c-2a98-4d45-9603-ecda0f68fd84 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:25.978484 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-beb6491c-2a98-4d45-9603-ecda0f68fd84 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:25.979024 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-beb6491c-2a98-4d45-9603-ecda0f68fd84 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:26.039384 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-beb6491c-2a98-4d45-9603-ecda0f68fd84 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:26.047174 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-beb6491c-2a98-4d45-9603-ecda0f68fd84 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.080707 Oct 29 01:44:26.047743 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 950/2068] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:25 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:27.063711 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9d47da01-26a5-4dc6-93e6-e992ae6a26af tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:27.064422 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9d47da01-26a5-4dc6-93e6-e992ae6a26af tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:27.070584 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9d47da01-26a5-4dc6-93e6-e992ae6a26af tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:27.071042 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9d47da01-26a5-4dc6-93e6-e992ae6a26af tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:27.071842 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9d47da01-26a5-4dc6-93e6-e992ae6a26af tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:27.072307 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9d47da01-26a5-4dc6-93e6-e992ae6a26af tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:27.290792 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-9d47da01-26a5-4dc6-93e6-e992ae6a26af tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:27.298552 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9d47da01-26a5-4dc6-93e6-e992ae6a26af tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.238354 Oct 29 01:44:27.299041 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1119/2069] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:27 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:28.316194 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-23340e4c-994d-43ba-8d94-2c12b6587653 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:28.316743 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-23340e4c-994d-43ba-8d94-2c12b6587653 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:28.322938 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-23340e4c-994d-43ba-8d94-2c12b6587653 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:28.323882 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-23340e4c-994d-43ba-8d94-2c12b6587653 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:28.324640 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-23340e4c-994d-43ba-8d94-2c12b6587653 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:28.325069 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-23340e4c-994d-43ba-8d94-2c12b6587653 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:28.383932 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-23340e4c-994d-43ba-8d94-2c12b6587653 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:28.392112 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-23340e4c-994d-43ba-8d94-2c12b6587653 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.079670 Oct 29 01:44:28.392665 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 951/2070] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:28 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:29.408610 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-128f4ea8-1353-44af-a477-a1f0391b1e93 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:29.409138 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-128f4ea8-1353-44af-a477-a1f0391b1e93 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:29.415304 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-128f4ea8-1353-44af-a477-a1f0391b1e93 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:29.415751 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-128f4ea8-1353-44af-a477-a1f0391b1e93 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:29.416511 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-128f4ea8-1353-44af-a477-a1f0391b1e93 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:29.417444 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-128f4ea8-1353-44af-a477-a1f0391b1e93 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:29.481230 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-128f4ea8-1353-44af-a477-a1f0391b1e93 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:29.488908 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-128f4ea8-1353-44af-a477-a1f0391b1e93 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.083966 Oct 29 01:44:29.489455 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1120/2071] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:29 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:30.505821 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-4cb05f10-a6d1-4552-a1e1-0d9e7b014516 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:30.506429 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-4cb05f10-a6d1-4552-a1e1-0d9e7b014516 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:30.514284 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4cb05f10-a6d1-4552-a1e1-0d9e7b014516 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:30.514759 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4cb05f10-a6d1-4552-a1e1-0d9e7b014516 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:30.515530 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4cb05f10-a6d1-4552-a1e1-0d9e7b014516 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:30.515963 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4cb05f10-a6d1-4552-a1e1-0d9e7b014516 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:30.575009 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-4cb05f10-a6d1-4552-a1e1-0d9e7b014516 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:30.583026 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-4cb05f10-a6d1-4552-a1e1-0d9e7b014516 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.080980 Oct 29 01:44:30.583594 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 952/2072] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:30 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:31.599357 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-39cbb345-1ea0-4c5c-86e7-1c8f078d6eb0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:31.599962 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-39cbb345-1ea0-4c5c-86e7-1c8f078d6eb0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:31.606137 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-39cbb345-1ea0-4c5c-86e7-1c8f078d6eb0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:31.606623 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-39cbb345-1ea0-4c5c-86e7-1c8f078d6eb0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:31.607378 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-39cbb345-1ea0-4c5c-86e7-1c8f078d6eb0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:31.607811 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-39cbb345-1ea0-4c5c-86e7-1c8f078d6eb0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:31.665254 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-39cbb345-1ea0-4c5c-86e7-1c8f078d6eb0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:31.672779 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-39cbb345-1ea0-4c5c-86e7-1c8f078d6eb0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.077057 Oct 29 01:44:31.673325 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1121/2073] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:31 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:32.689901 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-3db4135a-cc95-413d-ae4d-33c05eee6519 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:32.690539 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-3db4135a-cc95-413d-ae4d-33c05eee6519 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:32.696831 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3db4135a-cc95-413d-ae4d-33c05eee6519 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:32.697270 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3db4135a-cc95-413d-ae4d-33c05eee6519 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:32.698024 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3db4135a-cc95-413d-ae4d-33c05eee6519 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:32.698470 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3db4135a-cc95-413d-ae4d-33c05eee6519 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:32.759362 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-3db4135a-cc95-413d-ae4d-33c05eee6519 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:32.766952 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-3db4135a-cc95-413d-ae4d-33c05eee6519 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.081510 Oct 29 01:44:32.767506 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 953/2074] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:32 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:33.783370 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-66489f33-6510-4f9f-ba63-4c0defdca143 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:33.783973 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-66489f33-6510-4f9f-ba63-4c0defdca143 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:33.790058 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-66489f33-6510-4f9f-ba63-4c0defdca143 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:33.790531 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-66489f33-6510-4f9f-ba63-4c0defdca143 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:33.791285 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-66489f33-6510-4f9f-ba63-4c0defdca143 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:33.792249 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-66489f33-6510-4f9f-ba63-4c0defdca143 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:33.849588 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-66489f33-6510-4f9f-ba63-4c0defdca143 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:33.857791 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-66489f33-6510-4f9f-ba63-4c0defdca143 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.078147 Oct 29 01:44:33.858335 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1122/2075] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:33 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:34.874870 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d2ad6f83-99e4-4c22-92f5-cd58fd912335 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:34.875471 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d2ad6f83-99e4-4c22-92f5-cd58fd912335 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:34.881512 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d2ad6f83-99e4-4c22-92f5-cd58fd912335 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:34.881952 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d2ad6f83-99e4-4c22-92f5-cd58fd912335 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:34.882727 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d2ad6f83-99e4-4c22-92f5-cd58fd912335 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:34.883158 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d2ad6f83-99e4-4c22-92f5-cd58fd912335 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:34.941192 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-d2ad6f83-99e4-4c22-92f5-cd58fd912335 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:34.949427 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d2ad6f83-99e4-4c22-92f5-cd58fd912335 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.078259 Oct 29 01:44:34.949983 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 954/2076] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:34 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:35.966501 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-db470ad1-0de3-4d32-ab73-521473696263 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:35.967156 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-db470ad1-0de3-4d32-ab73-521473696263 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:35.973329 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-db470ad1-0de3-4d32-ab73-521473696263 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:35.973779 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-db470ad1-0de3-4d32-ab73-521473696263 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:35.974568 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-db470ad1-0de3-4d32-ab73-521473696263 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:35.975010 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-db470ad1-0de3-4d32-ab73-521473696263 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:36.037869 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-db470ad1-0de3-4d32-ab73-521473696263 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:36.046078 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-db470ad1-0de3-4d32-ab73-521473696263 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.083309 Oct 29 01:44:36.046670 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1123/2077] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:35 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:44:36.349665 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:44:36.349879 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: Fri Oct 29 01:44:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 29 01:44:37.063273 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-813316fc-28be-49b0-8beb-27788830a80f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:37.063816 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-813316fc-28be-49b0-8beb-27788830a80f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:37.069945 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-813316fc-28be-49b0-8beb-27788830a80f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:37.070407 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-813316fc-28be-49b0-8beb-27788830a80f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:37.071162 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-813316fc-28be-49b0-8beb-27788830a80f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:37.071584 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-813316fc-28be-49b0-8beb-27788830a80f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:37.378122 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-813316fc-28be-49b0-8beb-27788830a80f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:37.385912 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-813316fc-28be-49b0-8beb-27788830a80f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.326352 Oct 29 01:44:37.386496 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 955/2078] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:37 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:38.403022 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ec551a90-ff99-45bb-aac8-43e140d30999 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:38.403633 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ec551a90-ff99-45bb-aac8-43e140d30999 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:38.409823 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ec551a90-ff99-45bb-aac8-43e140d30999 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:38.410271 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ec551a90-ff99-45bb-aac8-43e140d30999 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:38.411065 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ec551a90-ff99-45bb-aac8-43e140d30999 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:38.411499 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ec551a90-ff99-45bb-aac8-43e140d30999 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:38.469345 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-ec551a90-ff99-45bb-aac8-43e140d30999 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:38.476874 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ec551a90-ff99-45bb-aac8-43e140d30999 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.078171 Oct 29 01:44:38.477423 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1124/2079] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:38 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:39.493443 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-b85d89aa-5796-4487-afd7-ee2395a0e615 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:39.494034 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-b85d89aa-5796-4487-afd7-ee2395a0e615 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:39.500713 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b85d89aa-5796-4487-afd7-ee2395a0e615 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:39.501156 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b85d89aa-5796-4487-afd7-ee2395a0e615 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:39.501908 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b85d89aa-5796-4487-afd7-ee2395a0e615 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:39.502335 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b85d89aa-5796-4487-afd7-ee2395a0e615 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:39.559786 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-b85d89aa-5796-4487-afd7-ee2395a0e615 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:39.567497 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-b85d89aa-5796-4487-afd7-ee2395a0e615 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.077687 Oct 29 01:44:39.568060 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 956/2080] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:39 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:40.585314 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-7a170d83-37f0-44dd-a655-63aa5a2422cd tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:40.585917 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-7a170d83-37f0-44dd-a655-63aa5a2422cd tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:40.592312 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7a170d83-37f0-44dd-a655-63aa5a2422cd tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:40.592751 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7a170d83-37f0-44dd-a655-63aa5a2422cd tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:40.593501 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7a170d83-37f0-44dd-a655-63aa5a2422cd tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:40.593928 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7a170d83-37f0-44dd-a655-63aa5a2422cd tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:40.653595 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-7a170d83-37f0-44dd-a655-63aa5a2422cd tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:40.661076 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-7a170d83-37f0-44dd-a655-63aa5a2422cd tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.079365 Oct 29 01:44:40.661616 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1125/2081] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:40 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:41.678320 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2957c841-7606-49e8-9dc9-1c434937cec0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:41.678959 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2957c841-7606-49e8-9dc9-1c434937cec0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:41.685736 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2957c841-7606-49e8-9dc9-1c434937cec0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:41.686175 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2957c841-7606-49e8-9dc9-1c434937cec0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:41.686962 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2957c841-7606-49e8-9dc9-1c434937cec0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:41.687397 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2957c841-7606-49e8-9dc9-1c434937cec0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:41.749379 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-2957c841-7606-49e8-9dc9-1c434937cec0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:41.756982 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2957c841-7606-49e8-9dc9-1c434937cec0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.082339 Oct 29 01:44:41.757552 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 957/2082] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:41 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:42.773209 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-7bde8431-9669-425c-ae9f-69f33b4245a2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:42.773817 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-7bde8431-9669-425c-ae9f-69f33b4245a2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:42.780631 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7bde8431-9669-425c-ae9f-69f33b4245a2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:42.781080 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7bde8431-9669-425c-ae9f-69f33b4245a2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:42.781837 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7bde8431-9669-425c-ae9f-69f33b4245a2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:42.782267 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7bde8431-9669-425c-ae9f-69f33b4245a2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:42.841565 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-7bde8431-9669-425c-ae9f-69f33b4245a2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:42.849422 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-7bde8431-9669-425c-ae9f-69f33b4245a2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.079832 Oct 29 01:44:42.849977 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1126/2083] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:42 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:43.865902 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-aca5fb30-4c23-4fb6-912e-650ad7eda584 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:43.866573 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-aca5fb30-4c23-4fb6-912e-650ad7eda584 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:43.874410 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-aca5fb30-4c23-4fb6-912e-650ad7eda584 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:43.874935 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-aca5fb30-4c23-4fb6-912e-650ad7eda584 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:43.876002 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-aca5fb30-4c23-4fb6-912e-650ad7eda584 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:43.876248 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-aca5fb30-4c23-4fb6-912e-650ad7eda584 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:43.935792 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-aca5fb30-4c23-4fb6-912e-650ad7eda584 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:43.943646 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-aca5fb30-4c23-4fb6-912e-650ad7eda584 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.082019 Oct 29 01:44:43.944199 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 958/2084] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:43 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:44.961738 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-6cb47550-1322-4dfb-9d11-30bc49784dfb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:44.962347 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-6cb47550-1322-4dfb-9d11-30bc49784dfb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:44.968656 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6cb47550-1322-4dfb-9d11-30bc49784dfb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:44.969127 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6cb47550-1322-4dfb-9d11-30bc49784dfb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:44.969922 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6cb47550-1322-4dfb-9d11-30bc49784dfb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:44.970306 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6cb47550-1322-4dfb-9d11-30bc49784dfb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:45.028197 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-6cb47550-1322-4dfb-9d11-30bc49784dfb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:45.035857 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-6cb47550-1322-4dfb-9d11-30bc49784dfb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.078320 Oct 29 01:44:45.036415 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1127/2085] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:44 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:46.052653 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f3ac4521-1469-4128-847a-d6a3f09af4d3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:46.053331 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f3ac4521-1469-4128-847a-d6a3f09af4d3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:46.060150 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f3ac4521-1469-4128-847a-d6a3f09af4d3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:46.060573 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f3ac4521-1469-4128-847a-d6a3f09af4d3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:46.061334 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f3ac4521-1469-4128-847a-d6a3f09af4d3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:46.061789 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f3ac4521-1469-4128-847a-d6a3f09af4d3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:46.120028 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-f3ac4521-1469-4128-847a-d6a3f09af4d3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:46.128229 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f3ac4521-1469-4128-847a-d6a3f09af4d3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.079234 Oct 29 01:44:46.128795 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 959/2086] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:46 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:47.146027 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9c792281-953d-4b29-986d-2597af32e93d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:47.146652 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9c792281-953d-4b29-986d-2597af32e93d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:47.153419 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9c792281-953d-4b29-986d-2597af32e93d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:47.153866 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9c792281-953d-4b29-986d-2597af32e93d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:47.154653 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9c792281-953d-4b29-986d-2597af32e93d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:47.155087 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9c792281-953d-4b29-986d-2597af32e93d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:47.216274 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-9c792281-953d-4b29-986d-2597af32e93d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:47.223853 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9c792281-953d-4b29-986d-2597af32e93d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.081441 Oct 29 01:44:47.224400 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1128/2087] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:47 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:48.240319 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c8e62e26-8485-4bbe-9515-72755beb408d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:48.240866 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c8e62e26-8485-4bbe-9515-72755beb408d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:48.247835 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c8e62e26-8485-4bbe-9515-72755beb408d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:48.248282 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c8e62e26-8485-4bbe-9515-72755beb408d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:48.249040 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c8e62e26-8485-4bbe-9515-72755beb408d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:48.249473 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c8e62e26-8485-4bbe-9515-72755beb408d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:48.308484 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-c8e62e26-8485-4bbe-9515-72755beb408d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:48.316189 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c8e62e26-8485-4bbe-9515-72755beb408d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.079624 Oct 29 01:44:48.316744 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 960/2088] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:48 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:49.333450 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-5abfed16-1066-442f-a718-f31176e4f4b7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:49.334070 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-5abfed16-1066-442f-a718-f31176e4f4b7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:49.340672 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5abfed16-1066-442f-a718-f31176e4f4b7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:49.341127 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5abfed16-1066-442f-a718-f31176e4f4b7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:49.341896 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5abfed16-1066-442f-a718-f31176e4f4b7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:49.342334 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5abfed16-1066-442f-a718-f31176e4f4b7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:49.401115 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-5abfed16-1066-442f-a718-f31176e4f4b7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:49.408916 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-5abfed16-1066-442f-a718-f31176e4f4b7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.079221 Oct 29 01:44:49.409462 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1129/2089] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:49 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:50.425360 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-29c32d59-e6e7-453d-bd4e-411ad03f8e45 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:50.425971 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-29c32d59-e6e7-453d-bd4e-411ad03f8e45 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:50.432258 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-29c32d59-e6e7-453d-bd4e-411ad03f8e45 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:50.432705 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-29c32d59-e6e7-453d-bd4e-411ad03f8e45 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:50.433460 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-29c32d59-e6e7-453d-bd4e-411ad03f8e45 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:50.434447 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-29c32d59-e6e7-453d-bd4e-411ad03f8e45 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:50.492502 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-29c32d59-e6e7-453d-bd4e-411ad03f8e45 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:50.500549 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-29c32d59-e6e7-453d-bd4e-411ad03f8e45 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.078782 Oct 29 01:44:50.501228 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 961/2090] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:50 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:51.516825 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-cc0b472a-89b0-4c38-a12f-4fc3bf616b39 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:51.517355 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-cc0b472a-89b0-4c38-a12f-4fc3bf616b39 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:51.523646 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cc0b472a-89b0-4c38-a12f-4fc3bf616b39 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:51.524094 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cc0b472a-89b0-4c38-a12f-4fc3bf616b39 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:51.524878 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cc0b472a-89b0-4c38-a12f-4fc3bf616b39 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:51.525308 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cc0b472a-89b0-4c38-a12f-4fc3bf616b39 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:51.583679 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-cc0b472a-89b0-4c38-a12f-4fc3bf616b39 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:51.592015 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-cc0b472a-89b0-4c38-a12f-4fc3bf616b39 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.078891 Oct 29 01:44:51.592565 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1130/2091] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:51 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:52.608808 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-5a5cfb21-ed67-492f-8e58-8b6bfd1a6ee8 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:52.609429 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-5a5cfb21-ed67-492f-8e58-8b6bfd1a6ee8 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:52.615676 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5a5cfb21-ed67-492f-8e58-8b6bfd1a6ee8 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:52.616124 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5a5cfb21-ed67-492f-8e58-8b6bfd1a6ee8 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:52.616881 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5a5cfb21-ed67-492f-8e58-8b6bfd1a6ee8 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:52.617403 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5a5cfb21-ed67-492f-8e58-8b6bfd1a6ee8 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:52.675441 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-5a5cfb21-ed67-492f-8e58-8b6bfd1a6ee8 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:52.682996 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-5a5cfb21-ed67-492f-8e58-8b6bfd1a6ee8 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.077931 Oct 29 01:44:52.683563 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 962/2092] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:52 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:53.701350 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9f5f5258-1023-436b-b078-5445ca9bfb64 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:53.702224 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9f5f5258-1023-436b-b078-5445ca9bfb64 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:53.708357 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9f5f5258-1023-436b-b078-5445ca9bfb64 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:53.708795 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9f5f5258-1023-436b-b078-5445ca9bfb64 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:53.709543 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9f5f5258-1023-436b-b078-5445ca9bfb64 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:53.709969 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9f5f5258-1023-436b-b078-5445ca9bfb64 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:53.771247 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-9f5f5258-1023-436b-b078-5445ca9bfb64 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:53.778922 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9f5f5258-1023-436b-b078-5445ca9bfb64 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.081823 Oct 29 01:44:53.779468 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1131/2093] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:53 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:54.795345 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-46096e53-ccff-4d36-9257-ed80e24b96e4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:54.795982 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-46096e53-ccff-4d36-9257-ed80e24b96e4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:54.802096 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-46096e53-ccff-4d36-9257-ed80e24b96e4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:54.802580 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-46096e53-ccff-4d36-9257-ed80e24b96e4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:54.803336 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-46096e53-ccff-4d36-9257-ed80e24b96e4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:54.803765 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-46096e53-ccff-4d36-9257-ed80e24b96e4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:54.863352 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-46096e53-ccff-4d36-9257-ed80e24b96e4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:54.871082 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-46096e53-ccff-4d36-9257-ed80e24b96e4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.079338 Oct 29 01:44:54.871642 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 963/2094] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:54 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:55.888684 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-cc770896-fe2f-4a8c-a2a6-3c6d94eb2ed6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:55.889322 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-cc770896-fe2f-4a8c-a2a6-3c6d94eb2ed6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:55.895510 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cc770896-fe2f-4a8c-a2a6-3c6d94eb2ed6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:55.895952 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cc770896-fe2f-4a8c-a2a6-3c6d94eb2ed6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:55.896703 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cc770896-fe2f-4a8c-a2a6-3c6d94eb2ed6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:55.897130 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cc770896-fe2f-4a8c-a2a6-3c6d94eb2ed6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:55.956997 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-cc770896-fe2f-4a8c-a2a6-3c6d94eb2ed6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:55.964853 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-cc770896-fe2f-4a8c-a2a6-3c6d94eb2ed6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.080921 Oct 29 01:44:55.965404 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1132/2095] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:55 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:56.981423 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-7fb974ec-3e07-4f0b-b374-e37cabd067e6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:56.981972 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-7fb974ec-3e07-4f0b-b374-e37cabd067e6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:56.988179 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7fb974ec-3e07-4f0b-b374-e37cabd067e6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:56.988613 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7fb974ec-3e07-4f0b-b374-e37cabd067e6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:56.989392 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7fb974ec-3e07-4f0b-b374-e37cabd067e6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:56.989816 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7fb974ec-3e07-4f0b-b374-e37cabd067e6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:57.048926 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-7fb974ec-3e07-4f0b-b374-e37cabd067e6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:57.056519 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-7fb974ec-3e07-4f0b-b374-e37cabd067e6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.079287 Oct 29 01:44:57.057071 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 964/2096] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:56 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:58.073891 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f286f537-e6ea-46c7-bee4-2b4ee2194326 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:58.075222 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f286f537-e6ea-46c7-bee4-2b4ee2194326 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:58.081558 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f286f537-e6ea-46c7-bee4-2b4ee2194326 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:58.082000 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f286f537-e6ea-46c7-bee4-2b4ee2194326 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:58.082779 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f286f537-e6ea-46c7-bee4-2b4ee2194326 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:58.083208 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f286f537-e6ea-46c7-bee4-2b4ee2194326 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:58.141703 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-f286f537-e6ea-46c7-bee4-2b4ee2194326 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:58.149300 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f286f537-e6ea-46c7-bee4-2b4ee2194326 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.079120 Oct 29 01:44:58.149841 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1133/2097] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:58 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:59.165640 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-311e7476-e204-4463-af50-c3a17d20cc91 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:59.166248 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-311e7476-e204-4463-af50-c3a17d20cc91 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:44:59.172696 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-311e7476-e204-4463-af50-c3a17d20cc91 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:59.173151 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-311e7476-e204-4463-af50-c3a17d20cc91 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:59.173920 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-311e7476-e204-4463-af50-c3a17d20cc91 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:44:59.174357 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-311e7476-e204-4463-af50-c3a17d20cc91 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:44:59.232949 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-311e7476-e204-4463-af50-c3a17d20cc91 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:59.240548 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-311e7476-e204-4463-af50-c3a17d20cc91 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.078593 Oct 29 01:44:59.241109 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 965/2098] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:44:59 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:00.257169 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-e01a365d-9e5e-4afb-afa3-e6680ae9fcec tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:00.257802 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-e01a365d-9e5e-4afb-afa3-e6680ae9fcec tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:00.264603 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e01a365d-9e5e-4afb-afa3-e6680ae9fcec tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:00.265049 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e01a365d-9e5e-4afb-afa3-e6680ae9fcec tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:00.265805 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e01a365d-9e5e-4afb-afa3-e6680ae9fcec tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:00.266231 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e01a365d-9e5e-4afb-afa3-e6680ae9fcec tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:00.329217 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-e01a365d-9e5e-4afb-afa3-e6680ae9fcec tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:00.336955 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-e01a365d-9e5e-4afb-afa3-e6680ae9fcec tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.083548 Oct 29 01:45:00.337499 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1134/2099] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:00 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:01.353746 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-7e3fe97a-5bd3-4e9c-a5c7-36a3f043c1ae tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:01.354351 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-7e3fe97a-5bd3-4e9c-a5c7-36a3f043c1ae tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:01.361124 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7e3fe97a-5bd3-4e9c-a5c7-36a3f043c1ae tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:01.361569 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7e3fe97a-5bd3-4e9c-a5c7-36a3f043c1ae tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:01.362316 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7e3fe97a-5bd3-4e9c-a5c7-36a3f043c1ae tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:01.362782 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7e3fe97a-5bd3-4e9c-a5c7-36a3f043c1ae tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:01.420415 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-7e3fe97a-5bd3-4e9c-a5c7-36a3f043c1ae tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:01.427915 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-7e3fe97a-5bd3-4e9c-a5c7-36a3f043c1ae tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.077844 Oct 29 01:45:01.428471 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 966/2100] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:01 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:02.445065 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-8b98344f-d72b-46ab-b990-22699ec17192 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:02.445678 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-8b98344f-d72b-46ab-b990-22699ec17192 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:02.452775 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8b98344f-d72b-46ab-b990-22699ec17192 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:02.453229 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8b98344f-d72b-46ab-b990-22699ec17192 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:02.453991 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8b98344f-d72b-46ab-b990-22699ec17192 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:02.454516 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8b98344f-d72b-46ab-b990-22699ec17192 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:02.512378 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-8b98344f-d72b-46ab-b990-22699ec17192 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:02.520067 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-8b98344f-d72b-46ab-b990-22699ec17192 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.078628 Oct 29 01:45:02.520618 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1135/2101] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:02 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:03.536377 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-89828d54-99b0-46ac-8143-bbda5bbb7ef6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:03.537014 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-89828d54-99b0-46ac-8143-bbda5bbb7ef6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:03.543296 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-89828d54-99b0-46ac-8143-bbda5bbb7ef6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:03.543739 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-89828d54-99b0-46ac-8143-bbda5bbb7ef6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:03.544490 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-89828d54-99b0-46ac-8143-bbda5bbb7ef6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:03.544916 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-89828d54-99b0-46ac-8143-bbda5bbb7ef6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:03.604833 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-89828d54-99b0-46ac-8143-bbda5bbb7ef6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:03.612866 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-89828d54-99b0-46ac-8143-bbda5bbb7ef6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.080222 Oct 29 01:45:03.613425 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 967/2102] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:03 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:45:04.629910 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-6484b9ff-d195-4768-8920-2fe0a6bd5cf8 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:04.630634 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-6484b9ff-d195-4768-8920-2fe0a6bd5cf8 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:04.637134 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6484b9ff-d195-4768-8920-2fe0a6bd5cf8 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:04.637585 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6484b9ff-d195-4768-8920-2fe0a6bd5cf8 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:04.638506 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6484b9ff-d195-4768-8920-2fe0a6bd5cf8 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:04.638940 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6484b9ff-d195-4768-8920-2fe0a6bd5cf8 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:04.699992 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-6484b9ff-d195-4768-8920-2fe0a6bd5cf8 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:04.708045 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-6484b9ff-d195-4768-8920-2fe0a6bd5cf8 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.081808 Oct 29 01:45:04.708588 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1136/2103] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:04 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:05.725642 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-214bb4ac-77f5-4b11-b1ad-358804745010 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:05.726273 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-214bb4ac-77f5-4b11-b1ad-358804745010 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:05.732362 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-214bb4ac-77f5-4b11-b1ad-358804745010 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:05.732800 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-214bb4ac-77f5-4b11-b1ad-358804745010 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:05.733548 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-214bb4ac-77f5-4b11-b1ad-358804745010 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:05.733971 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-214bb4ac-77f5-4b11-b1ad-358804745010 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:05.791543 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-214bb4ac-77f5-4b11-b1ad-358804745010 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:05.799806 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-214bb4ac-77f5-4b11-b1ad-358804745010 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.077837 Oct 29 01:45:05.800363 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 968/2104] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:05 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:06.817319 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-2ef0ad9a-137c-4a35-a160-c0be72ce2bba tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:06.817929 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-2ef0ad9a-137c-4a35-a160-c0be72ce2bba tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:06.825310 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2ef0ad9a-137c-4a35-a160-c0be72ce2bba tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:06.825763 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2ef0ad9a-137c-4a35-a160-c0be72ce2bba tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:06.826554 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2ef0ad9a-137c-4a35-a160-c0be72ce2bba tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:06.827278 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2ef0ad9a-137c-4a35-a160-c0be72ce2bba tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:06.889212 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-2ef0ad9a-137c-4a35-a160-c0be72ce2bba tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:06.896820 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-2ef0ad9a-137c-4a35-a160-c0be72ce2bba tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.083233 Oct 29 01:45:06.897368 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1137/2105] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:06 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:07.913565 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-9d6da4a1-84af-4fdc-8750-043691c9bf2e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:07.914176 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-9d6da4a1-84af-4fdc-8750-043691c9bf2e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:07.920925 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9d6da4a1-84af-4fdc-8750-043691c9bf2e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:07.921371 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9d6da4a1-84af-4fdc-8750-043691c9bf2e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:07.922196 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9d6da4a1-84af-4fdc-8750-043691c9bf2e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:07.922619 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9d6da4a1-84af-4fdc-8750-043691c9bf2e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:07.981959 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-9d6da4a1-84af-4fdc-8750-043691c9bf2e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:07.990103 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-9d6da4a1-84af-4fdc-8750-043691c9bf2e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.080262 Oct 29 01:45:07.990729 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 969/2106] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:07 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:09.006934 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-118de641-8793-495e-b0aa-884702066c4f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:09.007559 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-118de641-8793-495e-b0aa-884702066c4f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:09.014227 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-118de641-8793-495e-b0aa-884702066c4f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:09.014768 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-118de641-8793-495e-b0aa-884702066c4f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:09.015525 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-118de641-8793-495e-b0aa-884702066c4f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:09.015958 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-118de641-8793-495e-b0aa-884702066c4f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:09.075880 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-118de641-8793-495e-b0aa-884702066c4f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:09.083735 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-118de641-8793-495e-b0aa-884702066c4f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.080601 Oct 29 01:45:09.084293 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1138/2107] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:09 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:10.100982 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-822ff648-12ee-42cb-a473-f6ea0776d985 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:10.101591 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-822ff648-12ee-42cb-a473-f6ea0776d985 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:10.108642 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-822ff648-12ee-42cb-a473-f6ea0776d985 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:10.109091 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-822ff648-12ee-42cb-a473-f6ea0776d985 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:10.109849 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-822ff648-12ee-42cb-a473-f6ea0776d985 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:10.110309 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-822ff648-12ee-42cb-a473-f6ea0776d985 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:10.171359 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-822ff648-12ee-42cb-a473-f6ea0776d985 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:10.179253 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-822ff648-12ee-42cb-a473-f6ea0776d985 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.082062 Oct 29 01:45:10.179817 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 970/2108] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:10 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:11.196116 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b5fe11d7-fac2-446e-b745-353efff43680 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:11.196811 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b5fe11d7-fac2-446e-b745-353efff43680 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:11.203738 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b5fe11d7-fac2-446e-b745-353efff43680 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:11.204184 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b5fe11d7-fac2-446e-b745-353efff43680 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:11.204948 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b5fe11d7-fac2-446e-b745-353efff43680 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:11.205386 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b5fe11d7-fac2-446e-b745-353efff43680 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:11.270179 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-b5fe11d7-fac2-446e-b745-353efff43680 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:11.278469 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b5fe11d7-fac2-446e-b745-353efff43680 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.085393 Oct 29 01:45:11.279023 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1139/2109] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:11 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:12.295752 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-b3f14aa1-ef37-4bbd-b727-192941f33b76 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:12.296444 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-b3f14aa1-ef37-4bbd-b727-192941f33b76 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:12.302781 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b3f14aa1-ef37-4bbd-b727-192941f33b76 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:12.303433 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b3f14aa1-ef37-4bbd-b727-192941f33b76 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:12.304196 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b3f14aa1-ef37-4bbd-b727-192941f33b76 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:12.304694 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b3f14aa1-ef37-4bbd-b727-192941f33b76 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:12.366415 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-b3f14aa1-ef37-4bbd-b727-192941f33b76 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:12.374415 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-b3f14aa1-ef37-4bbd-b727-192941f33b76 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.082992 Oct 29 01:45:12.374996 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 971/2110] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:12 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:13.438405 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ed90e75f-5f11-4002-b61a-40c738d24c31 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:13.439035 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ed90e75f-5f11-4002-b61a-40c738d24c31 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:13.444676 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ed90e75f-5f11-4002-b61a-40c738d24c31 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:13.445118 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ed90e75f-5f11-4002-b61a-40c738d24c31 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:13.445866 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ed90e75f-5f11-4002-b61a-40c738d24c31 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:13.446298 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ed90e75f-5f11-4002-b61a-40c738d24c31 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:13.508481 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-ed90e75f-5f11-4002-b61a-40c738d24c31 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:13.516513 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ed90e75f-5f11-4002-b61a-40c738d24c31 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.128638 Oct 29 01:45:13.517064 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1140/2111] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:13 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:14.532813 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-759a24fc-d773-4188-bf71-a9e9c7254d82 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:14.533428 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-759a24fc-d773-4188-bf71-a9e9c7254d82 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:14.539640 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-759a24fc-d773-4188-bf71-a9e9c7254d82 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:14.540090 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-759a24fc-d773-4188-bf71-a9e9c7254d82 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:14.540852 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-759a24fc-d773-4188-bf71-a9e9c7254d82 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:14.541286 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-759a24fc-d773-4188-bf71-a9e9c7254d82 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:14.644378 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-759a24fc-d773-4188-bf71-a9e9c7254d82 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:14.652379 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-759a24fc-d773-4188-bf71-a9e9c7254d82 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.123313 Oct 29 01:45:14.652949 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 972/2112] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:14 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:15.671526 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b6c4fc77-a366-4ac5-b77f-f83f8b08445b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:15.672173 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b6c4fc77-a366-4ac5-b77f-f83f8b08445b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:15.678291 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b6c4fc77-a366-4ac5-b77f-f83f8b08445b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:15.678779 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b6c4fc77-a366-4ac5-b77f-f83f8b08445b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:15.679553 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b6c4fc77-a366-4ac5-b77f-f83f8b08445b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:15.679991 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b6c4fc77-a366-4ac5-b77f-f83f8b08445b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:15.739018 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-b6c4fc77-a366-4ac5-b77f-f83f8b08445b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:15.746698 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b6c4fc77-a366-4ac5-b77f-f83f8b08445b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.080992 Oct 29 01:45:15.747447 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1141/2113] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:15 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:16.764463 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-30364122-aee6-4bef-b7fc-8db76d243c1f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:16.765264 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-30364122-aee6-4bef-b7fc-8db76d243c1f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:16.772367 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-30364122-aee6-4bef-b7fc-8db76d243c1f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:16.772817 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-30364122-aee6-4bef-b7fc-8db76d243c1f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:16.773586 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-30364122-aee6-4bef-b7fc-8db76d243c1f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:16.774026 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-30364122-aee6-4bef-b7fc-8db76d243c1f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:16.832175 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-30364122-aee6-4bef-b7fc-8db76d243c1f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:16.839889 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-30364122-aee6-4bef-b7fc-8db76d243c1f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.080286 Oct 29 01:45:16.841050 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 973/2114] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:16 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:17.856837 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c6c11202-465d-49f4-aa34-5ced448dc100 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:17.857468 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c6c11202-465d-49f4-aa34-5ced448dc100 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:17.863609 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c6c11202-465d-49f4-aa34-5ced448dc100 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:17.864055 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c6c11202-465d-49f4-aa34-5ced448dc100 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:17.864807 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c6c11202-465d-49f4-aa34-5ced448dc100 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:17.865236 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c6c11202-465d-49f4-aa34-5ced448dc100 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:17.924871 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c6c11202-465d-49f4-aa34-5ced448dc100 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:17.932629 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c6c11202-465d-49f4-aa34-5ced448dc100 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.079942 Oct 29 01:45:17.933174 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1142/2115] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:17 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:18.949810 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-1a20649f-bec5-4806-930a-711dacfceb06 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:18.950456 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-1a20649f-bec5-4806-930a-711dacfceb06 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:18.957073 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1a20649f-bec5-4806-930a-711dacfceb06 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:18.957528 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1a20649f-bec5-4806-930a-711dacfceb06 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:18.958629 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1a20649f-bec5-4806-930a-711dacfceb06 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:18.958737 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1a20649f-bec5-4806-930a-711dacfceb06 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:19.017703 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-1a20649f-bec5-4806-930a-711dacfceb06 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:19.025647 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-1a20649f-bec5-4806-930a-711dacfceb06 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.079551 Oct 29 01:45:19.026208 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 974/2116] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:18 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:20.042781 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-e7922e6c-dd18-4db9-8525-89fe1253bf6b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:20.043875 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-e7922e6c-dd18-4db9-8525-89fe1253bf6b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:20.050082 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e7922e6c-dd18-4db9-8525-89fe1253bf6b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:20.050558 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e7922e6c-dd18-4db9-8525-89fe1253bf6b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:20.051310 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e7922e6c-dd18-4db9-8525-89fe1253bf6b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:20.051738 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e7922e6c-dd18-4db9-8525-89fe1253bf6b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:20.113838 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-e7922e6c-dd18-4db9-8525-89fe1253bf6b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:20.122083 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-e7922e6c-dd18-4db9-8525-89fe1253bf6b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.082330 Oct 29 01:45:20.122665 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1143/2117] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:20 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:21.137666 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-efa7e940-c2c0-45b2-8f17-0bc08ab5f80d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:21.138289 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-efa7e940-c2c0-45b2-8f17-0bc08ab5f80d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:21.144567 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-efa7e940-c2c0-45b2-8f17-0bc08ab5f80d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:21.145015 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-efa7e940-c2c0-45b2-8f17-0bc08ab5f80d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:21.145784 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-efa7e940-c2c0-45b2-8f17-0bc08ab5f80d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:21.146220 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-efa7e940-c2c0-45b2-8f17-0bc08ab5f80d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:21.204964 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-efa7e940-c2c0-45b2-8f17-0bc08ab5f80d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:21.212702 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-efa7e940-c2c0-45b2-8f17-0bc08ab5f80d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.078707 Oct 29 01:45:21.213218 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 975/2118] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:21 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:22.229408 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-30be44d0-a943-49f9-9186-6a7f96c139bc tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:22.230019 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-30be44d0-a943-49f9-9186-6a7f96c139bc tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:22.236864 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-30be44d0-a943-49f9-9186-6a7f96c139bc tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:22.237312 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-30be44d0-a943-49f9-9186-6a7f96c139bc tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:22.238101 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-30be44d0-a943-49f9-9186-6a7f96c139bc tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:22.238567 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-30be44d0-a943-49f9-9186-6a7f96c139bc tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:22.296805 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-30be44d0-a943-49f9-9186-6a7f96c139bc tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:22.306246 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-30be44d0-a943-49f9-9186-6a7f96c139bc tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.080513 Oct 29 01:45:22.306829 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1144/2119] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:22 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:23.322889 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-cea8a343-5c4c-4d33-a66c-c4770d959b66 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:23.323489 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-cea8a343-5c4c-4d33-a66c-c4770d959b66 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:23.329928 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cea8a343-5c4c-4d33-a66c-c4770d959b66 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:23.330378 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cea8a343-5c4c-4d33-a66c-c4770d959b66 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:23.331164 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cea8a343-5c4c-4d33-a66c-c4770d959b66 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:23.331596 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cea8a343-5c4c-4d33-a66c-c4770d959b66 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:23.389726 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-cea8a343-5c4c-4d33-a66c-c4770d959b66 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:23.397405 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-cea8a343-5c4c-4d33-a66c-c4770d959b66 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.078155 Oct 29 01:45:23.398190 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 976/2120] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:23 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:24.416815 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-1c99be63-8234-4a1c-a41e-0b31d0778dfb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:24.417420 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-1c99be63-8234-4a1c-a41e-0b31d0778dfb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:24.424348 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1c99be63-8234-4a1c-a41e-0b31d0778dfb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:24.424792 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1c99be63-8234-4a1c-a41e-0b31d0778dfb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:24.425540 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1c99be63-8234-4a1c-a41e-0b31d0778dfb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:24.425971 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1c99be63-8234-4a1c-a41e-0b31d0778dfb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:24.486183 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-1c99be63-8234-4a1c-a41e-0b31d0778dfb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:24.493794 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-1c99be63-8234-4a1c-a41e-0b31d0778dfb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.082063 Oct 29 01:45:24.494344 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1145/2121] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:24 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:25.510865 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-02a1a0b8-d287-4036-bc65-92e13d704fa3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:25.511505 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-02a1a0b8-d287-4036-bc65-92e13d704fa3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:25.517998 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-02a1a0b8-d287-4036-bc65-92e13d704fa3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:25.518466 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-02a1a0b8-d287-4036-bc65-92e13d704fa3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:25.519225 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-02a1a0b8-d287-4036-bc65-92e13d704fa3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:25.519658 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-02a1a0b8-d287-4036-bc65-92e13d704fa3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:25.579802 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-02a1a0b8-d287-4036-bc65-92e13d704fa3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:25.587363 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-02a1a0b8-d287-4036-bc65-92e13d704fa3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.080234 Oct 29 01:45:25.587922 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 977/2122] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:25 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:26.603675 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c131432b-075a-431e-ad1b-379fafe24809 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:26.604288 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c131432b-075a-431e-ad1b-379fafe24809 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:26.610494 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c131432b-075a-431e-ad1b-379fafe24809 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:26.610942 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c131432b-075a-431e-ad1b-379fafe24809 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:26.611700 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c131432b-075a-431e-ad1b-379fafe24809 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:26.612132 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c131432b-075a-431e-ad1b-379fafe24809 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:26.674641 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c131432b-075a-431e-ad1b-379fafe24809 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:26.684572 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c131432b-075a-431e-ad1b-379fafe24809 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.084552 Oct 29 01:45:26.685127 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1146/2123] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:26 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:27.701317 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-27e941dd-56e9-4e06-88e6-94d03af7433b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:27.702205 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-27e941dd-56e9-4e06-88e6-94d03af7433b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:27.708347 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-27e941dd-56e9-4e06-88e6-94d03af7433b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:27.708792 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-27e941dd-56e9-4e06-88e6-94d03af7433b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:27.709545 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-27e941dd-56e9-4e06-88e6-94d03af7433b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:27.709974 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-27e941dd-56e9-4e06-88e6-94d03af7433b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:27.768615 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-27e941dd-56e9-4e06-88e6-94d03af7433b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:27.776332 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-27e941dd-56e9-4e06-88e6-94d03af7433b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.079149 Oct 29 01:45:27.776909 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 978/2124] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:27 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:28.794309 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c512f207-4f6d-4ecf-b55c-ec8b20e61606 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:28.795012 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c512f207-4f6d-4ecf-b55c-ec8b20e61606 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:28.801196 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c512f207-4f6d-4ecf-b55c-ec8b20e61606 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:28.801637 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c512f207-4f6d-4ecf-b55c-ec8b20e61606 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:28.802401 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c512f207-4f6d-4ecf-b55c-ec8b20e61606 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:28.802838 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c512f207-4f6d-4ecf-b55c-ec8b20e61606 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:28.861804 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c512f207-4f6d-4ecf-b55c-ec8b20e61606 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:28.869338 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c512f207-4f6d-4ecf-b55c-ec8b20e61606 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.079425 Oct 29 01:45:28.869880 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1147/2125] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:28 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:29.884990 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-7809667a-f69c-4f6c-9b4d-3357d4a31abf tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:29.885602 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-7809667a-f69c-4f6c-9b4d-3357d4a31abf tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:29.892280 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7809667a-f69c-4f6c-9b4d-3357d4a31abf tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:29.892725 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7809667a-f69c-4f6c-9b4d-3357d4a31abf tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:29.893487 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7809667a-f69c-4f6c-9b4d-3357d4a31abf tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:29.893919 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7809667a-f69c-4f6c-9b4d-3357d4a31abf tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:29.953069 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-7809667a-f69c-4f6c-9b4d-3357d4a31abf tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:29.961155 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-7809667a-f69c-4f6c-9b4d-3357d4a31abf tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.079828 Oct 29 01:45:29.961775 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 979/2126] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:29 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:30.979569 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-e92517c4-3a4e-4163-850b-387cf15a4950 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:30.980227 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-e92517c4-3a4e-4163-850b-387cf15a4950 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:30.991596 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e92517c4-3a4e-4163-850b-387cf15a4950 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:30.993852 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e92517c4-3a4e-4163-850b-387cf15a4950 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:30.998315 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e92517c4-3a4e-4163-850b-387cf15a4950 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:30.999407 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e92517c4-3a4e-4163-850b-387cf15a4950 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:31.071152 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-e92517c4-3a4e-4163-850b-387cf15a4950 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:31.080109 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-e92517c4-3a4e-4163-850b-387cf15a4950 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.104895 Oct 29 01:45:31.080671 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1148/2127] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:30 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:32.097082 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-cf6f5541-9d11-4fed-8740-19d23add8da5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:32.097670 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-cf6f5541-9d11-4fed-8740-19d23add8da5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:32.104003 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cf6f5541-9d11-4fed-8740-19d23add8da5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:32.104451 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cf6f5541-9d11-4fed-8740-19d23add8da5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:32.105344 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cf6f5541-9d11-4fed-8740-19d23add8da5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:32.105780 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cf6f5541-9d11-4fed-8740-19d23add8da5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:32.165054 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-cf6f5541-9d11-4fed-8740-19d23add8da5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:32.172828 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-cf6f5541-9d11-4fed-8740-19d23add8da5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.079459 Oct 29 01:45:32.173399 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 980/2128] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:32 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:33.189784 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ccba6294-3826-4581-a17d-8e0f640c4682 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:33.190447 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ccba6294-3826-4581-a17d-8e0f640c4682 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:33.196608 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ccba6294-3826-4581-a17d-8e0f640c4682 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:33.197056 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ccba6294-3826-4581-a17d-8e0f640c4682 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:33.197838 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ccba6294-3826-4581-a17d-8e0f640c4682 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:33.198266 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ccba6294-3826-4581-a17d-8e0f640c4682 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:33.268283 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-ccba6294-3826-4581-a17d-8e0f640c4682 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:33.278216 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ccba6294-3826-4581-a17d-8e0f640c4682 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.092040 Oct 29 01:45:33.278817 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1149/2129] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:33 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:34.296511 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-8f1ba514-03c1-4abc-9197-51157cdd64c4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:34.297072 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-8f1ba514-03c1-4abc-9197-51157cdd64c4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:34.303493 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8f1ba514-03c1-4abc-9197-51157cdd64c4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:34.303939 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8f1ba514-03c1-4abc-9197-51157cdd64c4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:34.304704 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8f1ba514-03c1-4abc-9197-51157cdd64c4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:34.305138 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8f1ba514-03c1-4abc-9197-51157cdd64c4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:34.364503 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-8f1ba514-03c1-4abc-9197-51157cdd64c4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:34.372220 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-8f1ba514-03c1-4abc-9197-51157cdd64c4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.079884 Oct 29 01:45:34.372783 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 981/2130] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:34 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:35.389029 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-e80fef20-5924-4938-816e-12b0719acef0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:35.389634 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-e80fef20-5924-4938-816e-12b0719acef0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:35.395902 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e80fef20-5924-4938-816e-12b0719acef0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:35.396451 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e80fef20-5924-4938-816e-12b0719acef0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:35.397233 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e80fef20-5924-4938-816e-12b0719acef0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:35.397658 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e80fef20-5924-4938-816e-12b0719acef0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:35.457795 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-e80fef20-5924-4938-816e-12b0719acef0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:35.467018 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-e80fef20-5924-4938-816e-12b0719acef0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.080811 Oct 29 01:45:35.467018 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1150/2131] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:35 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:36.482086 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-72a7de17-5e24-4d81-b396-a58dec3a66ff tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:36.482919 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-72a7de17-5e24-4d81-b396-a58dec3a66ff tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:36.488980 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-72a7de17-5e24-4d81-b396-a58dec3a66ff tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:36.489418 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-72a7de17-5e24-4d81-b396-a58dec3a66ff tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:36.490174 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-72a7de17-5e24-4d81-b396-a58dec3a66ff tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:36.490626 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-72a7de17-5e24-4d81-b396-a58dec3a66ff tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:36.554533 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-72a7de17-5e24-4d81-b396-a58dec3a66ff tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:36.563557 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-72a7de17-5e24-4d81-b396-a58dec3a66ff tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.085186 Oct 29 01:45:36.564130 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 982/2132] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:36 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:37.580939 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-880699a3-8038-4328-8435-7d01e6c6fd73 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:37.581646 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-880699a3-8038-4328-8435-7d01e6c6fd73 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:37.588220 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-880699a3-8038-4328-8435-7d01e6c6fd73 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:37.588679 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-880699a3-8038-4328-8435-7d01e6c6fd73 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:37.590018 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-880699a3-8038-4328-8435-7d01e6c6fd73 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:37.590501 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-880699a3-8038-4328-8435-7d01e6c6fd73 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:37.650125 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-880699a3-8038-4328-8435-7d01e6c6fd73 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:37.657831 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-880699a3-8038-4328-8435-7d01e6c6fd73 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.080509 Oct 29 01:45:37.658419 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1151/2133] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:37 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:38.674286 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-008ef361-28b0-4f26-9d81-6b14dd6423a4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:38.674918 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-008ef361-28b0-4f26-9d81-6b14dd6423a4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:38.681042 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-008ef361-28b0-4f26-9d81-6b14dd6423a4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:38.681482 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-008ef361-28b0-4f26-9d81-6b14dd6423a4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:38.682227 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-008ef361-28b0-4f26-9d81-6b14dd6423a4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:38.682685 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-008ef361-28b0-4f26-9d81-6b14dd6423a4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:38.740895 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-008ef361-28b0-4f26-9d81-6b14dd6423a4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:38.748466 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-008ef361-28b0-4f26-9d81-6b14dd6423a4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.077802 Oct 29 01:45:38.749052 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 983/2134] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:38 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:39.765272 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-8ed38261-9de7-458a-9287-834203e98d0a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:39.765885 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-8ed38261-9de7-458a-9287-834203e98d0a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:39.772144 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8ed38261-9de7-458a-9287-834203e98d0a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:39.772595 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8ed38261-9de7-458a-9287-834203e98d0a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:39.773359 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8ed38261-9de7-458a-9287-834203e98d0a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:39.773797 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8ed38261-9de7-458a-9287-834203e98d0a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:39.836858 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-8ed38261-9de7-458a-9287-834203e98d0a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:39.844501 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-8ed38261-9de7-458a-9287-834203e98d0a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.082829 Oct 29 01:45:39.845065 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1152/2135] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:39 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:40.861537 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-ce23f122-88dc-443d-b21a-a59d81184d2e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:40.862142 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-ce23f122-88dc-443d-b21a-a59d81184d2e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:40.868392 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ce23f122-88dc-443d-b21a-a59d81184d2e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:40.868830 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ce23f122-88dc-443d-b21a-a59d81184d2e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:40.869579 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ce23f122-88dc-443d-b21a-a59d81184d2e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:40.870004 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ce23f122-88dc-443d-b21a-a59d81184d2e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:40.929123 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-ce23f122-88dc-443d-b21a-a59d81184d2e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:40.936766 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-ce23f122-88dc-443d-b21a-a59d81184d2e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.078892 Oct 29 01:45:40.937322 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 984/2136] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:40 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:41.953603 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-cf55862a-45dd-4638-bf70-33f28164c876 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:41.954123 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-cf55862a-45dd-4638-bf70-33f28164c876 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:41.960898 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cf55862a-45dd-4638-bf70-33f28164c876 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:41.961349 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cf55862a-45dd-4638-bf70-33f28164c876 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:41.962116 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cf55862a-45dd-4638-bf70-33f28164c876 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:41.962581 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cf55862a-45dd-4638-bf70-33f28164c876 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:42.021280 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-cf55862a-45dd-4638-bf70-33f28164c876 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:42.028900 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-cf55862a-45dd-4638-bf70-33f28164c876 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.079424 Oct 29 01:45:42.029457 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1153/2137] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:41 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:43.045939 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-8132af60-5502-48e5-8acd-267f99808fb2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:43.046506 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-8132af60-5502-48e5-8acd-267f99808fb2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:43.052633 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8132af60-5502-48e5-8acd-267f99808fb2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:43.053076 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8132af60-5502-48e5-8acd-267f99808fb2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:43.053821 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8132af60-5502-48e5-8acd-267f99808fb2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:43.054244 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8132af60-5502-48e5-8acd-267f99808fb2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:43.112827 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-8132af60-5502-48e5-8acd-267f99808fb2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:43.121005 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-8132af60-5502-48e5-8acd-267f99808fb2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.078285 Oct 29 01:45:43.121557 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 985/2138] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:43 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:44.137222 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-4f6b019d-1eeb-4e6b-848f-a37aa5169d42 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:44.137834 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-4f6b019d-1eeb-4e6b-848f-a37aa5169d42 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:44.144053 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4f6b019d-1eeb-4e6b-848f-a37aa5169d42 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:44.144487 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4f6b019d-1eeb-4e6b-848f-a37aa5169d42 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:44.145271 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4f6b019d-1eeb-4e6b-848f-a37aa5169d42 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:44.145722 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4f6b019d-1eeb-4e6b-848f-a37aa5169d42 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:44.204803 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-4f6b019d-1eeb-4e6b-848f-a37aa5169d42 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:44.212847 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-4f6b019d-1eeb-4e6b-848f-a37aa5169d42 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.079738 Oct 29 01:45:44.213401 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1154/2139] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:44 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:45.230184 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e02ac3e8-f291-419c-aacc-f1b403fdb86c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:45.230815 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-e02ac3e8-f291-419c-aacc-f1b403fdb86c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:45.237004 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e02ac3e8-f291-419c-aacc-f1b403fdb86c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:45.237447 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e02ac3e8-f291-419c-aacc-f1b403fdb86c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:45.238200 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e02ac3e8-f291-419c-aacc-f1b403fdb86c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:45.238658 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e02ac3e8-f291-419c-aacc-f1b403fdb86c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:45.297235 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-e02ac3e8-f291-419c-aacc-f1b403fdb86c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:45.304945 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-e02ac3e8-f291-419c-aacc-f1b403fdb86c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.078437 Oct 29 01:45:45.305502 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 986/2140] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:45 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:46.322171 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-91d63f0b-868f-4356-ba0b-6eec1e92d1c3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:46.322769 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-91d63f0b-868f-4356-ba0b-6eec1e92d1c3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:46.329475 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-91d63f0b-868f-4356-ba0b-6eec1e92d1c3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:46.329927 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-91d63f0b-868f-4356-ba0b-6eec1e92d1c3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:46.330723 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-91d63f0b-868f-4356-ba0b-6eec1e92d1c3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:46.331196 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-91d63f0b-868f-4356-ba0b-6eec1e92d1c3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:46.392990 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-91d63f0b-868f-4356-ba0b-6eec1e92d1c3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:46.400806 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-91d63f0b-868f-4356-ba0b-6eec1e92d1c3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.082406 Oct 29 01:45:46.401446 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1155/2141] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:46 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:47.419444 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e540d998-267f-49be-9fa1-1c31afa47652 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:47.420050 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-e540d998-267f-49be-9fa1-1c31afa47652 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:47.425822 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e540d998-267f-49be-9fa1-1c31afa47652 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:47.426266 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e540d998-267f-49be-9fa1-1c31afa47652 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:47.427057 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e540d998-267f-49be-9fa1-1c31afa47652 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:47.427491 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e540d998-267f-49be-9fa1-1c31afa47652 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:47.491369 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-e540d998-267f-49be-9fa1-1c31afa47652 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:47.499139 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-e540d998-267f-49be-9fa1-1c31afa47652 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.084220 Oct 29 01:45:47.499699 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 987/2142] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:47 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:48.515847 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-156ef624-2a5a-49bd-bd7e-9e3af5120020 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:48.516457 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-156ef624-2a5a-49bd-bd7e-9e3af5120020 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:48.522832 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-156ef624-2a5a-49bd-bd7e-9e3af5120020 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:48.523288 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-156ef624-2a5a-49bd-bd7e-9e3af5120020 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:48.524053 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-156ef624-2a5a-49bd-bd7e-9e3af5120020 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:48.524491 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-156ef624-2a5a-49bd-bd7e-9e3af5120020 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:48.583359 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-156ef624-2a5a-49bd-bd7e-9e3af5120020 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:48.591184 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-156ef624-2a5a-49bd-bd7e-9e3af5120020 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.078999 Oct 29 01:45:48.591743 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1156/2143] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:48 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:49.606854 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2a4935f0-4d56-4ade-94d0-ab7398d5b725 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:49.607466 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2a4935f0-4d56-4ade-94d0-ab7398d5b725 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:49.613638 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2a4935f0-4d56-4ade-94d0-ab7398d5b725 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:49.614082 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2a4935f0-4d56-4ade-94d0-ab7398d5b725 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:49.615042 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2a4935f0-4d56-4ade-94d0-ab7398d5b725 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:49.615475 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2a4935f0-4d56-4ade-94d0-ab7398d5b725 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:49.673720 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-2a4935f0-4d56-4ade-94d0-ab7398d5b725 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:49.681327 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2a4935f0-4d56-4ade-94d0-ab7398d5b725 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.078173 Oct 29 01:45:49.681884 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 988/2144] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:49 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:50.699389 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ba785611-7dc5-49bf-a20d-50760a37e347 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:50.700000 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ba785611-7dc5-49bf-a20d-50760a37e347 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:50.706573 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ba785611-7dc5-49bf-a20d-50760a37e347 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:50.707015 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ba785611-7dc5-49bf-a20d-50760a37e347 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:50.707763 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ba785611-7dc5-49bf-a20d-50760a37e347 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:50.708191 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ba785611-7dc5-49bf-a20d-50760a37e347 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:50.768229 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-ba785611-7dc5-49bf-a20d-50760a37e347 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:50.775996 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ba785611-7dc5-49bf-a20d-50760a37e347 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.080915 Oct 29 01:45:50.776536 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1157/2145] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:50 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:51.792682 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-1e028086-6652-48e2-8b4b-c473541d96fb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:51.793316 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-1e028086-6652-48e2-8b4b-c473541d96fb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:51.799550 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1e028086-6652-48e2-8b4b-c473541d96fb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:51.799996 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1e028086-6652-48e2-8b4b-c473541d96fb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:51.800753 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1e028086-6652-48e2-8b4b-c473541d96fb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:51.801184 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1e028086-6652-48e2-8b4b-c473541d96fb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:51.860001 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-1e028086-6652-48e2-8b4b-c473541d96fb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:51.867680 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-1e028086-6652-48e2-8b4b-c473541d96fb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.078727 Oct 29 01:45:51.868242 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 989/2146] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:51 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:52.884616 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a3f89c83-c687-47b7-9ce7-5d13a3eda81a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:52.885218 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a3f89c83-c687-47b7-9ce7-5d13a3eda81a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:52.891457 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a3f89c83-c687-47b7-9ce7-5d13a3eda81a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:52.891905 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a3f89c83-c687-47b7-9ce7-5d13a3eda81a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:52.892654 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a3f89c83-c687-47b7-9ce7-5d13a3eda81a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:52.893088 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a3f89c83-c687-47b7-9ce7-5d13a3eda81a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:52.955482 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-a3f89c83-c687-47b7-9ce7-5d13a3eda81a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:52.963487 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a3f89c83-c687-47b7-9ce7-5d13a3eda81a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.082608 Oct 29 01:45:52.964055 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1158/2147] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:52 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:53.980857 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-23bccd72-13e7-4ac6-809d-c46a77c39393 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:53.981468 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-23bccd72-13e7-4ac6-809d-c46a77c39393 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:53.987716 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-23bccd72-13e7-4ac6-809d-c46a77c39393 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:53.988163 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-23bccd72-13e7-4ac6-809d-c46a77c39393 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:53.988924 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-23bccd72-13e7-4ac6-809d-c46a77c39393 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:53.989353 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-23bccd72-13e7-4ac6-809d-c46a77c39393 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:54.047648 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-23bccd72-13e7-4ac6-809d-c46a77c39393 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:54.055555 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-23bccd72-13e7-4ac6-809d-c46a77c39393 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.078495 Oct 29 01:45:54.056116 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 990/2148] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:53 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:55.072775 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f3f24d38-0f69-4038-86d8-b4d9e82bad38 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:55.073316 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f3f24d38-0f69-4038-86d8-b4d9e82bad38 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:55.080390 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f3f24d38-0f69-4038-86d8-b4d9e82bad38 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:55.080832 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f3f24d38-0f69-4038-86d8-b4d9e82bad38 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:55.081583 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f3f24d38-0f69-4038-86d8-b4d9e82bad38 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:55.082011 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f3f24d38-0f69-4038-86d8-b4d9e82bad38 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:55.142522 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-f3f24d38-0f69-4038-86d8-b4d9e82bad38 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:55.150092 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f3f24d38-0f69-4038-86d8-b4d9e82bad38 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.081036 Oct 29 01:45:55.150675 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1159/2149] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:55 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:56.167212 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-304614e3-a328-49b5-973b-2b904f81e737 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:56.167823 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-304614e3-a328-49b5-973b-2b904f81e737 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:56.174055 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-304614e3-a328-49b5-973b-2b904f81e737 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:56.174538 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-304614e3-a328-49b5-973b-2b904f81e737 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:56.175297 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-304614e3-a328-49b5-973b-2b904f81e737 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:56.175738 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-304614e3-a328-49b5-973b-2b904f81e737 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:56.235734 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-304614e3-a328-49b5-973b-2b904f81e737 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:56.243465 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-304614e3-a328-49b5-973b-2b904f81e737 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.079937 Oct 29 01:45:56.244026 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 991/2150] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:56 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:45:57.260128 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-1e325ac5-4a62-481f-b6c7-3d6dc02c35b5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:57.260737 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-1e325ac5-4a62-481f-b6c7-3d6dc02c35b5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:57.266996 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1e325ac5-4a62-481f-b6c7-3d6dc02c35b5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:57.267444 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1e325ac5-4a62-481f-b6c7-3d6dc02c35b5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:57.268198 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1e325ac5-4a62-481f-b6c7-3d6dc02c35b5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:57.268629 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1e325ac5-4a62-481f-b6c7-3d6dc02c35b5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:57.328734 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-1e325ac5-4a62-481f-b6c7-3d6dc02c35b5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:57.336374 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-1e325ac5-4a62-481f-b6c7-3d6dc02c35b5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.079915 Oct 29 01:45:57.336928 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1160/2151] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:57 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:58.353140 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-37689a48-90ce-4703-9fde-4808e871a4f3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:58.353744 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-37689a48-90ce-4703-9fde-4808e871a4f3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:58.360391 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-37689a48-90ce-4703-9fde-4808e871a4f3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:58.360831 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-37689a48-90ce-4703-9fde-4808e871a4f3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:58.361577 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-37689a48-90ce-4703-9fde-4808e871a4f3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:58.362002 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-37689a48-90ce-4703-9fde-4808e871a4f3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:58.425055 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-37689a48-90ce-4703-9fde-4808e871a4f3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:58.432957 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-37689a48-90ce-4703-9fde-4808e871a4f3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.083412 Oct 29 01:45:58.433514 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 992/2152] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:58 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:59.450426 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-fd9f502f-7741-4569-82f3-f18119360c8c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:59.451136 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-fd9f502f-7741-4569-82f3-f18119360c8c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:45:59.462274 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fd9f502f-7741-4569-82f3-f18119360c8c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:59.462927 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fd9f502f-7741-4569-82f3-f18119360c8c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:59.464302 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fd9f502f-7741-4569-82f3-f18119360c8c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:45:59.464984 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fd9f502f-7741-4569-82f3-f18119360c8c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:45:59.530735 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-fd9f502f-7741-4569-82f3-f18119360c8c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:59.538490 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-fd9f502f-7741-4569-82f3-f18119360c8c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.091820 Oct 29 01:45:59.539046 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1161/2153] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:45:59 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:00.555376 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-6272547e-f360-459f-ab3e-7e88c10cea29 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:00.555983 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-6272547e-f360-459f-ab3e-7e88c10cea29 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:00.562194 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6272547e-f360-459f-ab3e-7e88c10cea29 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:00.562673 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6272547e-f360-459f-ab3e-7e88c10cea29 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:00.563430 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6272547e-f360-459f-ab3e-7e88c10cea29 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:00.563860 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6272547e-f360-459f-ab3e-7e88c10cea29 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:00.625383 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-6272547e-f360-459f-ab3e-7e88c10cea29 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:00.633184 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-6272547e-f360-459f-ab3e-7e88c10cea29 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.081460 Oct 29 01:46:00.633744 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 993/2154] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:00 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:00.962903 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:46:00.963078 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: Fri Oct 29 01:46:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 29 01:46:01.650878 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-aecb6558-ebb5-40ab-969b-9f607653e738 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:01.651492 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-aecb6558-ebb5-40ab-969b-9f607653e738 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:01.658694 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-aecb6558-ebb5-40ab-969b-9f607653e738 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:01.659155 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-aecb6558-ebb5-40ab-969b-9f607653e738 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:01.659924 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-aecb6558-ebb5-40ab-969b-9f607653e738 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:01.660940 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-aecb6558-ebb5-40ab-969b-9f607653e738 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:01.720722 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-aecb6558-ebb5-40ab-969b-9f607653e738 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:01.728675 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-aecb6558-ebb5-40ab-969b-9f607653e738 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.081450 Oct 29 01:46:01.729361 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1162/2155] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:01 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:02.744838 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-63c895b5-cec2-47e9-a0a5-e47203bbffb5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:02.745442 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-63c895b5-cec2-47e9-a0a5-e47203bbffb5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:02.752920 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-63c895b5-cec2-47e9-a0a5-e47203bbffb5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:02.753378 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-63c895b5-cec2-47e9-a0a5-e47203bbffb5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:02.754227 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-63c895b5-cec2-47e9-a0a5-e47203bbffb5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:02.754884 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-63c895b5-cec2-47e9-a0a5-e47203bbffb5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:02.819287 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-63c895b5-cec2-47e9-a0a5-e47203bbffb5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:02.827337 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-63c895b5-cec2-47e9-a0a5-e47203bbffb5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.086293 Oct 29 01:46:02.827882 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 994/2156] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:02 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:03.149268 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:46:03.149475 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: Fri Oct 29 01:46:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 29 01:46:03.843761 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b132d4f7-8bb7-4eaf-bf48-9b0667e1c2a2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:03.844367 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b132d4f7-8bb7-4eaf-bf48-9b0667e1c2a2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:03.850782 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b132d4f7-8bb7-4eaf-bf48-9b0667e1c2a2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:03.851264 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b132d4f7-8bb7-4eaf-bf48-9b0667e1c2a2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:03.852033 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b132d4f7-8bb7-4eaf-bf48-9b0667e1c2a2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:03.852462 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b132d4f7-8bb7-4eaf-bf48-9b0667e1c2a2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:03.911742 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-b132d4f7-8bb7-4eaf-bf48-9b0667e1c2a2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:03.919417 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b132d4f7-8bb7-4eaf-bf48-9b0667e1c2a2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.079381 Oct 29 01:46:03.920544 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1163/2157] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:03 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:04.936912 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f894d3d9-9504-493c-9c02-5e7c2ce95204 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:04.937515 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f894d3d9-9504-493c-9c02-5e7c2ce95204 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:04.943787 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f894d3d9-9504-493c-9c02-5e7c2ce95204 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:04.944223 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f894d3d9-9504-493c-9c02-5e7c2ce95204 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:04.944972 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f894d3d9-9504-493c-9c02-5e7c2ce95204 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:04.945399 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f894d3d9-9504-493c-9c02-5e7c2ce95204 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:05.006938 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-f894d3d9-9504-493c-9c02-5e7c2ce95204 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:05.015278 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f894d3d9-9504-493c-9c02-5e7c2ce95204 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.082431 Oct 29 01:46:05.015759 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 995/2158] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:04 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:06.031909 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-fa61071f-e14b-42c1-9a3e-3db3454c17a9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:06.032528 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-fa61071f-e14b-42c1-9a3e-3db3454c17a9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:06.038749 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fa61071f-e14b-42c1-9a3e-3db3454c17a9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:06.039203 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fa61071f-e14b-42c1-9a3e-3db3454c17a9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:06.039967 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fa61071f-e14b-42c1-9a3e-3db3454c17a9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:06.040406 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fa61071f-e14b-42c1-9a3e-3db3454c17a9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:06.102980 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-fa61071f-e14b-42c1-9a3e-3db3454c17a9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:06.111233 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-fa61071f-e14b-42c1-9a3e-3db3454c17a9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.083086 Oct 29 01:46:06.111801 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1164/2159] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:06 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:07.128030 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-987eb77f-1bd5-455a-888c-a7856efbe8a0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:07.128650 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-987eb77f-1bd5-455a-888c-a7856efbe8a0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:07.134885 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-987eb77f-1bd5-455a-888c-a7856efbe8a0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:07.135332 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-987eb77f-1bd5-455a-888c-a7856efbe8a0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:07.136092 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-987eb77f-1bd5-455a-888c-a7856efbe8a0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:07.136522 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-987eb77f-1bd5-455a-888c-a7856efbe8a0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:07.195650 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-987eb77f-1bd5-455a-888c-a7856efbe8a0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:07.203578 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-987eb77f-1bd5-455a-888c-a7856efbe8a0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.079286 Oct 29 01:46:07.204136 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 996/2160] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:07 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:08.220131 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f732fd2f-e0ea-4cb4-a327-183312052039 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:08.220974 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f732fd2f-e0ea-4cb4-a327-183312052039 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:08.227178 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f732fd2f-e0ea-4cb4-a327-183312052039 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:08.227675 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f732fd2f-e0ea-4cb4-a327-183312052039 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:08.228436 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f732fd2f-e0ea-4cb4-a327-183312052039 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:08.228864 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f732fd2f-e0ea-4cb4-a327-183312052039 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:08.289294 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-f732fd2f-e0ea-4cb4-a327-183312052039 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:08.297477 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f732fd2f-e0ea-4cb4-a327-183312052039 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.081021 Oct 29 01:46:08.298022 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1165/2161] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:08 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:09.314235 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-63f19eab-7263-4182-b455-d5450b76a3ec tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:09.314819 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-63f19eab-7263-4182-b455-d5450b76a3ec tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:09.320982 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-63f19eab-7263-4182-b455-d5450b76a3ec tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:09.321420 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-63f19eab-7263-4182-b455-d5450b76a3ec tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:09.322174 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-63f19eab-7263-4182-b455-d5450b76a3ec tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:09.322631 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-63f19eab-7263-4182-b455-d5450b76a3ec tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:09.382998 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-63f19eab-7263-4182-b455-d5450b76a3ec tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:09.391135 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-63f19eab-7263-4182-b455-d5450b76a3ec tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.080753 Oct 29 01:46:09.391688 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 997/2162] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:09 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:10.407981 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-621a68b7-67a4-4ca5-a4c9-b88ad432d883 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:10.408593 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-621a68b7-67a4-4ca5-a4c9-b88ad432d883 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:10.414804 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-621a68b7-67a4-4ca5-a4c9-b88ad432d883 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:10.415257 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-621a68b7-67a4-4ca5-a4c9-b88ad432d883 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:10.416013 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-621a68b7-67a4-4ca5-a4c9-b88ad432d883 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:10.416453 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-621a68b7-67a4-4ca5-a4c9-b88ad432d883 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:10.476204 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-621a68b7-67a4-4ca5-a4c9-b88ad432d883 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:10.484490 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-621a68b7-67a4-4ca5-a4c9-b88ad432d883 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.080651 Oct 29 01:46:10.485062 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1166/2163] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:10 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:11.501035 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-3f860fc4-831d-4497-8065-3ecdfb9095b6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:11.501625 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-3f860fc4-831d-4497-8065-3ecdfb9095b6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:11.507901 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3f860fc4-831d-4497-8065-3ecdfb9095b6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:11.508342 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3f860fc4-831d-4497-8065-3ecdfb9095b6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:11.509093 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3f860fc4-831d-4497-8065-3ecdfb9095b6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:11.509519 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3f860fc4-831d-4497-8065-3ecdfb9095b6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:11.725802 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-3f860fc4-831d-4497-8065-3ecdfb9095b6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:11.733442 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-3f860fc4-831d-4497-8065-3ecdfb9095b6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.236252 Oct 29 01:46:11.733992 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 998/2164] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:11 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:12.750102 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-999128c9-d1e4-474a-8559-f56e1b8397ac tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:12.750751 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-999128c9-d1e4-474a-8559-f56e1b8397ac tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:12.756894 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-999128c9-d1e4-474a-8559-f56e1b8397ac tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:12.757339 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-999128c9-d1e4-474a-8559-f56e1b8397ac tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:12.758081 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-999128c9-d1e4-474a-8559-f56e1b8397ac tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:12.758545 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-999128c9-d1e4-474a-8559-f56e1b8397ac tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:12.820609 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-999128c9-d1e4-474a-8559-f56e1b8397ac tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:12.829074 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-999128c9-d1e4-474a-8559-f56e1b8397ac tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.082708 Oct 29 01:46:12.829623 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1167/2165] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:12 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:13.302688 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-498f4536-b6b6-4f22-8c57-395ae63aa23a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:13.303787 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-498f4536-b6b6-4f22-8c57-395ae63aa23a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:13.311326 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-498f4536-b6b6-4f22-8c57-395ae63aa23a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:13.311778 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-498f4536-b6b6-4f22-8c57-395ae63aa23a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:13.312565 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-498f4536-b6b6-4f22-8c57-395ae63aa23a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:13.312983 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-498f4536-b6b6-4f22-8c57-395ae63aa23a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:13.339644 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-498f4536-b6b6-4f22-8c57-395ae63aa23a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Going to try to terminate instance {{(pid=115748) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 01:46:13.339872 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b4cef857-45c3-4d2b-a2e7-fe55ef011a11 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:13.340611 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b4cef857-45c3-4d2b-a2e7-fe55ef011a11 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:13.346419 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b4cef857-45c3-4d2b-a2e7-fe55ef011a11 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:13.346889 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b4cef857-45c3-4d2b-a2e7-fe55ef011a11 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:13.347852 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b4cef857-45c3-4d2b-a2e7-fe55ef011a11 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:13.348295 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b4cef857-45c3-4d2b-a2e7-fe55ef011a11 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:13.373250 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b4cef857-45c3-4d2b-a2e7-fe55ef011a11 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Going to try to terminate instance {{(pid=115747) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 01:46:13.421118 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-498f4536-b6b6-4f22-8c57-395ae63aa23a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "DELETE /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807" status: 204 len: 0 microversion: 2.1 time: 0.121811 Oct 29 01:46:13.422090 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 999/2166] 10.222.0.90 () {58 vars in 1238 bytes} [Fri Oct 29 01:46:13 2021] DELETE /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:46:13.430901 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-9ab93ddd-5a81-4521-a009-12440b24d336 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:13.432208 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-9ab93ddd-5a81-4521-a009-12440b24d336 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:13.439561 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9ab93ddd-5a81-4521-a009-12440b24d336 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:13.440010 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9ab93ddd-5a81-4521-a009-12440b24d336 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:13.440792 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9ab93ddd-5a81-4521-a009-12440b24d336 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:13.441648 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9ab93ddd-5a81-4521-a009-12440b24d336 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:13.476115 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b4cef857-45c3-4d2b-a2e7-fe55ef011a11 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "DELETE /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 204 len: 0 microversion: 2.1 time: 0.139418 Oct 29 01:46:13.478495 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1168/2167] 10.222.0.90 () {58 vars in 1238 bytes} [Fri Oct 29 01:46:13 2021] DELETE /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 01:46:13.483702 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-fcf0e4cc-188e-42db-bdf5-57281b28a4ba tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] Calling method '.version_select at 0x7f6029b42430>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:13.504912 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-fcf0e4cc-188e-42db-bdf5-57281b28a4ba tempest-TestVolumeBootPattern-266951710 tempest-TestVolumeBootPattern-266951710-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1685738325" status: 202 len: 0 microversion: 2.1 time: 0.024883 Oct 29 01:46:13.505494 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1169/2168] 10.222.0.90 () {58 vars in 1262 bytes} [Fri Oct 29 01:46:13 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1685738325 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:46:13.511358 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-63109462-e6a0-4b9c-b4fc-2ebb01afb4ab tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:13.512099 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-63109462-e6a0-4b9c-b4fc-2ebb01afb4ab tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:13.520914 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-63109462-e6a0-4b9c-b4fc-2ebb01afb4ab tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:13.521522 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-63109462-e6a0-4b9c-b4fc-2ebb01afb4ab tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:13.522139 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-63109462-e6a0-4b9c-b4fc-2ebb01afb4ab tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:13.522619 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-63109462-e6a0-4b9c-b4fc-2ebb01afb4ab tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:13.619217 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-9ab93ddd-5a81-4521-a009-12440b24d336 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2e7072a6214e9fb3b1fdc341b2d702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9478c9b68c774f5cbffc9f7b559fc86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:13.626758 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-9ab93ddd-5a81-4521-a009-12440b24d336 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "GET /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807" status: 200 len: 1676 microversion: 2.1 time: 0.200269 Oct 29 01:46:13.627323 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1000/2169] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:13 2021] GET /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807 => generated 1676 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:46:13.683736 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-63109462-e6a0-4b9c-b4fc-2ebb01afb4ab tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:13.691482 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-63109462-e6a0-4b9c-b4fc-2ebb01afb4ab tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1507 microversion: 2.1 time: 0.185046 Oct 29 01:46:13.692156 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1170/2170] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:13 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1507 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:13.845717 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c509da37-5382-4a32-a969-4f3fa10877db tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:13.846326 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c509da37-5382-4a32-a969-4f3fa10877db tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:13.852475 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c509da37-5382-4a32-a969-4f3fa10877db tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:13.852931 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c509da37-5382-4a32-a969-4f3fa10877db tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:13.853703 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c509da37-5382-4a32-a969-4f3fa10877db tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:13.854141 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c509da37-5382-4a32-a969-4f3fa10877db tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:13.918584 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-c509da37-5382-4a32-a969-4f3fa10877db tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:13.926896 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c509da37-5382-4a32-a969-4f3fa10877db tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.084933 Oct 29 01:46:13.927447 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1001/2171] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:13 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:14.649082 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-1c60188c-10d7-4795-8aac-5ebdf469eeba tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:14.650631 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-1c60188c-10d7-4795-8aac-5ebdf469eeba tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:14.657749 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1c60188c-10d7-4795-8aac-5ebdf469eeba tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:14.658668 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1c60188c-10d7-4795-8aac-5ebdf469eeba tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:14.659675 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1c60188c-10d7-4795-8aac-5ebdf469eeba tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:14.660411 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1c60188c-10d7-4795-8aac-5ebdf469eeba tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:14.708367 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-23656486-7c72-4bce-916b-ebd4f4c37535 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:14.709122 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-23656486-7c72-4bce-916b-ebd4f4c37535 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:14.719801 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-23656486-7c72-4bce-916b-ebd4f4c37535 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:14.720348 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-23656486-7c72-4bce-916b-ebd4f4c37535 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:14.721207 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-23656486-7c72-4bce-916b-ebd4f4c37535 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:14.723812 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-23656486-7c72-4bce-916b-ebd4f4c37535 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:14.807673 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-23656486-7c72-4bce-916b-ebd4f4c37535 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:14.816259 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-23656486-7c72-4bce-916b-ebd4f4c37535 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 200 len: 1465 microversion: 2.1 time: 0.111370 Oct 29 01:46:14.817530 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1002/2172] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:14 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 1465 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:14.913321 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-1c60188c-10d7-4795-8aac-5ebdf469eeba tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2e7072a6214e9fb3b1fdc341b2d702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9478c9b68c774f5cbffc9f7b559fc86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:14.914766 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [req-982bf51b-c98d-46ea-b070-2160744adf8e req-3a7f6177-f2c8-4ba1-8864-811b701be79f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d46f88d3-603a-4019-8233-a3a1217bb756", "name": "network-vif-deleted", "tag": "e474fbf6-067d-4c7e-9464-2262ab46d614"}]} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:14.917049 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:46:14.917049 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: warnings.warn(msg) Oct 29 01:46:14.923937 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-1c60188c-10d7-4795-8aac-5ebdf469eeba tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "GET /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807" status: 200 len: 1676 microversion: 2.1 time: 0.280131 Oct 29 01:46:14.925193 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-982bf51b-c98d-46ea-b070-2160744adf8e req-3a7f6177-f2c8-4ba1-8864-811b701be79f service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:14.925860 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-982bf51b-c98d-46ea-b070-2160744adf8e req-3a7f6177-f2c8-4ba1-8864-811b701be79f service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:14.928419 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1171/2173] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:14 2021] GET /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807 => generated 1676 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:14.937394 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.compute.server_external_events [req-982bf51b-c98d-46ea-b070-2160744adf8e req-3a7f6177-f2c8-4ba1-8864-811b701be79f service nova] Creating event network-vif-deleted:e474fbf6-067d-4c7e-9464-2262ab46d614 for instance d46f88d3-603a-4019-8233-a3a1217bb756 on hv-cinder-81558 Oct 29 01:46:14.944329 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [req-982bf51b-c98d-46ea-b070-2160744adf8e req-3a7f6177-f2c8-4ba1-8864-811b701be79f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125349 Oct 29 01:46:14.948054 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-cefed1f9-b78e-426a-8315-e97a0f5f98bb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:14.949246 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1003/2174] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:46:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:46:14.950141 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-cefed1f9-b78e-426a-8315-e97a0f5f98bb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:14.964224 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cefed1f9-b78e-426a-8315-e97a0f5f98bb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:14.964669 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cefed1f9-b78e-426a-8315-e97a0f5f98bb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:14.965442 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cefed1f9-b78e-426a-8315-e97a0f5f98bb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:14.965867 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cefed1f9-b78e-426a-8315-e97a0f5f98bb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:15.031769 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-cefed1f9-b78e-426a-8315-e97a0f5f98bb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:15.040297 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-cefed1f9-b78e-426a-8315-e97a0f5f98bb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.097767 Oct 29 01:46:15.041086 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1172/2175] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:14 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:15.834415 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-67d84495-ab3b-4939-8b2e-3343c0eb95a4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:15.835128 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-67d84495-ab3b-4939-8b2e-3343c0eb95a4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: d46f88d3-603a-4019-8233-a3a1217bb756] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:15.842037 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-67d84495-ab3b-4939-8b2e-3343c0eb95a4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:15.842516 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-67d84495-ab3b-4939-8b2e-3343c0eb95a4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:15.843486 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-67d84495-ab3b-4939-8b2e-3343c0eb95a4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:15.844096 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-67d84495-ab3b-4939-8b2e-3343c0eb95a4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:15.861562 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.wsgi [None req-67d84495-ab3b-4939-8b2e-3343c0eb95a4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] HTTP exception thrown: Instance d46f88d3-603a-4019-8233-a3a1217bb756 could not be found. Oct 29 01:46:15.862498 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-67d84495-ab3b-4939-8b2e-3343c0eb95a4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Returning 404 to user: Instance d46f88d3-603a-4019-8233-a3a1217bb756 could not be found. {{(pid=115748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:46:15.863597 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-67d84495-ab3b-4939-8b2e-3343c0eb95a4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756" status: 404 len: 111 microversion: 2.1 time: 0.033209 Oct 29 01:46:15.864186 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1004/2176] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:15 2021] GET /compute/v2.1/servers/d46f88d3-603a-4019-8233-a3a1217bb756 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:46:15.873457 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-709d5514-cbd6-43af-9420-52f5f9842528 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:15.874052 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-709d5514-cbd6-43af-9420-52f5f9842528 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:15.881057 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-709d5514-cbd6-43af-9420-52f5f9842528 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:15.881595 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-709d5514-cbd6-43af-9420-52f5f9842528 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:15.882479 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-709d5514-cbd6-43af-9420-52f5f9842528 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:15.883144 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-709d5514-cbd6-43af-9420-52f5f9842528 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:15.923493 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-709d5514-cbd6-43af-9420-52f5f9842528 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Going to try to terminate instance {{(pid=115747) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 01:46:15.949055 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2515948a-ba91-4a9d-86bd-5a62b5f399a0 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:15.949842 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2515948a-ba91-4a9d-86bd-5a62b5f399a0 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:15.960835 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2515948a-ba91-4a9d-86bd-5a62b5f399a0 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:15.961612 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2515948a-ba91-4a9d-86bd-5a62b5f399a0 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:15.962693 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2515948a-ba91-4a9d-86bd-5a62b5f399a0 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:15.964112 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2515948a-ba91-4a9d-86bd-5a62b5f399a0 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:16.048699 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-709d5514-cbd6-43af-9420-52f5f9842528 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "DELETE /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 204 len: 0 microversion: 2.1 time: 0.179196 Oct 29 01:46:16.049866 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1173/2177] 10.222.0.90 () {58 vars in 1238 bytes} [Fri Oct 29 01:46:15 2021] DELETE /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:46:16.057536 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [req-815b662c-75ac-46b8-a7c0-d6b66aede1a3 req-b9fd6c68-7677-4369-8ca8-33a68b38538c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a271df91-65af-42bb-a06e-b3d97b359807", "name": "network-vif-deleted", "tag": "cd073e79-275c-491d-8c38-18d39de4a7c2"}]} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:16.064635 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:46:16.064635 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: warnings.warn(msg) Oct 29 01:46:16.079399 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-815b662c-75ac-46b8-a7c0-d6b66aede1a3 req-b9fd6c68-7677-4369-8ca8-33a68b38538c service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:16.079830 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-815b662c-75ac-46b8-a7c0-d6b66aede1a3 req-b9fd6c68-7677-4369-8ca8-33a68b38538c service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:16.081766 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-2515948a-ba91-4a9d-86bd-5a62b5f399a0 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2e7072a6214e9fb3b1fdc341b2d702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9478c9b68c774f5cbffc9f7b559fc86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:16.091442 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2515948a-ba91-4a9d-86bd-5a62b5f399a0 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "GET /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807" status: 200 len: 1608 microversion: 2.1 time: 0.146160 Oct 29 01:46:16.094689 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1005/2178] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:15 2021] GET /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807 => generated 1608 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:46:16.096753 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.compute.server_external_events [req-815b662c-75ac-46b8-a7c0-d6b66aede1a3 req-b9fd6c68-7677-4369-8ca8-33a68b38538c service nova] Creating event network-vif-deleted:cd073e79-275c-491d-8c38-18d39de4a7c2 for instance a271df91-65af-42bb-a06e-b3d97b359807 on hv-cinder-81558 Oct 29 01:46:16.101167 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-02ce459c-4b09-4e39-9cc0-4b181a04b7e9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:16.102276 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [req-815b662c-75ac-46b8-a7c0-d6b66aede1a3 req-b9fd6c68-7677-4369-8ca8-33a68b38538c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048806 Oct 29 01:46:16.102720 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-02ce459c-4b09-4e39-9cc0-4b181a04b7e9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:16.103447 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1174/2179] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:46:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:46:16.109779 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-02ce459c-4b09-4e39-9cc0-4b181a04b7e9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:16.110492 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-02ce459c-4b09-4e39-9cc0-4b181a04b7e9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:16.111882 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-02ce459c-4b09-4e39-9cc0-4b181a04b7e9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:16.112418 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-02ce459c-4b09-4e39-9cc0-4b181a04b7e9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:16.114099 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-8b61be5d-2eeb-4bab-b892-294dbddcb03b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:16.114994 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-8b61be5d-2eeb-4bab-b892-294dbddcb03b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:16.123847 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8b61be5d-2eeb-4bab-b892-294dbddcb03b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:16.124530 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8b61be5d-2eeb-4bab-b892-294dbddcb03b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:16.125491 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8b61be5d-2eeb-4bab-b892-294dbddcb03b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:16.126099 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8b61be5d-2eeb-4bab-b892-294dbddcb03b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:16.187268 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-02ce459c-4b09-4e39-9cc0-4b181a04b7e9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:16.197757 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-02ce459c-4b09-4e39-9cc0-4b181a04b7e9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.101299 Oct 29 01:46:16.198767 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1006/2180] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:16 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:16.319620 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-8b61be5d-2eeb-4bab-b892-294dbddcb03b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:16.336372 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-8b61be5d-2eeb-4bab-b892-294dbddcb03b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1568 microversion: 2.1 time: 0.230829 Oct 29 01:46:16.346553 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1175/2181] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:16 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1568 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:17.117903 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-a55a704a-d543-478d-a2ea-1bf797462f16 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:17.118617 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-a55a704a-d543-478d-a2ea-1bf797462f16 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:17.125229 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a55a704a-d543-478d-a2ea-1bf797462f16 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:17.125792 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a55a704a-d543-478d-a2ea-1bf797462f16 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:17.126907 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a55a704a-d543-478d-a2ea-1bf797462f16 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:17.127663 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a55a704a-d543-478d-a2ea-1bf797462f16 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:17.143076 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.wsgi [None req-a55a704a-d543-478d-a2ea-1bf797462f16 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] HTTP exception thrown: Instance a271df91-65af-42bb-a06e-b3d97b359807 could not be found. Oct 29 01:46:17.144400 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-a55a704a-d543-478d-a2ea-1bf797462f16 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Returning 404 to user: Instance a271df91-65af-42bb-a06e-b3d97b359807 could not be found. {{(pid=115748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:46:17.145210 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-a55a704a-d543-478d-a2ea-1bf797462f16 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "GET /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807" status: 404 len: 111 microversion: 2.1 time: 0.030965 Oct 29 01:46:17.145774 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1007/2182] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:17 2021] GET /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:46:17.155787 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c1d90329-3831-4945-92b3-c96897c33d2a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Calling method '.version_select at 0x7f60292fd310>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:17.178892 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c1d90329-3831-4945-92b3-c96897c33d2a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2049351198" status: 202 len: 0 microversion: 2.1 time: 0.028324 Oct 29 01:46:17.179909 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1176/2183] 10.222.0.90 () {58 vars in 1220 bytes} [Fri Oct 29 01:46:17 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2049351198 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:46:17.215045 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-dd96bd57-bf8c-46b3-a37e-8ad9cdfc7665 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:17.216607 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-dd96bd57-bf8c-46b3-a37e-8ad9cdfc7665 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:17.225410 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dd96bd57-bf8c-46b3-a37e-8ad9cdfc7665 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:17.227318 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dd96bd57-bf8c-46b3-a37e-8ad9cdfc7665 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:17.228420 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dd96bd57-bf8c-46b3-a37e-8ad9cdfc7665 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:17.228994 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dd96bd57-bf8c-46b3-a37e-8ad9cdfc7665 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:17.376346 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-dd96bd57-bf8c-46b3-a37e-8ad9cdfc7665 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:17.389282 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-dd96bd57-bf8c-46b3-a37e-8ad9cdfc7665 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.177997 Oct 29 01:46:17.390855 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1008/2184] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:17 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:17.396391 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2a1c11c1-cf92-4c1a-a88b-6faa9b246e14 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:17.397395 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2a1c11c1-cf92-4c1a-a88b-6faa9b246e14 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:17.407377 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2a1c11c1-cf92-4c1a-a88b-6faa9b246e14 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:17.408235 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2a1c11c1-cf92-4c1a-a88b-6faa9b246e14 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:17.410431 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2a1c11c1-cf92-4c1a-a88b-6faa9b246e14 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:17.411306 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2a1c11c1-cf92-4c1a-a88b-6faa9b246e14 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:17.453398 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [req-4b60f9cf-b8ba-4c28-99ba-711ed44c7f06 req-7d69a1f2-66c2-4610-ac1f-d2d426b947bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ff6277c-b59e-467c-82d4-631046fb03d9", "name": "network-vif-unplugged", "status": "completed", "tag": "087af4cc-fcd8-4ae5-a1ad-de9edef4df73"}]} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:17.454992 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:46:17.454992 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: warnings.warn(msg) Oct 29 01:46:17.470827 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-4b60f9cf-b8ba-4c28-99ba-711ed44c7f06 req-7d69a1f2-66c2-4610-ac1f-d2d426b947bb service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:17.482296 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-4b60f9cf-b8ba-4c28-99ba-711ed44c7f06 req-7d69a1f2-66c2-4610-ac1f-d2d426b947bb service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:17.522045 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.compute.server_external_events [req-4b60f9cf-b8ba-4c28-99ba-711ed44c7f06 req-7d69a1f2-66c2-4610-ac1f-d2d426b947bb service nova] Creating event network-vif-unplugged:087af4cc-fcd8-4ae5-a1ad-de9edef4df73 for instance 0ff6277c-b59e-467c-82d4-631046fb03d9 on hv-cinder-81558 Oct 29 01:46:17.527547 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [req-4b60f9cf-b8ba-4c28-99ba-711ed44c7f06 req-7d69a1f2-66c2-4610-ac1f-d2d426b947bb service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.209545 Oct 29 01:46:17.528301 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1177/2185] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:46:17 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:46:17.657461 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-2a1c11c1-cf92-4c1a-a88b-6faa9b246e14 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:17.667239 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2a1c11c1-cf92-4c1a-a88b-6faa9b246e14 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1568 microversion: 2.1 time: 0.275041 Oct 29 01:46:17.678381 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1009/2186] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:17 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1568 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:18.226814 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [req-00932e4f-3d0d-4ab7-aeb7-128e8cbfd64d req-63277dbf-c2f3-470a-91db-9c8320779c44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ff6277c-b59e-467c-82d4-631046fb03d9", "name": "network-vif-deleted", "tag": "087af4cc-fcd8-4ae5-a1ad-de9edef4df73"}]} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:18.229175 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:46:18.229175 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: warnings.warn(msg) Oct 29 01:46:18.252943 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-00932e4f-3d0d-4ab7-aeb7-128e8cbfd64d req-63277dbf-c2f3-470a-91db-9c8320779c44 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:18.254954 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-00932e4f-3d0d-4ab7-aeb7-128e8cbfd64d req-63277dbf-c2f3-470a-91db-9c8320779c44 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:18.280623 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.compute.server_external_events [req-00932e4f-3d0d-4ab7-aeb7-128e8cbfd64d req-63277dbf-c2f3-470a-91db-9c8320779c44 service nova] Creating event network-vif-deleted:087af4cc-fcd8-4ae5-a1ad-de9edef4df73 for instance 0ff6277c-b59e-467c-82d4-631046fb03d9 on hv-cinder-81558 Oct 29 01:46:18.287206 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [req-00932e4f-3d0d-4ab7-aeb7-128e8cbfd64d req-63277dbf-c2f3-470a-91db-9c8320779c44 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073272 Oct 29 01:46:18.289719 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1178/2187] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:46:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:46:18.407367 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-7c107f1a-6ffc-4dbc-b527-e8d33a6ba3f4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:18.408898 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-7c107f1a-6ffc-4dbc-b527-e8d33a6ba3f4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:18.414824 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7c107f1a-6ffc-4dbc-b527-e8d33a6ba3f4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:18.415275 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7c107f1a-6ffc-4dbc-b527-e8d33a6ba3f4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:18.416045 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7c107f1a-6ffc-4dbc-b527-e8d33a6ba3f4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:18.416478 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7c107f1a-6ffc-4dbc-b527-e8d33a6ba3f4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:18.491056 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-7c107f1a-6ffc-4dbc-b527-e8d33a6ba3f4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:18.498958 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-7c107f1a-6ffc-4dbc-b527-e8d33a6ba3f4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.096004 Oct 29 01:46:18.499619 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1010/2188] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:18 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:46:18.672548 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-546ac739-07a9-434f-9c01-04d9d250becc tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'create', calling method: .version_select at 0x7f6029b14670>, body: {"keypair": {"name": "tempest-keypair-203162948"}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:18.688382 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-acff78f6-d015-410b-aacd-46e861f02c55 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:18.689028 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-acff78f6-d015-410b-aacd-46e861f02c55 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:18.690611 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.quota [None req-546ac739-07a9-434f-9c01-04d9d250becc tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Getting quotas for project 9478c9b68c774f5cbffc9f7b559fc86e. Resources: {'key_pairs'} {{(pid=115747) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:46:18.694667 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.quota [None req-546ac739-07a9-434f-9c01-04d9d250becc tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Getting quotas for user aa2e7072a6214e9fb3b1fdc341b2d702 and project 9478c9b68c774f5cbffc9f7b559fc86e. Resources: {'key_pairs'} {{(pid=115747) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:46:18.694818 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-acff78f6-d015-410b-aacd-46e861f02c55 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:18.695171 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-acff78f6-d015-410b-aacd-46e861f02c55 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:18.695939 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-acff78f6-d015-410b-aacd-46e861f02c55 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:18.696378 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-acff78f6-d015-410b-aacd-46e861f02c55 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:18.781326 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-acff78f6-d015-410b-aacd-46e861f02c55 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:18.791000 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-acff78f6-d015-410b-aacd-46e861f02c55 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.106600 Oct 29 01:46:18.800685 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1011/2189] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:18 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:19.006369 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.quota [None req-546ac739-07a9-434f-9c01-04d9d250becc tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Getting quotas for project 9478c9b68c774f5cbffc9f7b559fc86e. Resources: {'key_pairs'} {{(pid=115747) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:46:19.009915 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.quota [None req-546ac739-07a9-434f-9c01-04d9d250becc tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Getting quotas for user aa2e7072a6214e9fb3b1fdc341b2d702 and project 9478c9b68c774f5cbffc9f7b559fc86e. Resources: {'key_pairs'} {{(pid=115747) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:46:19.024825 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-546ac739-07a9-434f-9c01-04d9d250becc tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.356843 Oct 29 01:46:19.025535 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1179/2190] 10.222.0.90 () {60 vars in 1157 bytes} [Fri Oct 29 01:46:18 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:19.517779 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f29f5f10-bab1-419e-8efd-22279c8e07da tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:19.518510 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f29f5f10-bab1-419e-8efd-22279c8e07da tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:19.525937 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f29f5f10-bab1-419e-8efd-22279c8e07da tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:19.526405 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f29f5f10-bab1-419e-8efd-22279c8e07da tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:19.527183 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f29f5f10-bab1-419e-8efd-22279c8e07da tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:19.527643 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f29f5f10-bab1-419e-8efd-22279c8e07da tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:19.621657 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-f29f5f10-bab1-419e-8efd-22279c8e07da tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:19.629924 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f29f5f10-bab1-419e-8efd-22279c8e07da tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.117193 Oct 29 01:46:19.630792 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1012/2191] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:19 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:19.807463 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-81a41aa4-2506-4f2a-b462-e3b5bacbfd8b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:19.808081 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-81a41aa4-2506-4f2a-b462-e3b5bacbfd8b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:19.815173 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-81a41aa4-2506-4f2a-b462-e3b5bacbfd8b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:19.815616 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-81a41aa4-2506-4f2a-b462-e3b5bacbfd8b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:19.816579 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-81a41aa4-2506-4f2a-b462-e3b5bacbfd8b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:19.817013 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-81a41aa4-2506-4f2a-b462-e3b5bacbfd8b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:19.894608 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-81a41aa4-2506-4f2a-b462-e3b5bacbfd8b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:19.902572 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-81a41aa4-2506-4f2a-b462-e3b5bacbfd8b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.098910 Oct 29 01:46:19.903065 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1180/2192] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:19 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:20.477175 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2f12f61d-f9de-4502-84da-2bab9cbe6857 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1535783632", "imageRef": "3fef3f0d-d772-4999-b764-d6690634a06d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1372eaaf-0ff8-4c92-af45-6a6e8a255eb4"}], "security_groups": [{"name": "tempest-securitygroup--466746277"}], "key_name": "tempest-keypair-203162948", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:20.587808 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.network.neutron [None req-2f12f61d-f9de-4502-84da-2bab9cbe6857 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] validate_networks() for [('1372eaaf-0ff8-4c92-af45-6a6e8a255eb4', None, None, None, None, None)] {{(pid=115748) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 01:46:20.647332 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-e0330136-a3fb-4c37-8b35-6c232b9458bb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:20.648531 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-e0330136-a3fb-4c37-8b35-6c232b9458bb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:20.655363 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e0330136-a3fb-4c37-8b35-6c232b9458bb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:20.656097 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e0330136-a3fb-4c37-8b35-6c232b9458bb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:20.656941 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e0330136-a3fb-4c37-8b35-6c232b9458bb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:20.657386 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e0330136-a3fb-4c37-8b35-6c232b9458bb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:20.747650 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-e0330136-a3fb-4c37-8b35-6c232b9458bb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:20.756183 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-e0330136-a3fb-4c37-8b35-6c232b9458bb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.112648 Oct 29 01:46:20.756768 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1181/2193] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:20 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:46:20.919530 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-cf446c08-165a-4c02-ba16-fff6852cdf58 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:20.920188 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-cf446c08-165a-4c02-ba16-fff6852cdf58 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:20.935847 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cf446c08-165a-4c02-ba16-fff6852cdf58 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:20.936297 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cf446c08-165a-4c02-ba16-fff6852cdf58 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:20.937094 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cf446c08-165a-4c02-ba16-fff6852cdf58 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:20.937532 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cf446c08-165a-4c02-ba16-fff6852cdf58 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:21.053475 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-cf446c08-165a-4c02-ba16-fff6852cdf58 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:21.064549 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-cf446c08-165a-4c02-ba16-fff6852cdf58 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.148627 Oct 29 01:46:21.065553 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1182/2194] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:20 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:46:21.169469 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.virt.hardware [None req-2f12f61d-f9de-4502-84da-2bab9cbe6857 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Flavor limits 0:0:0 {{(pid=115748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:46:21.169969 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.virt.hardware [None req-2f12f61d-f9de-4502-84da-2bab9cbe6857 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Image limits 0:0:0 {{(pid=115748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:46:21.170558 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.virt.hardware [None req-2f12f61d-f9de-4502-84da-2bab9cbe6857 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Flavor pref 0:0:0 {{(pid=115748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:46:21.171048 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.virt.hardware [None req-2f12f61d-f9de-4502-84da-2bab9cbe6857 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Image pref 0:0:0 {{(pid=115748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:46:21.171549 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.virt.hardware [None req-2f12f61d-f9de-4502-84da-2bab9cbe6857 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:46:21.180420 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2f12f61d-f9de-4502-84da-2bab9cbe6857 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:21.180872 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2f12f61d-f9de-4502-84da-2bab9cbe6857 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:21.181686 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2f12f61d-f9de-4502-84da-2bab9cbe6857 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:21.182207 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2f12f61d-f9de-4502-84da-2bab9cbe6857 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:21.199147 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.quota [None req-2f12f61d-f9de-4502-84da-2bab9cbe6857 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Getting quotas for project 9478c9b68c774f5cbffc9f7b559fc86e. Resources: {'instances', 'cores', 'ram'} {{(pid=115748) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:46:21.203301 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.quota [None req-2f12f61d-f9de-4502-84da-2bab9cbe6857 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Getting quotas for user aa2e7072a6214e9fb3b1fdc341b2d702 and project 9478c9b68c774f5cbffc9f7b559fc86e. Resources: {'instances', 'cores', 'ram'} {{(pid=115748) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:46:21.213863 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2f12f61d-f9de-4502-84da-2bab9cbe6857 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Going to run 1 instances... {{(pid=115748) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 01:46:21.216238 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2f12f61d-f9de-4502-84da-2bab9cbe6857 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3fef3f0d-d772-4999-b764-d6690634a06d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 01:46:21.264051 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2f12f61d-f9de-4502-84da-2bab9cbe6857 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.790796 Oct 29 01:46:21.264865 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1013/2195] 10.222.0.90 () {60 vars in 1146 bytes} [Fri Oct 29 01:46:20 2021] POST /compute/v2.1/servers => generated 401 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:46:21.274417 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c02f0304-347c-4394-b43e-abe3594422a9 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:21.275073 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c02f0304-347c-4394-b43e-abe3594422a9 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:21.333019 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c02f0304-347c-4394-b43e-abe3594422a9 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2e7072a6214e9fb3b1fdc341b2d702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9478c9b68c774f5cbffc9f7b559fc86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:21.345003 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c02f0304-347c-4394-b43e-abe3594422a9 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "GET /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019" status: 200 len: 1237 microversion: 2.1 time: 0.074107 Oct 29 01:46:21.346164 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1183/2196] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:21 2021] GET /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019 => generated 1237 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:21.773456 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-8ebd6af6-edeb-4910-9791-978e4e204def tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:21.774080 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-8ebd6af6-edeb-4910-9791-978e4e204def tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:21.786975 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8ebd6af6-edeb-4910-9791-978e4e204def tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:21.789090 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8ebd6af6-edeb-4910-9791-978e4e204def tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:21.791478 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8ebd6af6-edeb-4910-9791-978e4e204def tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:21.792492 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8ebd6af6-edeb-4910-9791-978e4e204def tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:21.907920 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-8ebd6af6-edeb-4910-9791-978e4e204def tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:21.918184 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-8ebd6af6-edeb-4910-9791-978e4e204def tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.148642 Oct 29 01:46:21.920174 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1014/2197] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:21 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:22.092199 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-544cd7ee-401e-4bfd-baf6-47694b5ed5b5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:22.093522 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-544cd7ee-401e-4bfd-baf6-47694b5ed5b5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:22.101627 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-544cd7ee-401e-4bfd-baf6-47694b5ed5b5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:22.102264 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-544cd7ee-401e-4bfd-baf6-47694b5ed5b5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:22.107961 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-544cd7ee-401e-4bfd-baf6-47694b5ed5b5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:22.108469 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-544cd7ee-401e-4bfd-baf6-47694b5ed5b5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:22.189208 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-544cd7ee-401e-4bfd-baf6-47694b5ed5b5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:22.197103 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-544cd7ee-401e-4bfd-baf6-47694b5ed5b5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.113335 Oct 29 01:46:22.197989 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1184/2198] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:22 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:22.361486 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-11fece34-3ab1-4f87-8493-e980a2a1052e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:22.362108 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-11fece34-3ab1-4f87-8493-e980a2a1052e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:22.372035 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-11fece34-3ab1-4f87-8493-e980a2a1052e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:22.372758 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-11fece34-3ab1-4f87-8493-e980a2a1052e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:22.373803 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-11fece34-3ab1-4f87-8493-e980a2a1052e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:22.374241 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-11fece34-3ab1-4f87-8493-e980a2a1052e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:22.447639 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-11fece34-3ab1-4f87-8493-e980a2a1052e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2e7072a6214e9fb3b1fdc341b2d702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9478c9b68c774f5cbffc9f7b559fc86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:22.457057 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-11fece34-3ab1-4f87-8493-e980a2a1052e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "GET /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019" status: 200 len: 1289 microversion: 2.1 time: 0.098954 Oct 29 01:46:22.466753 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1015/2199] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:22 2021] GET /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019 => generated 1289 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:22.936406 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b60d400b-cb00-4c69-a404-b18d79c2a042 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:22.937112 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b60d400b-cb00-4c69-a404-b18d79c2a042 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:22.943058 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b60d400b-cb00-4c69-a404-b18d79c2a042 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:22.943510 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b60d400b-cb00-4c69-a404-b18d79c2a042 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:22.944280 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b60d400b-cb00-4c69-a404-b18d79c2a042 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:22.944714 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b60d400b-cb00-4c69-a404-b18d79c2a042 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:23.004742 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-b60d400b-cb00-4c69-a404-b18d79c2a042 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:23.013433 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b60d400b-cb00-4c69-a404-b18d79c2a042 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.080781 Oct 29 01:46:23.014705 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1185/2200] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:22 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:23.214970 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-b9cafcca-45d7-4828-8d3f-4b140cd3b57f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:23.215904 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-b9cafcca-45d7-4828-8d3f-4b140cd3b57f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:23.223211 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b9cafcca-45d7-4828-8d3f-4b140cd3b57f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:23.223662 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b9cafcca-45d7-4828-8d3f-4b140cd3b57f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:23.224677 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b9cafcca-45d7-4828-8d3f-4b140cd3b57f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:23.225354 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b9cafcca-45d7-4828-8d3f-4b140cd3b57f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:23.304630 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-b9cafcca-45d7-4828-8d3f-4b140cd3b57f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:23.314165 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-b9cafcca-45d7-4828-8d3f-4b140cd3b57f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.103816 Oct 29 01:46:23.315677 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1016/2201] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:23 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:23.475162 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-fd0333b9-30a3-4543-92c3-e17fa3d5e285 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:23.476475 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-fd0333b9-30a3-4543-92c3-e17fa3d5e285 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:23.483673 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fd0333b9-30a3-4543-92c3-e17fa3d5e285 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:23.484226 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fd0333b9-30a3-4543-92c3-e17fa3d5e285 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:23.485609 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fd0333b9-30a3-4543-92c3-e17fa3d5e285 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:23.486111 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fd0333b9-30a3-4543-92c3-e17fa3d5e285 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:23.866693 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-fd0333b9-30a3-4543-92c3-e17fa3d5e285 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2e7072a6214e9fb3b1fdc341b2d702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9478c9b68c774f5cbffc9f7b559fc86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:23.874085 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-fd0333b9-30a3-4543-92c3-e17fa3d5e285 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "GET /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019" status: 200 len: 1362 microversion: 2.1 time: 0.402883 Oct 29 01:46:23.874684 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1186/2202] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:23 2021] GET /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019 => generated 1362 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:24.031828 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-fc57a897-4225-4108-a636-a41f2d406a61 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:24.032538 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-fc57a897-4225-4108-a636-a41f2d406a61 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:24.038791 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fc57a897-4225-4108-a636-a41f2d406a61 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:24.039334 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fc57a897-4225-4108-a636-a41f2d406a61 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:24.040395 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fc57a897-4225-4108-a636-a41f2d406a61 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:24.040898 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fc57a897-4225-4108-a636-a41f2d406a61 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:24.090328 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [req-229a8648-82c6-462a-a0c8-dddbdc71c76b req-e746f019-fa5e-486d-a16b-da7dd0ddee33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0014609-7d4d-4959-a30a-1f7001aa2019", "tag": "82e879d7-87f5-437f-9a71-954eb07957ab"}]} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:24.097266 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:46:24.097266 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: warnings.warn(msg) Oct 29 01:46:24.113793 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-fc57a897-4225-4108-a636-a41f2d406a61 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:24.113980 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-229a8648-82c6-462a-a0c8-dddbdc71c76b req-e746f019-fa5e-486d-a16b-da7dd0ddee33 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:24.114240 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-229a8648-82c6-462a-a0c8-dddbdc71c76b req-e746f019-fa5e-486d-a16b-da7dd0ddee33 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:24.124190 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-fc57a897-4225-4108-a636-a41f2d406a61 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.096621 Oct 29 01:46:24.125117 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1017/2203] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:24 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:46:24.127332 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.compute.server_external_events [req-229a8648-82c6-462a-a0c8-dddbdc71c76b req-e746f019-fa5e-486d-a16b-da7dd0ddee33 service nova] Creating event network-changed:82e879d7-87f5-437f-9a71-954eb07957ab for instance d0014609-7d4d-4959-a30a-1f7001aa2019 on hv-cinder-81558 Oct 29 01:46:24.132798 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [req-229a8648-82c6-462a-a0c8-dddbdc71c76b req-e746f019-fa5e-486d-a16b-da7dd0ddee33 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054461 Oct 29 01:46:24.133600 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1187/2204] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:46:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:46:24.332954 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-21f9eb92-7035-4d8d-82ad-d4bd0aac495c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:24.334225 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-21f9eb92-7035-4d8d-82ad-d4bd0aac495c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:24.340456 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-21f9eb92-7035-4d8d-82ad-d4bd0aac495c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:24.340902 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-21f9eb92-7035-4d8d-82ad-d4bd0aac495c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:24.341673 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-21f9eb92-7035-4d8d-82ad-d4bd0aac495c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:24.342105 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-21f9eb92-7035-4d8d-82ad-d4bd0aac495c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:24.402691 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-21f9eb92-7035-4d8d-82ad-d4bd0aac495c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:24.411724 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-21f9eb92-7035-4d8d-82ad-d4bd0aac495c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.082111 Oct 29 01:46:24.412197 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1018/2205] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:24 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:24.891300 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-7a55ddbb-b003-4b6b-9397-2bbc2457d3d2 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:24.891996 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-7a55ddbb-b003-4b6b-9397-2bbc2457d3d2 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:24.898310 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7a55ddbb-b003-4b6b-9397-2bbc2457d3d2 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:24.898791 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7a55ddbb-b003-4b6b-9397-2bbc2457d3d2 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:24.899547 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7a55ddbb-b003-4b6b-9397-2bbc2457d3d2 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:24.899974 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7a55ddbb-b003-4b6b-9397-2bbc2457d3d2 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:25.025164 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-7a55ddbb-b003-4b6b-9397-2bbc2457d3d2 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2e7072a6214e9fb3b1fdc341b2d702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9478c9b68c774f5cbffc9f7b559fc86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:25.033204 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-7a55ddbb-b003-4b6b-9397-2bbc2457d3d2 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "GET /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019" status: 200 len: 1362 microversion: 2.1 time: 0.146430 Oct 29 01:46:25.033803 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1188/2206] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:24 2021] GET /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:25.141956 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-bfa251f2-0952-4a67-835e-8655f8ca8acd tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:25.142594 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-bfa251f2-0952-4a67-835e-8655f8ca8acd tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:25.148322 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bfa251f2-0952-4a67-835e-8655f8ca8acd tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:25.148767 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bfa251f2-0952-4a67-835e-8655f8ca8acd tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:25.149531 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bfa251f2-0952-4a67-835e-8655f8ca8acd tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:25.149963 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bfa251f2-0952-4a67-835e-8655f8ca8acd tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:25.208783 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-bfa251f2-0952-4a67-835e-8655f8ca8acd tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:25.216527 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-bfa251f2-0952-4a67-835e-8655f8ca8acd tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.078881 Oct 29 01:46:25.217057 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1019/2207] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:25 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:25.428495 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-5a216efb-073e-459d-8a22-06f9e9059f10 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:25.429103 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-5a216efb-073e-459d-8a22-06f9e9059f10 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:25.434996 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5a216efb-073e-459d-8a22-06f9e9059f10 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:25.435440 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5a216efb-073e-459d-8a22-06f9e9059f10 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:25.436755 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5a216efb-073e-459d-8a22-06f9e9059f10 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:25.437189 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5a216efb-073e-459d-8a22-06f9e9059f10 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:25.494658 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-5a216efb-073e-459d-8a22-06f9e9059f10 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:25.502739 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-5a216efb-073e-459d-8a22-06f9e9059f10 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.077851 Oct 29 01:46:25.503372 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1189/2208] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:25 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:26.050173 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f4d59db4-a023-4640-8601-d20a12f73949 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:26.050803 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f4d59db4-a023-4640-8601-d20a12f73949 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:26.057010 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f4d59db4-a023-4640-8601-d20a12f73949 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:26.057456 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f4d59db4-a023-4640-8601-d20a12f73949 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:26.058211 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f4d59db4-a023-4640-8601-d20a12f73949 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:26.058670 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f4d59db4-a023-4640-8601-d20a12f73949 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:26.178718 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-f4d59db4-a023-4640-8601-d20a12f73949 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2e7072a6214e9fb3b1fdc341b2d702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9478c9b68c774f5cbffc9f7b559fc86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:26.185819 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f4d59db4-a023-4640-8601-d20a12f73949 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "GET /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019" status: 200 len: 1362 microversion: 2.1 time: 0.139324 Oct 29 01:46:26.186375 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1020/2209] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:26 2021] GET /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019 => generated 1362 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:26.233365 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-3cff65b6-91b5-490e-be7e-0d200ccdf9eb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:26.234011 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-3cff65b6-91b5-490e-be7e-0d200ccdf9eb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:26.240202 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3cff65b6-91b5-490e-be7e-0d200ccdf9eb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:26.240658 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3cff65b6-91b5-490e-be7e-0d200ccdf9eb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:26.241432 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3cff65b6-91b5-490e-be7e-0d200ccdf9eb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:26.241872 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3cff65b6-91b5-490e-be7e-0d200ccdf9eb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:26.300230 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-3cff65b6-91b5-490e-be7e-0d200ccdf9eb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:26.307810 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-3cff65b6-91b5-490e-be7e-0d200ccdf9eb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.078765 Oct 29 01:46:26.308369 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1190/2210] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:26 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:26.519261 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-a5fa67c7-a235-4c7f-b9c2-74b2c919dbc3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:26.519802 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-a5fa67c7-a235-4c7f-b9c2-74b2c919dbc3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:26.525789 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a5fa67c7-a235-4c7f-b9c2-74b2c919dbc3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:26.526239 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a5fa67c7-a235-4c7f-b9c2-74b2c919dbc3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:26.527030 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a5fa67c7-a235-4c7f-b9c2-74b2c919dbc3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:26.527466 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a5fa67c7-a235-4c7f-b9c2-74b2c919dbc3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:26.587509 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-a5fa67c7-a235-4c7f-b9c2-74b2c919dbc3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:26.596015 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-a5fa67c7-a235-4c7f-b9c2-74b2c919dbc3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.080669 Oct 29 01:46:26.596566 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1021/2211] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:26 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:27.202674 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-4e3758e6-e9e7-4d6a-b555-a470f6034db5 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:27.203289 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-4e3758e6-e9e7-4d6a-b555-a470f6034db5 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:27.209014 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4e3758e6-e9e7-4d6a-b555-a470f6034db5 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:27.209460 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4e3758e6-e9e7-4d6a-b555-a470f6034db5 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:27.210228 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4e3758e6-e9e7-4d6a-b555-a470f6034db5 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:27.210688 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4e3758e6-e9e7-4d6a-b555-a470f6034db5 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:27.324617 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-a9c20e73-2403-4548-9390-a423bbd92b54 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:27.325366 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-a9c20e73-2403-4548-9390-a423bbd92b54 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:27.330818 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-4e3758e6-e9e7-4d6a-b555-a470f6034db5 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2e7072a6214e9fb3b1fdc341b2d702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9478c9b68c774f5cbffc9f7b559fc86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:27.332190 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a9c20e73-2403-4548-9390-a423bbd92b54 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:27.332745 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a9c20e73-2403-4548-9390-a423bbd92b54 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:27.333566 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a9c20e73-2403-4548-9390-a423bbd92b54 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:27.334053 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a9c20e73-2403-4548-9390-a423bbd92b54 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:27.338143 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-4e3758e6-e9e7-4d6a-b555-a470f6034db5 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "GET /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019" status: 200 len: 1362 microversion: 2.1 time: 0.139478 Oct 29 01:46:27.338750 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1191/2212] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:27 2021] GET /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019 => generated 1362 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:27.394832 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-a9c20e73-2403-4548-9390-a423bbd92b54 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:27.402679 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-a9c20e73-2403-4548-9390-a423bbd92b54 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.081676 Oct 29 01:46:27.403241 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1022/2213] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:27 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:46:27.613224 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-0235743b-5322-49af-a699-3a27d03c4974 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:27.614020 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-0235743b-5322-49af-a699-3a27d03c4974 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:27.620083 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0235743b-5322-49af-a699-3a27d03c4974 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:27.620538 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0235743b-5322-49af-a699-3a27d03c4974 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:27.621312 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0235743b-5322-49af-a699-3a27d03c4974 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:27.621746 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0235743b-5322-49af-a699-3a27d03c4974 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:27.683236 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-0235743b-5322-49af-a699-3a27d03c4974 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:27.690927 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-0235743b-5322-49af-a699-3a27d03c4974 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.081452 Oct 29 01:46:27.691481 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1192/2214] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:27 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:28.354594 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-6b623a38-dae1-4ad9-8b74-7cc8fb938183 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:28.355187 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-6b623a38-dae1-4ad9-8b74-7cc8fb938183 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:28.361490 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6b623a38-dae1-4ad9-8b74-7cc8fb938183 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:28.361941 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6b623a38-dae1-4ad9-8b74-7cc8fb938183 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:28.362728 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6b623a38-dae1-4ad9-8b74-7cc8fb938183 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:28.363162 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6b623a38-dae1-4ad9-8b74-7cc8fb938183 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:28.419946 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d8a248da-aa6f-4dd3-85ac-fb9dec9a976d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:28.420679 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d8a248da-aa6f-4dd3-85ac-fb9dec9a976d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:28.426912 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d8a248da-aa6f-4dd3-85ac-fb9dec9a976d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:28.427358 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d8a248da-aa6f-4dd3-85ac-fb9dec9a976d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:28.428117 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d8a248da-aa6f-4dd3-85ac-fb9dec9a976d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:28.428543 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d8a248da-aa6f-4dd3-85ac-fb9dec9a976d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:28.495007 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-d8a248da-aa6f-4dd3-85ac-fb9dec9a976d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:28.503275 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d8a248da-aa6f-4dd3-85ac-fb9dec9a976d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.086884 Oct 29 01:46:28.503841 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1193/2215] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:28 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:46:28.507910 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-6b623a38-dae1-4ad9-8b74-7cc8fb938183 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2e7072a6214e9fb3b1fdc341b2d702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9478c9b68c774f5cbffc9f7b559fc86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:28.515849 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-6b623a38-dae1-4ad9-8b74-7cc8fb938183 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "GET /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019" status: 200 len: 1362 microversion: 2.1 time: 0.164942 Oct 29 01:46:28.516398 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1023/2216] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:28 2021] GET /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:28.707584 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b7c39c1a-81a0-457a-a8ad-187a5aea1edf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:28.708115 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b7c39c1a-81a0-457a-a8ad-187a5aea1edf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:28.713983 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b7c39c1a-81a0-457a-a8ad-187a5aea1edf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:28.714470 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b7c39c1a-81a0-457a-a8ad-187a5aea1edf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:28.715242 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b7c39c1a-81a0-457a-a8ad-187a5aea1edf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:28.715679 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b7c39c1a-81a0-457a-a8ad-187a5aea1edf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:28.774114 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-b7c39c1a-81a0-457a-a8ad-187a5aea1edf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:28.781717 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b7c39c1a-81a0-457a-a8ad-187a5aea1edf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.077873 Oct 29 01:46:28.782280 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1194/2217] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:28 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:29.146102 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [req-282473c2-2319-475c-a2e2-9c0c8cc31687 req-4e291c3d-554c-449a-a25a-799c208c1b44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0014609-7d4d-4959-a30a-1f7001aa2019", "name": "network-vif-plugged", "status": "completed", "tag": "82e879d7-87f5-437f-9a71-954eb07957ab"}]} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:29.147906 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:46:29.147906 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: warnings.warn(msg) Oct 29 01:46:29.156618 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-282473c2-2319-475c-a2e2-9c0c8cc31687 req-4e291c3d-554c-449a-a25a-799c208c1b44 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:29.157066 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-282473c2-2319-475c-a2e2-9c0c8cc31687 req-4e291c3d-554c-449a-a25a-799c208c1b44 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:29.168609 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.compute.server_external_events [req-282473c2-2319-475c-a2e2-9c0c8cc31687 req-4e291c3d-554c-449a-a25a-799c208c1b44 service nova] Creating event network-vif-plugged:82e879d7-87f5-437f-9a71-954eb07957ab for instance d0014609-7d4d-4959-a30a-1f7001aa2019 on hv-cinder-81558 Oct 29 01:46:29.174463 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [req-282473c2-2319-475c-a2e2-9c0c8cc31687 req-4e291c3d-554c-449a-a25a-799c208c1b44 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033776 Oct 29 01:46:29.175046 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1024/2218] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:46:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:46:29.519638 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ebfc5044-2062-4496-b3b2-384b4d28d94d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:29.520292 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ebfc5044-2062-4496-b3b2-384b4d28d94d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:29.526480 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ebfc5044-2062-4496-b3b2-384b4d28d94d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:29.527042 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ebfc5044-2062-4496-b3b2-384b4d28d94d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:29.527813 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ebfc5044-2062-4496-b3b2-384b4d28d94d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:29.528259 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ebfc5044-2062-4496-b3b2-384b4d28d94d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:29.533265 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-67415a0d-1a2b-4454-87f2-8a18fec91781 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:29.533972 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-67415a0d-1a2b-4454-87f2-8a18fec91781 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:29.540352 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-67415a0d-1a2b-4454-87f2-8a18fec91781 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:29.540800 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-67415a0d-1a2b-4454-87f2-8a18fec91781 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:29.541572 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-67415a0d-1a2b-4454-87f2-8a18fec91781 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:29.542006 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-67415a0d-1a2b-4454-87f2-8a18fec91781 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:29.593006 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-ebfc5044-2062-4496-b3b2-384b4d28d94d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:29.601383 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ebfc5044-2062-4496-b3b2-384b4d28d94d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.085538 Oct 29 01:46:29.601966 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1195/2219] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:29 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:29.678120 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-67415a0d-1a2b-4454-87f2-8a18fec91781 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2e7072a6214e9fb3b1fdc341b2d702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9478c9b68c774f5cbffc9f7b559fc86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:29.685245 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-67415a0d-1a2b-4454-87f2-8a18fec91781 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "GET /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019" status: 200 len: 1362 microversion: 2.1 time: 0.156765 Oct 29 01:46:29.685808 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1025/2220] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:29 2021] GET /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:46:29.798006 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-dde81623-8206-483e-8015-e030ed8423b5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:29.798648 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-dde81623-8206-483e-8015-e030ed8423b5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:29.804437 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dde81623-8206-483e-8015-e030ed8423b5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:29.804885 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dde81623-8206-483e-8015-e030ed8423b5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:29.805640 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dde81623-8206-483e-8015-e030ed8423b5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:29.806073 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dde81623-8206-483e-8015-e030ed8423b5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:29.864289 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-dde81623-8206-483e-8015-e030ed8423b5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:29.871915 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-dde81623-8206-483e-8015-e030ed8423b5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.078164 Oct 29 01:46:29.872481 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1196/2221] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:29 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:30.618118 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f0c6cc98-98a0-45d9-8008-7ec87a2f57c7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:30.618753 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f0c6cc98-98a0-45d9-8008-7ec87a2f57c7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:30.626203 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f0c6cc98-98a0-45d9-8008-7ec87a2f57c7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:30.626675 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f0c6cc98-98a0-45d9-8008-7ec87a2f57c7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:30.627433 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f0c6cc98-98a0-45d9-8008-7ec87a2f57c7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:30.627912 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f0c6cc98-98a0-45d9-8008-7ec87a2f57c7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:30.690796 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-f0c6cc98-98a0-45d9-8008-7ec87a2f57c7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:30.700023 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f0c6cc98-98a0-45d9-8008-7ec87a2f57c7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.085516 Oct 29 01:46:30.700578 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1026/2222] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:30 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:30.705144 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-6676ad2a-be29-4b4c-aac5-dd89bc359228 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:30.705761 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-6676ad2a-be29-4b4c-aac5-dd89bc359228 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:30.712523 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6676ad2a-be29-4b4c-aac5-dd89bc359228 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:30.712975 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6676ad2a-be29-4b4c-aac5-dd89bc359228 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:30.713743 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6676ad2a-be29-4b4c-aac5-dd89bc359228 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:30.714184 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6676ad2a-be29-4b4c-aac5-dd89bc359228 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:30.850358 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-6676ad2a-be29-4b4c-aac5-dd89bc359228 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2e7072a6214e9fb3b1fdc341b2d702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9478c9b68c774f5cbffc9f7b559fc86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:30.858138 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-6676ad2a-be29-4b4c-aac5-dd89bc359228 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "GET /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019" status: 200 len: 1549 microversion: 2.1 time: 0.157599 Oct 29 01:46:30.858721 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1197/2223] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:30 2021] GET /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019 => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:46:30.874828 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-5edbfcd2-d6a2-480b-a48c-113430c7f2ef tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:30.875247 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-5edbfcd2-d6a2-480b-a48c-113430c7f2ef tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:30.880953 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5edbfcd2-d6a2-480b-a48c-113430c7f2ef tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:30.881392 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5edbfcd2-d6a2-480b-a48c-113430c7f2ef tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:30.882180 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5edbfcd2-d6a2-480b-a48c-113430c7f2ef tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:30.882639 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5edbfcd2-d6a2-480b-a48c-113430c7f2ef tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:30.887870 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-cf577ef3-51b5-4a60-ab76-a93117205929 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:30.888603 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-cf577ef3-51b5-4a60-ab76-a93117205929 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:30.894449 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cf577ef3-51b5-4a60-ab76-a93117205929 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:30.894980 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cf577ef3-51b5-4a60-ab76-a93117205929 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:30.895816 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cf577ef3-51b5-4a60-ab76-a93117205929 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:30.896258 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cf577ef3-51b5-4a60-ab76-a93117205929 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:30.966284 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-cf577ef3-51b5-4a60-ab76-a93117205929 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:30.974000 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-cf577ef3-51b5-4a60-ab76-a93117205929 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.089570 Oct 29 01:46:30.974592 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1198/2224] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:30 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:46:30.983326 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-5edbfcd2-d6a2-480b-a48c-113430c7f2ef tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "GET /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.112184 Oct 29 01:46:30.983992 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1027/2225] 10.222.0.90 () {58 vars in 1274 bytes} [Fri Oct 29 01:46:30 2021] GET /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/os-interface => generated 285 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:46:31.717570 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-588d79cc-f961-41c4-af01-1b26e4aa2546 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:31.718189 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-588d79cc-f961-41c4-af01-1b26e4aa2546 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:31.724295 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-588d79cc-f961-41c4-af01-1b26e4aa2546 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:31.724742 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-588d79cc-f961-41c4-af01-1b26e4aa2546 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:31.725502 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-588d79cc-f961-41c4-af01-1b26e4aa2546 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:31.725932 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-588d79cc-f961-41c4-af01-1b26e4aa2546 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:31.789228 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-588d79cc-f961-41c4-af01-1b26e4aa2546 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:31.796831 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-588d79cc-f961-41c4-af01-1b26e4aa2546 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.083631 Oct 29 01:46:31.797394 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1199/2226] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:31 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:31.927669 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-6a2b6574-2387-447c-a4b8-d4b2de286265 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:31.928719 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-6a2b6574-2387-447c-a4b8-d4b2de286265 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:31.929442 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [req-98217eab-84c4-48d8-af10-b7f98475e34d req-1afd196f-4bf8-4b54-b19d-ef6c455bc97a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0014609-7d4d-4959-a30a-1f7001aa2019", "tag": "82e879d7-87f5-437f-9a71-954eb07957ab"}]} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:31.930986 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:46:31.930986 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: warnings.warn(msg) Oct 29 01:46:31.935088 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6a2b6574-2387-447c-a4b8-d4b2de286265 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:31.936136 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6a2b6574-2387-447c-a4b8-d4b2de286265 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:31.936980 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6a2b6574-2387-447c-a4b8-d4b2de286265 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:31.937503 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6a2b6574-2387-447c-a4b8-d4b2de286265 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:31.938478 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-98217eab-84c4-48d8-af10-b7f98475e34d req-1afd196f-4bf8-4b54-b19d-ef6c455bc97a service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:31.938921 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-98217eab-84c4-48d8-af10-b7f98475e34d req-1afd196f-4bf8-4b54-b19d-ef6c455bc97a service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:31.950138 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.compute.server_external_events [req-98217eab-84c4-48d8-af10-b7f98475e34d req-1afd196f-4bf8-4b54-b19d-ef6c455bc97a service nova] Creating event network-changed:82e879d7-87f5-437f-9a71-954eb07957ab for instance d0014609-7d4d-4959-a30a-1f7001aa2019 on hv-cinder-81558 Oct 29 01:46:31.960246 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [req-98217eab-84c4-48d8-af10-b7f98475e34d req-1afd196f-4bf8-4b54-b19d-ef6c455bc97a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034102 Oct 29 01:46:31.962423 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1200/2227] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:46:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:46:31.992114 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b4b5f0a9-9690-4db9-99ef-57ed73bcf38a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:31.992901 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b4b5f0a9-9690-4db9-99ef-57ed73bcf38a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:32.000084 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b4b5f0a9-9690-4db9-99ef-57ed73bcf38a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:32.000535 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b4b5f0a9-9690-4db9-99ef-57ed73bcf38a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:32.001312 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b4b5f0a9-9690-4db9-99ef-57ed73bcf38a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:32.001743 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b4b5f0a9-9690-4db9-99ef-57ed73bcf38a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:32.052604 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-6a2b6574-2387-447c-a4b8-d4b2de286265 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action" status: 200 len: 14 microversion: 2.1 time: 0.129197 Oct 29 01:46:32.056639 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1028/2228] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:46:31 2021] POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:46:32.067999 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-b4b5f0a9-9690-4db9-99ef-57ed73bcf38a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:32.075814 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b4b5f0a9-9690-4db9-99ef-57ed73bcf38a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.087720 Oct 29 01:46:32.077494 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1201/2229] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:31 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:32.814657 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-cd911308-00ab-4fff-a346-191a77af72f3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:32.815472 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-cd911308-00ab-4fff-a346-191a77af72f3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:32.822346 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cd911308-00ab-4fff-a346-191a77af72f3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:32.822837 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cd911308-00ab-4fff-a346-191a77af72f3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:32.823625 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cd911308-00ab-4fff-a346-191a77af72f3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:32.824067 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cd911308-00ab-4fff-a346-191a77af72f3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:32.893464 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-cd911308-00ab-4fff-a346-191a77af72f3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:32.901920 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-cd911308-00ab-4fff-a346-191a77af72f3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.091859 Oct 29 01:46:32.902916 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1029/2230] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:32 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:33.063299 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-601c1abd-0eca-45fe-9a34-b0790c134e65 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:33.064133 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-601c1abd-0eca-45fe-9a34-b0790c134e65 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:33.070315 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-601c1abd-0eca-45fe-9a34-b0790c134e65 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:33.070806 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-601c1abd-0eca-45fe-9a34-b0790c134e65 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:33.071591 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-601c1abd-0eca-45fe-9a34-b0790c134e65 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:33.072015 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-601c1abd-0eca-45fe-9a34-b0790c134e65 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:33.093855 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-67cef9c4-6cd8-4352-ac96-ad64385dec63 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:33.095165 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-67cef9c4-6cd8-4352-ac96-ad64385dec63 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:33.102234 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-67cef9c4-6cd8-4352-ac96-ad64385dec63 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:33.102721 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-67cef9c4-6cd8-4352-ac96-ad64385dec63 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:33.103513 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-67cef9c4-6cd8-4352-ac96-ad64385dec63 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:33.103958 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-67cef9c4-6cd8-4352-ac96-ad64385dec63 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:33.156143 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-601c1abd-0eca-45fe-9a34-b0790c134e65 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action" status: 200 len: 14 microversion: 2.1 time: 0.097131 Oct 29 01:46:33.156956 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1202/2231] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:46:33 2021] POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:46:33.167182 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-67cef9c4-6cd8-4352-ac96-ad64385dec63 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:33.177718 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-67cef9c4-6cd8-4352-ac96-ad64385dec63 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.087902 Oct 29 01:46:33.178285 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1030/2232] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:33 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:33.918930 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-38c779a7-0092-4da4-961a-671f9066e753 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:33.919622 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-38c779a7-0092-4da4-961a-671f9066e753 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:33.926346 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-38c779a7-0092-4da4-961a-671f9066e753 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:33.926821 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-38c779a7-0092-4da4-961a-671f9066e753 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:33.927577 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-38c779a7-0092-4da4-961a-671f9066e753 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:33.928003 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-38c779a7-0092-4da4-961a-671f9066e753 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:33.991035 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-38c779a7-0092-4da4-961a-671f9066e753 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:33.999520 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-38c779a7-0092-4da4-961a-671f9066e753 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.084712 Oct 29 01:46:34.000120 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1203/2233] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:33 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:34.166662 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-6a4688f9-4126-4afe-893b-8c681735bbde tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:34.167608 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-6a4688f9-4126-4afe-893b-8c681735bbde tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:34.173886 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6a4688f9-4126-4afe-893b-8c681735bbde tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:34.174282 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6a4688f9-4126-4afe-893b-8c681735bbde tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:34.175156 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6a4688f9-4126-4afe-893b-8c681735bbde tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:34.175594 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6a4688f9-4126-4afe-893b-8c681735bbde tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:34.194509 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-7fbf2d7b-91e5-4d47-9c21-59066df3b5e1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:34.195127 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-7fbf2d7b-91e5-4d47-9c21-59066df3b5e1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:34.202272 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7fbf2d7b-91e5-4d47-9c21-59066df3b5e1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:34.202769 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7fbf2d7b-91e5-4d47-9c21-59066df3b5e1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:34.203551 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7fbf2d7b-91e5-4d47-9c21-59066df3b5e1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:34.203998 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7fbf2d7b-91e5-4d47-9c21-59066df3b5e1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:34.257766 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-6a4688f9-4126-4afe-893b-8c681735bbde tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action" status: 200 len: 14 microversion: 2.1 time: 0.094560 Oct 29 01:46:34.260939 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1031/2234] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:46:34 2021] POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:46:34.262231 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-7fbf2d7b-91e5-4d47-9c21-59066df3b5e1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:34.270706 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-7fbf2d7b-91e5-4d47-9c21-59066df3b5e1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.079753 Oct 29 01:46:34.271261 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1204/2235] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:34 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:46:35.015818 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-231148ed-719b-4e84-ad03-66ecaeb6f522 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:35.016525 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-231148ed-719b-4e84-ad03-66ecaeb6f522 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:35.023376 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-231148ed-719b-4e84-ad03-66ecaeb6f522 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:35.023899 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-231148ed-719b-4e84-ad03-66ecaeb6f522 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:35.024627 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-231148ed-719b-4e84-ad03-66ecaeb6f522 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:35.025065 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-231148ed-719b-4e84-ad03-66ecaeb6f522 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:35.085525 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-231148ed-719b-4e84-ad03-66ecaeb6f522 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:35.094296 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-231148ed-719b-4e84-ad03-66ecaeb6f522 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.082506 Oct 29 01:46:35.094893 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1032/2236] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:35 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:35.268701 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9c4d05e6-006e-4a4c-b7af-e526005bb1ab tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:35.269624 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9c4d05e6-006e-4a4c-b7af-e526005bb1ab tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:35.275946 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9c4d05e6-006e-4a4c-b7af-e526005bb1ab tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:35.276342 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9c4d05e6-006e-4a4c-b7af-e526005bb1ab tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:35.277109 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9c4d05e6-006e-4a4c-b7af-e526005bb1ab tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:35.277547 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9c4d05e6-006e-4a4c-b7af-e526005bb1ab tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:35.286873 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-91b9fb21-eff5-4a70-a81b-1cff69b6d17e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:35.287488 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-91b9fb21-eff5-4a70-a81b-1cff69b6d17e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:35.293853 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-91b9fb21-eff5-4a70-a81b-1cff69b6d17e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:35.294305 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-91b9fb21-eff5-4a70-a81b-1cff69b6d17e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:35.295149 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-91b9fb21-eff5-4a70-a81b-1cff69b6d17e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:35.295595 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-91b9fb21-eff5-4a70-a81b-1cff69b6d17e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:35.355339 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-91b9fb21-eff5-4a70-a81b-1cff69b6d17e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:35.363143 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-91b9fb21-eff5-4a70-a81b-1cff69b6d17e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.079890 Oct 29 01:46:35.366170 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9c4d05e6-006e-4a4c-b7af-e526005bb1ab tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action" status: 200 len: 14 microversion: 2.1 time: 0.100943 Oct 29 01:46:35.366878 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1205/2237] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:46:35 2021] POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:46:35.367005 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1033/2238] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:35 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:46:36.112034 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f4c114b2-d2ba-4236-bd13-dc23ee1a9d26 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:36.112735 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f4c114b2-d2ba-4236-bd13-dc23ee1a9d26 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:36.119532 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f4c114b2-d2ba-4236-bd13-dc23ee1a9d26 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:36.119985 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f4c114b2-d2ba-4236-bd13-dc23ee1a9d26 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:36.120739 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f4c114b2-d2ba-4236-bd13-dc23ee1a9d26 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:36.121169 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f4c114b2-d2ba-4236-bd13-dc23ee1a9d26 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:36.184921 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-f4c114b2-d2ba-4236-bd13-dc23ee1a9d26 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:36.193674 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f4c114b2-d2ba-4236-bd13-dc23ee1a9d26 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.086235 Oct 29 01:46:36.194222 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1206/2239] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:36 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:36.378075 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-7d9e3ba4-589f-4045-9b4c-3ac4eb8b66b6 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:36.379031 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-7d9e3ba4-589f-4045-9b4c-3ac4eb8b66b6 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:36.379636 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-326de81b-4c7a-4bc2-a552-b37280b6adf4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:36.380250 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-326de81b-4c7a-4bc2-a552-b37280b6adf4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:36.385051 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7d9e3ba4-589f-4045-9b4c-3ac4eb8b66b6 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:36.385506 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7d9e3ba4-589f-4045-9b4c-3ac4eb8b66b6 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:36.386287 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7d9e3ba4-589f-4045-9b4c-3ac4eb8b66b6 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:36.386506 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-326de81b-4c7a-4bc2-a552-b37280b6adf4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:36.386753 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7d9e3ba4-589f-4045-9b4c-3ac4eb8b66b6 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:36.386962 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-326de81b-4c7a-4bc2-a552-b37280b6adf4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:36.387730 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-326de81b-4c7a-4bc2-a552-b37280b6adf4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:36.388170 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-326de81b-4c7a-4bc2-a552-b37280b6adf4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:36.448845 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-326de81b-4c7a-4bc2-a552-b37280b6adf4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:36.457036 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-326de81b-4c7a-4bc2-a552-b37280b6adf4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.080959 Oct 29 01:46:36.457602 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1207/2240] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:36 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:46:36.469002 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-7d9e3ba4-589f-4045-9b4c-3ac4eb8b66b6 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action" status: 200 len: 14 microversion: 2.1 time: 0.095238 Oct 29 01:46:36.469620 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1034/2241] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:46:36 2021] POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:46:37.213068 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a8fef8d7-1812-4393-8a25-30446b21f385 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:37.213682 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a8fef8d7-1812-4393-8a25-30446b21f385 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:37.221549 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a8fef8d7-1812-4393-8a25-30446b21f385 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:37.222223 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a8fef8d7-1812-4393-8a25-30446b21f385 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:37.223558 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a8fef8d7-1812-4393-8a25-30446b21f385 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:37.224110 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a8fef8d7-1812-4393-8a25-30446b21f385 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:37.282927 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-a8fef8d7-1812-4393-8a25-30446b21f385 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:37.290683 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a8fef8d7-1812-4393-8a25-30446b21f385 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.081878 Oct 29 01:46:37.291232 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1208/2242] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:37 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:37.474262 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-3947f0c7-8fe8-44aa-8a15-5430daf39650 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:37.474920 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-3947f0c7-8fe8-44aa-8a15-5430daf39650 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:37.479616 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b42c5ee6-3f45-433c-a64f-8637bc4dedfe tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:37.480529 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b42c5ee6-3f45-433c-a64f-8637bc4dedfe tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:37.481745 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3947f0c7-8fe8-44aa-8a15-5430daf39650 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:37.482201 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3947f0c7-8fe8-44aa-8a15-5430daf39650 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:37.483593 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3947f0c7-8fe8-44aa-8a15-5430daf39650 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:37.484031 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3947f0c7-8fe8-44aa-8a15-5430daf39650 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:37.487008 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b42c5ee6-3f45-433c-a64f-8637bc4dedfe tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:37.487449 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b42c5ee6-3f45-433c-a64f-8637bc4dedfe tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:37.488208 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b42c5ee6-3f45-433c-a64f-8637bc4dedfe tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:37.488635 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b42c5ee6-3f45-433c-a64f-8637bc4dedfe tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:37.544513 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-3947f0c7-8fe8-44aa-8a15-5430daf39650 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:37.552436 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-3947f0c7-8fe8-44aa-8a15-5430daf39650 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.082240 Oct 29 01:46:37.552999 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1035/2243] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:37 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:37.573494 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b42c5ee6-3f45-433c-a64f-8637bc4dedfe tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action" status: 200 len: 14 microversion: 2.1 time: 0.097276 Oct 29 01:46:37.574112 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1209/2244] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:46:37 2021] POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:46:38.307995 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c37954fa-e342-405e-9696-0d69feceb74d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:38.308514 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c37954fa-e342-405e-9696-0d69feceb74d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:38.315268 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c37954fa-e342-405e-9696-0d69feceb74d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:38.315714 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c37954fa-e342-405e-9696-0d69feceb74d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:38.316495 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c37954fa-e342-405e-9696-0d69feceb74d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:38.316953 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c37954fa-e342-405e-9696-0d69feceb74d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:38.375848 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-c37954fa-e342-405e-9696-0d69feceb74d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:38.383527 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c37954fa-e342-405e-9696-0d69feceb74d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.079299 Oct 29 01:46:38.384087 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1036/2245] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:38 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:38.569260 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-30c55a6f-e28d-41c0-9b54-0100a56c9d6b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:38.569907 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-30c55a6f-e28d-41c0-9b54-0100a56c9d6b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:38.576922 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-30c55a6f-e28d-41c0-9b54-0100a56c9d6b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:38.577371 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-30c55a6f-e28d-41c0-9b54-0100a56c9d6b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:38.578139 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-30c55a6f-e28d-41c0-9b54-0100a56c9d6b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:38.578611 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-30c55a6f-e28d-41c0-9b54-0100a56c9d6b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:38.584549 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-4c1d9c0e-5f5e-4d99-9f31-aaea2cbbc017 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:38.585487 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-4c1d9c0e-5f5e-4d99-9f31-aaea2cbbc017 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:38.591765 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4c1d9c0e-5f5e-4d99-9f31-aaea2cbbc017 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:38.592219 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4c1d9c0e-5f5e-4d99-9f31-aaea2cbbc017 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:38.593000 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4c1d9c0e-5f5e-4d99-9f31-aaea2cbbc017 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:38.593439 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4c1d9c0e-5f5e-4d99-9f31-aaea2cbbc017 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:38.640153 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-30c55a6f-e28d-41c0-9b54-0100a56c9d6b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:38.647777 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-30c55a6f-e28d-41c0-9b54-0100a56c9d6b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.082645 Oct 29 01:46:38.648344 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1210/2246] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:38 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:38.679772 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-4c1d9c0e-5f5e-4d99-9f31-aaea2cbbc017 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action" status: 200 len: 14 microversion: 2.1 time: 0.098544 Oct 29 01:46:38.680406 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1037/2247] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:46:38 2021] POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 01:46:39.400196 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c750bda2-1e8c-443b-bcaa-b63ee1133511 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:39.400808 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c750bda2-1e8c-443b-bcaa-b63ee1133511 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:39.407509 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c750bda2-1e8c-443b-bcaa-b63ee1133511 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:39.407951 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c750bda2-1e8c-443b-bcaa-b63ee1133511 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:39.408725 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c750bda2-1e8c-443b-bcaa-b63ee1133511 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:39.409154 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c750bda2-1e8c-443b-bcaa-b63ee1133511 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:39.470924 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c750bda2-1e8c-443b-bcaa-b63ee1133511 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:39.478586 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c750bda2-1e8c-443b-bcaa-b63ee1133511 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.081999 Oct 29 01:46:39.479154 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1211/2248] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:39 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:39.665782 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-52d0890a-89e7-4280-90f6-8dd67527f8f6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:39.666424 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-52d0890a-89e7-4280-90f6-8dd67527f8f6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:39.673864 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-52d0890a-89e7-4280-90f6-8dd67527f8f6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:39.674326 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-52d0890a-89e7-4280-90f6-8dd67527f8f6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:39.675133 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-52d0890a-89e7-4280-90f6-8dd67527f8f6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:39.675571 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-52d0890a-89e7-4280-90f6-8dd67527f8f6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:39.691076 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b80a3455-221f-493e-918c-b794c3fb4c82 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:39.692030 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b80a3455-221f-493e-918c-b794c3fb4c82 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:39.698189 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b80a3455-221f-493e-918c-b794c3fb4c82 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:39.698683 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b80a3455-221f-493e-918c-b794c3fb4c82 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:39.699450 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b80a3455-221f-493e-918c-b794c3fb4c82 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:39.699880 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b80a3455-221f-493e-918c-b794c3fb4c82 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:39.736600 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-52d0890a-89e7-4280-90f6-8dd67527f8f6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:39.744523 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-52d0890a-89e7-4280-90f6-8dd67527f8f6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.082916 Oct 29 01:46:39.745084 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1038/2249] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:39 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:39.796965 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b80a3455-221f-493e-918c-b794c3fb4c82 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action" status: 200 len: 14 microversion: 2.1 time: 0.109302 Oct 29 01:46:39.797579 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1212/2250] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:46:39 2021] POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 01:46:40.495856 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-89022de2-b011-43e9-8f9c-72dadde225c0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:40.496473 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-89022de2-b011-43e9-8f9c-72dadde225c0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:40.502826 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-89022de2-b011-43e9-8f9c-72dadde225c0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:40.503165 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-89022de2-b011-43e9-8f9c-72dadde225c0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:40.503938 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-89022de2-b011-43e9-8f9c-72dadde225c0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:40.504381 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-89022de2-b011-43e9-8f9c-72dadde225c0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:40.564702 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-89022de2-b011-43e9-8f9c-72dadde225c0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:40.572440 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-89022de2-b011-43e9-8f9c-72dadde225c0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.080267 Oct 29 01:46:40.572992 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1039/2251] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:40 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:40.761386 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ffe85d12-6256-4b2c-9609-71a952a8a788 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:40.762012 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ffe85d12-6256-4b2c-9609-71a952a8a788 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:40.769402 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ffe85d12-6256-4b2c-9609-71a952a8a788 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:40.769852 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ffe85d12-6256-4b2c-9609-71a952a8a788 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:40.770640 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ffe85d12-6256-4b2c-9609-71a952a8a788 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:40.771074 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ffe85d12-6256-4b2c-9609-71a952a8a788 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:40.807449 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2aa27613-a4ac-4dac-b957-ceea0aab50c5 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:40.808356 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2aa27613-a4ac-4dac-b957-ceea0aab50c5 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:40.814545 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2aa27613-a4ac-4dac-b957-ceea0aab50c5 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:40.815126 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2aa27613-a4ac-4dac-b957-ceea0aab50c5 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:40.815869 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2aa27613-a4ac-4dac-b957-ceea0aab50c5 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:40.816302 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2aa27613-a4ac-4dac-b957-ceea0aab50c5 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:40.832551 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-ffe85d12-6256-4b2c-9609-71a952a8a788 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:40.840699 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ffe85d12-6256-4b2c-9609-71a952a8a788 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.083383 Oct 29 01:46:40.841265 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1213/2252] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:40 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:40.913991 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2aa27613-a4ac-4dac-b957-ceea0aab50c5 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action" status: 200 len: 14 microversion: 2.1 time: 0.109947 Oct 29 01:46:40.914642 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1040/2253] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:46:40 2021] POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 01:46:41.588826 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-266f6333-66ee-4a43-b9eb-c15aef981668 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:41.589425 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-266f6333-66ee-4a43-b9eb-c15aef981668 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:41.596605 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-266f6333-66ee-4a43-b9eb-c15aef981668 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:41.597050 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-266f6333-66ee-4a43-b9eb-c15aef981668 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:41.597800 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-266f6333-66ee-4a43-b9eb-c15aef981668 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:41.598228 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-266f6333-66ee-4a43-b9eb-c15aef981668 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:41.658101 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-266f6333-66ee-4a43-b9eb-c15aef981668 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:41.665809 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-266f6333-66ee-4a43-b9eb-c15aef981668 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.080669 Oct 29 01:46:41.666371 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1214/2254] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:41 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:41.858259 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-ac22ed51-c099-4fc9-aada-57300804e02b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:41.858999 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-ac22ed51-c099-4fc9-aada-57300804e02b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:41.865769 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ac22ed51-c099-4fc9-aada-57300804e02b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:41.866230 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ac22ed51-c099-4fc9-aada-57300804e02b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:41.867023 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ac22ed51-c099-4fc9-aada-57300804e02b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:41.867465 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ac22ed51-c099-4fc9-aada-57300804e02b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:41.924768 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-1a5e8c86-2c76-4daf-bcbd-7ea4357892c0 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:41.925694 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-1a5e8c86-2c76-4daf-bcbd-7ea4357892c0 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:41.926305 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-ac22ed51-c099-4fc9-aada-57300804e02b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:41.931956 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1a5e8c86-2c76-4daf-bcbd-7ea4357892c0 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:41.932402 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1a5e8c86-2c76-4daf-bcbd-7ea4357892c0 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:41.933168 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1a5e8c86-2c76-4daf-bcbd-7ea4357892c0 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:41.933603 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1a5e8c86-2c76-4daf-bcbd-7ea4357892c0 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:41.934617 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-ac22ed51-c099-4fc9-aada-57300804e02b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.080306 Oct 29 01:46:41.935839 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1041/2255] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:41 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:42.020711 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-1a5e8c86-2c76-4daf-bcbd-7ea4357892c0 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action" status: 200 len: 14 microversion: 2.1 time: 0.099510 Oct 29 01:46:42.021318 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1215/2256] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:46:41 2021] POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 01:46:42.682338 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-32cd485d-d01e-4a64-944b-4c1ce8c3f6e8 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:42.682975 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-32cd485d-d01e-4a64-944b-4c1ce8c3f6e8 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:42.689180 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-32cd485d-d01e-4a64-944b-4c1ce8c3f6e8 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:42.689631 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-32cd485d-d01e-4a64-944b-4c1ce8c3f6e8 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:42.690509 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-32cd485d-d01e-4a64-944b-4c1ce8c3f6e8 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:42.690947 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-32cd485d-d01e-4a64-944b-4c1ce8c3f6e8 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:42.754848 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-32cd485d-d01e-4a64-944b-4c1ce8c3f6e8 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:42.762572 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-32cd485d-d01e-4a64-944b-4c1ce8c3f6e8 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.084044 Oct 29 01:46:42.763125 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1042/2257] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:42 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:42.952947 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-92d07541-e05f-48ab-a580-64a890c4948d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:42.953560 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-92d07541-e05f-48ab-a580-64a890c4948d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:42.960493 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-92d07541-e05f-48ab-a580-64a890c4948d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:42.960939 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-92d07541-e05f-48ab-a580-64a890c4948d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:42.961698 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-92d07541-e05f-48ab-a580-64a890c4948d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:42.962128 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-92d07541-e05f-48ab-a580-64a890c4948d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:43.022046 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-92d07541-e05f-48ab-a580-64a890c4948d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:43.030806 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-92d07541-e05f-48ab-a580-64a890c4948d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.082403 Oct 29 01:46:43.031480 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1216/2258] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:42 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:43.031971 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-0279972c-9c93-4805-80e0-a1dc31f46f8e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:43.032922 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-0279972c-9c93-4805-80e0-a1dc31f46f8e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:43.039082 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0279972c-9c93-4805-80e0-a1dc31f46f8e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:43.039537 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0279972c-9c93-4805-80e0-a1dc31f46f8e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:43.040312 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0279972c-9c93-4805-80e0-a1dc31f46f8e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:43.040749 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0279972c-9c93-4805-80e0-a1dc31f46f8e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:43.129154 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-0279972c-9c93-4805-80e0-a1dc31f46f8e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action" status: 200 len: 9039 microversion: 2.1 time: 0.101361 Oct 29 01:46:43.129776 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1043/2259] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:46:43 2021] POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action => generated 9039 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:46:43.780472 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-345f0a6b-8e28-4172-b720-bbeac5076519 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:43.781087 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-345f0a6b-8e28-4172-b720-bbeac5076519 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:43.787320 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-345f0a6b-8e28-4172-b720-bbeac5076519 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:43.787776 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-345f0a6b-8e28-4172-b720-bbeac5076519 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:43.788542 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-345f0a6b-8e28-4172-b720-bbeac5076519 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:43.788982 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-345f0a6b-8e28-4172-b720-bbeac5076519 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:43.848731 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-345f0a6b-8e28-4172-b720-bbeac5076519 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:43.856335 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-345f0a6b-8e28-4172-b720-bbeac5076519 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.080230 Oct 29 01:46:43.856899 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1217/2260] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:43 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:44.047898 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-b9104de8-8b79-436a-87fe-3c9145715c33 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:44.048524 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-b9104de8-8b79-436a-87fe-3c9145715c33 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:44.055327 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b9104de8-8b79-436a-87fe-3c9145715c33 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:44.055775 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b9104de8-8b79-436a-87fe-3c9145715c33 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:44.056534 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b9104de8-8b79-436a-87fe-3c9145715c33 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:44.056960 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b9104de8-8b79-436a-87fe-3c9145715c33 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:44.119155 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-b9104de8-8b79-436a-87fe-3c9145715c33 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:44.127477 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-b9104de8-8b79-436a-87fe-3c9145715c33 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.083681 Oct 29 01:46:44.128010 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1044/2261] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:44 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:46:44.140388 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-250bcd2a-e125-4653-b3b3-797d7f1d4a4e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:44.141312 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-250bcd2a-e125-4653-b3b3-797d7f1d4a4e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:44.147659 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-250bcd2a-e125-4653-b3b3-797d7f1d4a4e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:44.148111 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-250bcd2a-e125-4653-b3b3-797d7f1d4a4e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:44.148874 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-250bcd2a-e125-4653-b3b3-797d7f1d4a4e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:44.149306 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-250bcd2a-e125-4653-b3b3-797d7f1d4a4e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:44.253202 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-250bcd2a-e125-4653-b3b3-797d7f1d4a4e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action" status: 200 len: 16364 microversion: 2.1 time: 0.116854 Oct 29 01:46:44.253827 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1218/2262] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:46:44 2021] POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action => generated 16364 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:46:44.873652 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d743964f-09d6-4ab8-a0bb-544882fe9762 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:44.874255 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d743964f-09d6-4ab8-a0bb-544882fe9762 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:44.880520 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d743964f-09d6-4ab8-a0bb-544882fe9762 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:44.880967 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d743964f-09d6-4ab8-a0bb-544882fe9762 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:44.881721 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d743964f-09d6-4ab8-a0bb-544882fe9762 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:44.882147 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d743964f-09d6-4ab8-a0bb-544882fe9762 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:44.940430 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-d743964f-09d6-4ab8-a0bb-544882fe9762 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:44.949065 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d743964f-09d6-4ab8-a0bb-544882fe9762 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.079636 Oct 29 01:46:44.949628 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1045/2263] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:44 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:45.144147 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a4630918-fbed-4d78-9a62-ade5eec65ab2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:45.144857 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a4630918-fbed-4d78-9a62-ade5eec65ab2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:45.151726 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a4630918-fbed-4d78-9a62-ade5eec65ab2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:45.152179 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a4630918-fbed-4d78-9a62-ade5eec65ab2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:45.152945 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a4630918-fbed-4d78-9a62-ade5eec65ab2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:45.153383 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a4630918-fbed-4d78-9a62-ade5eec65ab2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:45.219799 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-a4630918-fbed-4d78-9a62-ade5eec65ab2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:45.228001 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a4630918-fbed-4d78-9a62-ade5eec65ab2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.087891 Oct 29 01:46:45.228562 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1219/2264] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:45 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:45.264286 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-27b43955-dc51-41e6-be89-f0a8a6149a4e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:45.265200 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-27b43955-dc51-41e6-be89-f0a8a6149a4e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:45.271393 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-27b43955-dc51-41e6-be89-f0a8a6149a4e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:45.271845 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-27b43955-dc51-41e6-be89-f0a8a6149a4e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:45.272610 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-27b43955-dc51-41e6-be89-f0a8a6149a4e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:45.273042 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-27b43955-dc51-41e6-be89-f0a8a6149a4e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:45.365578 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-27b43955-dc51-41e6-be89-f0a8a6149a4e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action" status: 200 len: 18305 microversion: 2.1 time: 0.104792 Oct 29 01:46:45.366217 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1046/2265] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:46:45 2021] POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action => generated 18305 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:46:45.965735 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-18b2da4c-8001-448e-97c7-49c454c73ca3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:45.966354 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-18b2da4c-8001-448e-97c7-49c454c73ca3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:45.972723 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-18b2da4c-8001-448e-97c7-49c454c73ca3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:45.973171 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-18b2da4c-8001-448e-97c7-49c454c73ca3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:45.973932 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-18b2da4c-8001-448e-97c7-49c454c73ca3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:45.974368 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-18b2da4c-8001-448e-97c7-49c454c73ca3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:46.036480 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-18b2da4c-8001-448e-97c7-49c454c73ca3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:46.044210 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-18b2da4c-8001-448e-97c7-49c454c73ca3 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.082102 Oct 29 01:46:46.045261 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1220/2266] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:45 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:46.245049 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c6258528-8ebd-47c4-abfd-aad41e74403e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:46.245656 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c6258528-8ebd-47c4-abfd-aad41e74403e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:46.252418 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c6258528-8ebd-47c4-abfd-aad41e74403e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:46.252862 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c6258528-8ebd-47c4-abfd-aad41e74403e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:46.253615 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c6258528-8ebd-47c4-abfd-aad41e74403e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:46.254072 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c6258528-8ebd-47c4-abfd-aad41e74403e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:46.315730 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-c6258528-8ebd-47c4-abfd-aad41e74403e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:46.323524 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c6258528-8ebd-47c4-abfd-aad41e74403e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.082657 Oct 29 01:46:46.324079 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1047/2267] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:46 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:46.376691 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d69a4055-5eee-422e-a159-d3835f2f3c6c tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:46.377609 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d69a4055-5eee-422e-a159-d3835f2f3c6c tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:46.383802 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d69a4055-5eee-422e-a159-d3835f2f3c6c tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:46.384251 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d69a4055-5eee-422e-a159-d3835f2f3c6c tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:46.385009 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d69a4055-5eee-422e-a159-d3835f2f3c6c tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:46.385443 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d69a4055-5eee-422e-a159-d3835f2f3c6c tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:46.479379 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d69a4055-5eee-422e-a159-d3835f2f3c6c tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action" status: 200 len: 20997 microversion: 2.1 time: 0.106213 Oct 29 01:46:46.480019 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1221/2268] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:46:46 2021] POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action => generated 20997 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:46:47.061194 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-eb2aa651-d9a1-4eb8-bb14-ac4a78209a03 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:47.061732 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-eb2aa651-d9a1-4eb8-bb14-ac4a78209a03 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:47.068099 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-eb2aa651-d9a1-4eb8-bb14-ac4a78209a03 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:47.068544 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-eb2aa651-d9a1-4eb8-bb14-ac4a78209a03 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:47.069301 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-eb2aa651-d9a1-4eb8-bb14-ac4a78209a03 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:47.069732 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-eb2aa651-d9a1-4eb8-bb14-ac4a78209a03 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:47.128690 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-eb2aa651-d9a1-4eb8-bb14-ac4a78209a03 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:47.136399 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-eb2aa651-d9a1-4eb8-bb14-ac4a78209a03 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.079523 Oct 29 01:46:47.136958 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1048/2269] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:47 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:47.341000 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ccf665be-982c-4551-b36c-066bc3b2e644 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:47.341979 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ccf665be-982c-4551-b36c-066bc3b2e644 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:47.351510 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ccf665be-982c-4551-b36c-066bc3b2e644 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:47.351959 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ccf665be-982c-4551-b36c-066bc3b2e644 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:47.352728 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ccf665be-982c-4551-b36c-066bc3b2e644 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:47.353162 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ccf665be-982c-4551-b36c-066bc3b2e644 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:47.414230 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-ccf665be-982c-4551-b36c-066bc3b2e644 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:47.422679 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ccf665be-982c-4551-b36c-066bc3b2e644 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.085774 Oct 29 01:46:47.423245 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1222/2270] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:47 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:47.491110 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-928d372c-3aa8-450d-8764-529e775dd037 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:47.492022 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-928d372c-3aa8-450d-8764-529e775dd037 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:47.498814 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-928d372c-3aa8-450d-8764-529e775dd037 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:47.499262 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-928d372c-3aa8-450d-8764-529e775dd037 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:47.500014 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-928d372c-3aa8-450d-8764-529e775dd037 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:47.500446 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-928d372c-3aa8-450d-8764-529e775dd037 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:47.590247 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-928d372c-3aa8-450d-8764-529e775dd037 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action" status: 200 len: 22852 microversion: 2.1 time: 0.102573 Oct 29 01:46:47.593249 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1049/2271] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:46:47 2021] POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action => generated 22852 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:46:48.153262 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-dc332e10-914c-4512-920b-be0d88871bb5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:48.153877 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-dc332e10-914c-4512-920b-be0d88871bb5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:48.160888 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dc332e10-914c-4512-920b-be0d88871bb5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:48.161335 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dc332e10-914c-4512-920b-be0d88871bb5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:48.162096 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dc332e10-914c-4512-920b-be0d88871bb5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:48.162558 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dc332e10-914c-4512-920b-be0d88871bb5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:48.222325 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-dc332e10-914c-4512-920b-be0d88871bb5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:48.230135 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-dc332e10-914c-4512-920b-be0d88871bb5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.080902 Oct 29 01:46:48.230729 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1223/2272] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:48 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:48.440249 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-bf05f1e7-a151-4f25-8cef-1a3f627ca8a0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:48.440937 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-bf05f1e7-a151-4f25-8cef-1a3f627ca8a0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:48.447704 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bf05f1e7-a151-4f25-8cef-1a3f627ca8a0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:48.448147 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bf05f1e7-a151-4f25-8cef-1a3f627ca8a0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:48.448905 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bf05f1e7-a151-4f25-8cef-1a3f627ca8a0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:48.449334 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bf05f1e7-a151-4f25-8cef-1a3f627ca8a0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:48.509834 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-bf05f1e7-a151-4f25-8cef-1a3f627ca8a0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:48.518831 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-bf05f1e7-a151-4f25-8cef-1a3f627ca8a0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.083060 Oct 29 01:46:48.519380 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1050/2273] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:48 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:48.600800 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-0e9c03ca-e33a-4aa7-8914-b1e4089c5d73 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:48.601714 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-0e9c03ca-e33a-4aa7-8914-b1e4089c5d73 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:48.607889 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0e9c03ca-e33a-4aa7-8914-b1e4089c5d73 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:48.608404 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0e9c03ca-e33a-4aa7-8914-b1e4089c5d73 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:48.609167 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0e9c03ca-e33a-4aa7-8914-b1e4089c5d73 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:48.609600 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-0e9c03ca-e33a-4aa7-8914-b1e4089c5d73 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:48.705598 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-0e9c03ca-e33a-4aa7-8914-b1e4089c5d73 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action" status: 200 len: 23804 microversion: 2.1 time: 0.108289 Oct 29 01:46:48.706242 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1224/2274] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:46:48 2021] POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action => generated 23804 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:46:49.246906 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c1f6aa1d-b4e1-4518-8af0-e32be069462e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:49.247526 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c1f6aa1d-b4e1-4518-8af0-e32be069462e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:49.253942 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c1f6aa1d-b4e1-4518-8af0-e32be069462e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:49.254413 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c1f6aa1d-b4e1-4518-8af0-e32be069462e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:49.255191 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c1f6aa1d-b4e1-4518-8af0-e32be069462e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:49.255639 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c1f6aa1d-b4e1-4518-8af0-e32be069462e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:49.320356 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-c1f6aa1d-b4e1-4518-8af0-e32be069462e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:49.328775 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c1f6aa1d-b4e1-4518-8af0-e32be069462e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.085500 Oct 29 01:46:49.329667 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1051/2275] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:49 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:49.535788 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-495d6226-3d5b-4e60-8993-f1db850d7fa6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:49.536394 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-495d6226-3d5b-4e60-8993-f1db850d7fa6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:49.543253 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-495d6226-3d5b-4e60-8993-f1db850d7fa6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:49.543703 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-495d6226-3d5b-4e60-8993-f1db850d7fa6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:49.544462 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-495d6226-3d5b-4e60-8993-f1db850d7fa6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:49.544894 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-495d6226-3d5b-4e60-8993-f1db850d7fa6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:49.605409 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-495d6226-3d5b-4e60-8993-f1db850d7fa6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:49.613551 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-495d6226-3d5b-4e60-8993-f1db850d7fa6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.081881 Oct 29 01:46:49.614102 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1225/2276] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:49 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:49.716931 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c806576c-e72e-4ec7-96d3-81e44902024b tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:49.717871 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c806576c-e72e-4ec7-96d3-81e44902024b tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:49.724658 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c806576c-e72e-4ec7-96d3-81e44902024b tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:49.725102 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c806576c-e72e-4ec7-96d3-81e44902024b tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:49.725856 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c806576c-e72e-4ec7-96d3-81e44902024b tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:49.726283 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c806576c-e72e-4ec7-96d3-81e44902024b tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:49.818358 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c806576c-e72e-4ec7-96d3-81e44902024b tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action" status: 200 len: 25427 microversion: 2.1 time: 0.104827 Oct 29 01:46:49.818945 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1052/2277] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:46:49 2021] POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action => generated 25427 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:46:50.345148 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ebe62e21-0c61-4e8a-ba55-73f0f63d2875 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:50.345868 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ebe62e21-0c61-4e8a-ba55-73f0f63d2875 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:50.352106 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ebe62e21-0c61-4e8a-ba55-73f0f63d2875 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:50.352555 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ebe62e21-0c61-4e8a-ba55-73f0f63d2875 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:50.353312 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ebe62e21-0c61-4e8a-ba55-73f0f63d2875 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:50.353747 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ebe62e21-0c61-4e8a-ba55-73f0f63d2875 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:50.413347 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-ebe62e21-0c61-4e8a-ba55-73f0f63d2875 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:50.421027 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ebe62e21-0c61-4e8a-ba55-73f0f63d2875 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.079581 Oct 29 01:46:50.422108 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1226/2278] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:50 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:50.630478 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-b8b26962-4165-4fc2-9bfc-1f51cb9589be tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:50.631101 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-b8b26962-4165-4fc2-9bfc-1f51cb9589be tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:50.637837 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b8b26962-4165-4fc2-9bfc-1f51cb9589be tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:50.638286 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b8b26962-4165-4fc2-9bfc-1f51cb9589be tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:50.639066 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b8b26962-4165-4fc2-9bfc-1f51cb9589be tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:50.639495 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b8b26962-4165-4fc2-9bfc-1f51cb9589be tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:50.699121 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-b8b26962-4165-4fc2-9bfc-1f51cb9589be tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:50.707561 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-b8b26962-4165-4fc2-9bfc-1f51cb9589be tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.081278 Oct 29 01:46:50.708125 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1053/2279] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:50 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:50.829888 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-055816c3-81e2-4e10-9596-e2adacb3192e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:50.830963 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-055816c3-81e2-4e10-9596-e2adacb3192e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:50.837181 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-055816c3-81e2-4e10-9596-e2adacb3192e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:50.837633 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-055816c3-81e2-4e10-9596-e2adacb3192e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:50.838406 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-055816c3-81e2-4e10-9596-e2adacb3192e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:50.838846 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-055816c3-81e2-4e10-9596-e2adacb3192e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:50.939300 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-055816c3-81e2-4e10-9596-e2adacb3192e tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action" status: 200 len: 26848 microversion: 2.1 time: 0.113145 Oct 29 01:46:50.939852 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1227/2280] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:46:50 2021] POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action => generated 26848 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:46:51.438206 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c5c98dc6-a5fb-4a24-984c-acaab7b276b6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:51.438978 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c5c98dc6-a5fb-4a24-984c-acaab7b276b6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:51.445316 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c5c98dc6-a5fb-4a24-984c-acaab7b276b6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:51.445780 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c5c98dc6-a5fb-4a24-984c-acaab7b276b6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:51.446572 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c5c98dc6-a5fb-4a24-984c-acaab7b276b6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:51.447000 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c5c98dc6-a5fb-4a24-984c-acaab7b276b6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:51.506165 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-c5c98dc6-a5fb-4a24-984c-acaab7b276b6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:51.513784 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c5c98dc6-a5fb-4a24-984c-acaab7b276b6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.079924 Oct 29 01:46:51.514341 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1054/2281] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:51 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:51.724473 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-4d8dfcc0-1481-49e4-af14-04a62cedb781 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:51.725100 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-4d8dfcc0-1481-49e4-af14-04a62cedb781 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:51.732002 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4d8dfcc0-1481-49e4-af14-04a62cedb781 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:51.732456 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4d8dfcc0-1481-49e4-af14-04a62cedb781 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:51.733219 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4d8dfcc0-1481-49e4-af14-04a62cedb781 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:51.733657 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4d8dfcc0-1481-49e4-af14-04a62cedb781 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:51.795723 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-4d8dfcc0-1481-49e4-af14-04a62cedb781 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:51.803922 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-4d8dfcc0-1481-49e4-af14-04a62cedb781 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.083595 Oct 29 01:46:51.804470 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1228/2282] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:51 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:51.951539 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f73cf5ff-f971-4c11-90b1-6c25a16ad23a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:51.952464 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f73cf5ff-f971-4c11-90b1-6c25a16ad23a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:51.958858 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f73cf5ff-f971-4c11-90b1-6c25a16ad23a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:51.959306 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f73cf5ff-f971-4c11-90b1-6c25a16ad23a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:51.960076 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f73cf5ff-f971-4c11-90b1-6c25a16ad23a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:51.960513 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f73cf5ff-f971-4c11-90b1-6c25a16ad23a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:52.058751 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f73cf5ff-f971-4c11-90b1-6c25a16ad23a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action" status: 200 len: 27660 microversion: 2.1 time: 0.111195 Oct 29 01:46:52.059302 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1055/2283] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:46:51 2021] POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action => generated 27660 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:46:52.531265 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-26630e88-980a-4594-84fd-199df0f7838c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:52.531867 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-26630e88-980a-4594-84fd-199df0f7838c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:52.538136 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-26630e88-980a-4594-84fd-199df0f7838c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:52.538614 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-26630e88-980a-4594-84fd-199df0f7838c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:52.539391 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-26630e88-980a-4594-84fd-199df0f7838c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:52.539817 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-26630e88-980a-4594-84fd-199df0f7838c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:52.601684 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-26630e88-980a-4594-84fd-199df0f7838c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:52.609884 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-26630e88-980a-4594-84fd-199df0f7838c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.082317 Oct 29 01:46:52.610454 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1229/2284] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:52 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:52.821396 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-042f3784-a083-45e7-afc8-cfc77ab7035b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:52.822091 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-042f3784-a083-45e7-afc8-cfc77ab7035b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:52.829140 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-042f3784-a083-45e7-afc8-cfc77ab7035b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:52.829590 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-042f3784-a083-45e7-afc8-cfc77ab7035b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:52.830360 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-042f3784-a083-45e7-afc8-cfc77ab7035b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:52.830816 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-042f3784-a083-45e7-afc8-cfc77ab7035b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:52.890598 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-042f3784-a083-45e7-afc8-cfc77ab7035b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:52.898821 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-042f3784-a083-45e7-afc8-cfc77ab7035b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.081465 Oct 29 01:46:52.899379 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1056/2285] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:52 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:53.070922 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-2f8c5077-4302-451e-b8b8-8bf04fc86b48 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:53.071791 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-2f8c5077-4302-451e-b8b8-8bf04fc86b48 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:53.078225 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2f8c5077-4302-451e-b8b8-8bf04fc86b48 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:53.078711 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2f8c5077-4302-451e-b8b8-8bf04fc86b48 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:53.079469 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2f8c5077-4302-451e-b8b8-8bf04fc86b48 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:53.079979 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2f8c5077-4302-451e-b8b8-8bf04fc86b48 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:53.177074 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-2f8c5077-4302-451e-b8b8-8bf04fc86b48 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action" status: 200 len: 28143 microversion: 2.1 time: 0.109741 Oct 29 01:46:53.177693 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1230/2286] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:46:53 2021] POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action => generated 28143 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:46:53.627358 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c6a59250-7938-44fa-b084-ff2671319913 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:53.627968 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c6a59250-7938-44fa-b084-ff2671319913 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:53.634215 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c6a59250-7938-44fa-b084-ff2671319913 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:53.634695 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c6a59250-7938-44fa-b084-ff2671319913 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:53.635459 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c6a59250-7938-44fa-b084-ff2671319913 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:53.635894 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c6a59250-7938-44fa-b084-ff2671319913 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:53.697267 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-c6a59250-7938-44fa-b084-ff2671319913 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:53.705881 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c6a59250-7938-44fa-b084-ff2671319913 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.082696 Oct 29 01:46:53.706452 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1057/2287] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:53 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:53.916146 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-37b9af9a-1032-4039-a321-eb933f6e584d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:53.916776 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-37b9af9a-1032-4039-a321-eb933f6e584d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:53.923675 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-37b9af9a-1032-4039-a321-eb933f6e584d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:53.924123 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-37b9af9a-1032-4039-a321-eb933f6e584d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:53.924889 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-37b9af9a-1032-4039-a321-eb933f6e584d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:53.925327 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-37b9af9a-1032-4039-a321-eb933f6e584d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:53.987316 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-37b9af9a-1032-4039-a321-eb933f6e584d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:53.995163 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-37b9af9a-1032-4039-a321-eb933f6e584d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.083100 Oct 29 01:46:53.995725 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1231/2288] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:53 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:54.189312 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-5a7ea6b6-0683-460a-89ae-970e1673c7f3 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:54.190153 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-5a7ea6b6-0683-460a-89ae-970e1673c7f3 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:54.196429 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5a7ea6b6-0683-460a-89ae-970e1673c7f3 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:54.196885 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5a7ea6b6-0683-460a-89ae-970e1673c7f3 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:54.197651 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5a7ea6b6-0683-460a-89ae-970e1673c7f3 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:54.198095 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5a7ea6b6-0683-460a-89ae-970e1673c7f3 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:54.294900 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-5a7ea6b6-0683-460a-89ae-970e1673c7f3 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action" status: 200 len: 28205 microversion: 2.1 time: 0.109825 Oct 29 01:46:54.295533 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1058/2289] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:46:54 2021] POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action => generated 28205 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:46:54.723177 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-1b61a43f-97a4-4b19-86bf-2b9639b7f97a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:54.723789 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-1b61a43f-97a4-4b19-86bf-2b9639b7f97a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:54.729935 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1b61a43f-97a4-4b19-86bf-2b9639b7f97a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:54.730377 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1b61a43f-97a4-4b19-86bf-2b9639b7f97a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:54.731187 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1b61a43f-97a4-4b19-86bf-2b9639b7f97a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:54.731616 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1b61a43f-97a4-4b19-86bf-2b9639b7f97a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:54.791082 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-1b61a43f-97a4-4b19-86bf-2b9639b7f97a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:54.798714 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-1b61a43f-97a4-4b19-86bf-2b9639b7f97a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.079303 Oct 29 01:46:54.799273 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1232/2290] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:54 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:55.012872 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-bf73dd78-d9ec-4992-a495-bc02d8e1adb6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:55.013505 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-bf73dd78-d9ec-4992-a495-bc02d8e1adb6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:55.020846 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bf73dd78-d9ec-4992-a495-bc02d8e1adb6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:55.021296 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bf73dd78-d9ec-4992-a495-bc02d8e1adb6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:55.022051 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bf73dd78-d9ec-4992-a495-bc02d8e1adb6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:55.022512 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bf73dd78-d9ec-4992-a495-bc02d8e1adb6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:55.084372 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-bf73dd78-d9ec-4992-a495-bc02d8e1adb6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:55.091986 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-bf73dd78-d9ec-4992-a495-bc02d8e1adb6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.083401 Oct 29 01:46:55.092549 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1059/2291] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:55 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:55.306688 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-08c69000-3eeb-4be1-858e-316a4cfb6a15 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:55.307511 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-08c69000-3eeb-4be1-858e-316a4cfb6a15 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:55.314288 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-08c69000-3eeb-4be1-858e-316a4cfb6a15 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:55.314764 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-08c69000-3eeb-4be1-858e-316a4cfb6a15 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:55.315526 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-08c69000-3eeb-4be1-858e-316a4cfb6a15 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:55.315958 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-08c69000-3eeb-4be1-858e-316a4cfb6a15 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:55.418050 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-08c69000-3eeb-4be1-858e-316a4cfb6a15 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action" status: 200 len: 28230 microversion: 2.1 time: 0.114884 Oct 29 01:46:55.418963 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1233/2292] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:46:55 2021] POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action => generated 28230 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:46:55.817205 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-674e740d-f312-466d-83b7-f60399cb1484 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:55.817851 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-674e740d-f312-466d-83b7-f60399cb1484 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:55.824059 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-674e740d-f312-466d-83b7-f60399cb1484 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:55.824515 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-674e740d-f312-466d-83b7-f60399cb1484 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:55.825280 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-674e740d-f312-466d-83b7-f60399cb1484 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:55.825971 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-674e740d-f312-466d-83b7-f60399cb1484 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:55.888229 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-674e740d-f312-466d-83b7-f60399cb1484 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:55.895942 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-674e740d-f312-466d-83b7-f60399cb1484 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.084292 Oct 29 01:46:55.896505 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1060/2293] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:55 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:56.109862 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b608098f-fbec-41af-81e4-a45269215052 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:56.110582 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b608098f-fbec-41af-81e4-a45269215052 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:56.117362 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b608098f-fbec-41af-81e4-a45269215052 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:56.117811 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b608098f-fbec-41af-81e4-a45269215052 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:56.118600 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b608098f-fbec-41af-81e4-a45269215052 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:56.119039 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b608098f-fbec-41af-81e4-a45269215052 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:56.179844 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-b608098f-fbec-41af-81e4-a45269215052 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:56.188100 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b608098f-fbec-41af-81e4-a45269215052 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.082782 Oct 29 01:46:56.188686 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1234/2294] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:56 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:56.430596 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d0e3c59a-478e-4115-b7f9-2662cc6f47dc tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:56.431466 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d0e3c59a-478e-4115-b7f9-2662cc6f47dc tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:56.438215 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d0e3c59a-478e-4115-b7f9-2662cc6f47dc tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:56.438694 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d0e3c59a-478e-4115-b7f9-2662cc6f47dc tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:56.439485 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d0e3c59a-478e-4115-b7f9-2662cc6f47dc tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:56.440035 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d0e3c59a-478e-4115-b7f9-2662cc6f47dc tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:56.531539 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d0e3c59a-478e-4115-b7f9-2662cc6f47dc tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action" status: 200 len: 28496 microversion: 2.1 time: 0.104740 Oct 29 01:46:56.532168 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1061/2295] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:46:56 2021] POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action => generated 28496 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:46:56.912545 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-8fd5f60f-5347-4733-8948-de5686ee363a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:56.913148 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-8fd5f60f-5347-4733-8948-de5686ee363a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:56.919405 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8fd5f60f-5347-4733-8948-de5686ee363a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:56.919851 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8fd5f60f-5347-4733-8948-de5686ee363a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:56.920602 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8fd5f60f-5347-4733-8948-de5686ee363a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:56.921535 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8fd5f60f-5347-4733-8948-de5686ee363a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:56.982780 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-8fd5f60f-5347-4733-8948-de5686ee363a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:56.991190 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-8fd5f60f-5347-4733-8948-de5686ee363a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.082317 Oct 29 01:46:56.991755 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1235/2296] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:56 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:46:57.205177 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e8c03d0f-955c-40f4-b0fe-f98f4ff5b2ec tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:57.205875 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-e8c03d0f-955c-40f4-b0fe-f98f4ff5b2ec tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:57.212747 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e8c03d0f-955c-40f4-b0fe-f98f4ff5b2ec tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:57.213194 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e8c03d0f-955c-40f4-b0fe-f98f4ff5b2ec tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:57.213955 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e8c03d0f-955c-40f4-b0fe-f98f4ff5b2ec tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:57.214413 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e8c03d0f-955c-40f4-b0fe-f98f4ff5b2ec tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:57.274839 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-e8c03d0f-955c-40f4-b0fe-f98f4ff5b2ec tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:57.282487 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-e8c03d0f-955c-40f4-b0fe-f98f4ff5b2ec tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.081630 Oct 29 01:46:57.283047 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1062/2297] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:57 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:57.543141 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f08c2ae3-6da4-4c6a-9d28-714302eee216 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:57.543977 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f08c2ae3-6da4-4c6a-9d28-714302eee216 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:57.550636 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f08c2ae3-6da4-4c6a-9d28-714302eee216 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:57.551093 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f08c2ae3-6da4-4c6a-9d28-714302eee216 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:57.551849 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f08c2ae3-6da4-4c6a-9d28-714302eee216 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:57.552285 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f08c2ae3-6da4-4c6a-9d28-714302eee216 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:57.657058 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f08c2ae3-6da4-4c6a-9d28-714302eee216 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action" status: 200 len: 28664 microversion: 2.1 time: 0.117607 Oct 29 01:46:57.657685 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1236/2298] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:46:57 2021] POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action => generated 28664 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:46:58.008223 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-a51ba7df-db92-476f-bc09-a7e5666089f2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:58.008834 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-a51ba7df-db92-476f-bc09-a7e5666089f2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:58.015053 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a51ba7df-db92-476f-bc09-a7e5666089f2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:58.015459 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a51ba7df-db92-476f-bc09-a7e5666089f2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:58.016218 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a51ba7df-db92-476f-bc09-a7e5666089f2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:58.016650 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a51ba7df-db92-476f-bc09-a7e5666089f2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:58.075262 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-a51ba7df-db92-476f-bc09-a7e5666089f2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:58.083269 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-a51ba7df-db92-476f-bc09-a7e5666089f2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.078697 Oct 29 01:46:58.083826 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1063/2299] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:58 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:58.299455 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-2dcf4aa3-9a32-4f88-9953-724a15beffd1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:58.300065 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-2dcf4aa3-9a32-4f88-9953-724a15beffd1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:58.306850 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2dcf4aa3-9a32-4f88-9953-724a15beffd1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:58.307297 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2dcf4aa3-9a32-4f88-9953-724a15beffd1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:58.308053 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2dcf4aa3-9a32-4f88-9953-724a15beffd1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:58.308488 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2dcf4aa3-9a32-4f88-9953-724a15beffd1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:58.367655 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-2dcf4aa3-9a32-4f88-9953-724a15beffd1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:58.375679 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-2dcf4aa3-9a32-4f88-9953-724a15beffd1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.080369 Oct 29 01:46:58.376237 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1237/2300] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:58 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:58.668455 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-fada3105-fa97-4531-9904-72a32cae2265 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:58.669376 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-fada3105-fa97-4531-9904-72a32cae2265 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:58.676176 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fada3105-fa97-4531-9904-72a32cae2265 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:58.676629 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fada3105-fa97-4531-9904-72a32cae2265 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:58.677387 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fada3105-fa97-4531-9904-72a32cae2265 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:58.677825 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fada3105-fa97-4531-9904-72a32cae2265 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:58.768094 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-fada3105-fa97-4531-9904-72a32cae2265 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action" status: 200 len: 28664 microversion: 2.1 time: 0.103112 Oct 29 01:46:58.768731 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1064/2301] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:46:58 2021] POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action => generated 28664 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:46:59.099631 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-40f43822-1328-491d-b0f7-e5140d026e21 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:59.100247 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-40f43822-1328-491d-b0f7-e5140d026e21 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:59.106635 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-40f43822-1328-491d-b0f7-e5140d026e21 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:59.107082 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-40f43822-1328-491d-b0f7-e5140d026e21 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:59.107837 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-40f43822-1328-491d-b0f7-e5140d026e21 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:59.108268 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-40f43822-1328-491d-b0f7-e5140d026e21 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:59.170037 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-40f43822-1328-491d-b0f7-e5140d026e21 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:59.178202 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-40f43822-1328-491d-b0f7-e5140d026e21 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.082222 Oct 29 01:46:59.178787 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1238/2302] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:59 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:59.392566 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-488ea60b-dde3-4030-8529-b40badb6a575 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:59.393284 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-488ea60b-dde3-4030-8529-b40badb6a575 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:59.400112 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-488ea60b-dde3-4030-8529-b40badb6a575 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:59.400558 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-488ea60b-dde3-4030-8529-b40badb6a575 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:59.401311 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-488ea60b-dde3-4030-8529-b40badb6a575 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:59.401740 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-488ea60b-dde3-4030-8529-b40badb6a575 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:59.472213 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-488ea60b-dde3-4030-8529-b40badb6a575 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:59.480340 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-488ea60b-dde3-4030-8529-b40badb6a575 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.091869 Oct 29 01:46:59.480897 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1065/2303] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:46:59 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:59.779562 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f47fcbfa-1cf9-4061-8edb-61f466e088a3 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:59.781074 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f47fcbfa-1cf9-4061-8edb-61f466e088a3 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:46:59.787413 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f47fcbfa-1cf9-4061-8edb-61f466e088a3 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:59.787863 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f47fcbfa-1cf9-4061-8edb-61f466e088a3 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:59.788628 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f47fcbfa-1cf9-4061-8edb-61f466e088a3 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:46:59.789059 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f47fcbfa-1cf9-4061-8edb-61f466e088a3 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:46:59.876985 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f47fcbfa-1cf9-4061-8edb-61f466e088a3 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action" status: 200 len: 28664 microversion: 2.1 time: 0.101063 Oct 29 01:46:59.877594 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1239/2304] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:46:59 2021] POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action => generated 28664 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:47:00.195415 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f2c27580-be28-4215-b7b5-dd2b192dc7a6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:00.196023 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f2c27580-be28-4215-b7b5-dd2b192dc7a6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:00.203164 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f2c27580-be28-4215-b7b5-dd2b192dc7a6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:00.203612 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f2c27580-be28-4215-b7b5-dd2b192dc7a6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:00.204370 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f2c27580-be28-4215-b7b5-dd2b192dc7a6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:00.204801 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f2c27580-be28-4215-b7b5-dd2b192dc7a6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:00.266034 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-f2c27580-be28-4215-b7b5-dd2b192dc7a6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:00.273880 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f2c27580-be28-4215-b7b5-dd2b192dc7a6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.082107 Oct 29 01:47:00.274460 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1066/2305] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:00 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:00.498195 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-1a45f89d-927a-4b7f-84f0-bd33110e9114 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:00.498843 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-1a45f89d-927a-4b7f-84f0-bd33110e9114 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:00.506207 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1a45f89d-927a-4b7f-84f0-bd33110e9114 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:00.506675 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1a45f89d-927a-4b7f-84f0-bd33110e9114 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:00.507432 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1a45f89d-927a-4b7f-84f0-bd33110e9114 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:00.507861 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1a45f89d-927a-4b7f-84f0-bd33110e9114 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:00.567954 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-1a45f89d-927a-4b7f-84f0-bd33110e9114 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:00.576820 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-1a45f89d-927a-4b7f-84f0-bd33110e9114 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.082702 Oct 29 01:47:00.577459 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1240/2306] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:00 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:00.888489 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f0b44a47-9878-45f5-84f3-598af2df7ec4 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:47:00.889437 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f0b44a47-9878-45f5-84f3-598af2df7ec4 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:00.895741 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f0b44a47-9878-45f5-84f3-598af2df7ec4 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:00.896350 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f0b44a47-9878-45f5-84f3-598af2df7ec4 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:00.897108 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f0b44a47-9878-45f5-84f3-598af2df7ec4 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:00.897541 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f0b44a47-9878-45f5-84f3-598af2df7ec4 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:01.004219 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f0b44a47-9878-45f5-84f3-598af2df7ec4 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action" status: 200 len: 29400 microversion: 2.1 time: 0.119427 Oct 29 01:47:01.004859 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1067/2307] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:47:00 2021] POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action => generated 29400 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:47:01.290853 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c2263080-d772-4d5e-aed5-d13a02eda11f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:01.291470 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c2263080-d772-4d5e-aed5-d13a02eda11f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:01.297689 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c2263080-d772-4d5e-aed5-d13a02eda11f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:01.298141 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c2263080-d772-4d5e-aed5-d13a02eda11f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:01.298928 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c2263080-d772-4d5e-aed5-d13a02eda11f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:01.299365 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c2263080-d772-4d5e-aed5-d13a02eda11f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:01.357972 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c2263080-d772-4d5e-aed5-d13a02eda11f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:01.366000 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c2263080-d772-4d5e-aed5-d13a02eda11f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.078826 Oct 29 01:47:01.366581 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1241/2308] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:01 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:01.593356 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-718f8833-d78c-4a3d-b335-0996f1e30aa6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:01.594080 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-718f8833-d78c-4a3d-b335-0996f1e30aa6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:01.600886 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-718f8833-d78c-4a3d-b335-0996f1e30aa6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:01.601332 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-718f8833-d78c-4a3d-b335-0996f1e30aa6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:01.602245 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-718f8833-d78c-4a3d-b335-0996f1e30aa6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:01.602710 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-718f8833-d78c-4a3d-b335-0996f1e30aa6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:01.662377 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-718f8833-d78c-4a3d-b335-0996f1e30aa6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:01.670592 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-718f8833-d78c-4a3d-b335-0996f1e30aa6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.081222 Oct 29 01:47:01.671148 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1068/2309] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:01 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:02.016265 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f42211b3-1c2c-4d0f-a77e-3dcdbb1e38c1 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:47:02.017180 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-f42211b3-1c2c-4d0f-a77e-3dcdbb1e38c1 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:02.023523 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f42211b3-1c2c-4d0f-a77e-3dcdbb1e38c1 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:02.023971 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f42211b3-1c2c-4d0f-a77e-3dcdbb1e38c1 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:02.024734 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f42211b3-1c2c-4d0f-a77e-3dcdbb1e38c1 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:02.025166 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-f42211b3-1c2c-4d0f-a77e-3dcdbb1e38c1 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:02.118859 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f42211b3-1c2c-4d0f-a77e-3dcdbb1e38c1 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action" status: 200 len: 31580 microversion: 2.1 time: 0.106688 Oct 29 01:47:02.119485 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1242/2310] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:47:02 2021] POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action => generated 31580 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:47:02.382951 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-334a9054-124e-4dec-bf24-d801738f54eb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:02.383555 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-334a9054-124e-4dec-bf24-d801738f54eb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:02.389642 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-334a9054-124e-4dec-bf24-d801738f54eb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:02.390087 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-334a9054-124e-4dec-bf24-d801738f54eb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:02.390882 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-334a9054-124e-4dec-bf24-d801738f54eb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:02.391312 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-334a9054-124e-4dec-bf24-d801738f54eb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:02.453543 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-334a9054-124e-4dec-bf24-d801738f54eb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:02.461320 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-334a9054-124e-4dec-bf24-d801738f54eb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.082285 Oct 29 01:47:02.461881 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1069/2311] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:02 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:02.688169 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-cd52ef61-8aac-4dcb-90c2-0f8863e7af85 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:02.688790 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-cd52ef61-8aac-4dcb-90c2-0f8863e7af85 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:02.695657 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cd52ef61-8aac-4dcb-90c2-0f8863e7af85 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:02.696111 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cd52ef61-8aac-4dcb-90c2-0f8863e7af85 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:02.696877 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cd52ef61-8aac-4dcb-90c2-0f8863e7af85 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:02.697316 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cd52ef61-8aac-4dcb-90c2-0f8863e7af85 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:02.761235 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-cd52ef61-8aac-4dcb-90c2-0f8863e7af85 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:02.769940 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-cd52ef61-8aac-4dcb-90c2-0f8863e7af85 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.086387 Oct 29 01:47:02.770505 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1243/2312] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:02 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:03.130455 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-b842b460-9062-452e-a34a-75c604348faf tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:47:03.131370 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-b842b460-9062-452e-a34a-75c604348faf tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:03.137473 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b842b460-9062-452e-a34a-75c604348faf tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:03.137921 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b842b460-9062-452e-a34a-75c604348faf tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:03.138705 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b842b460-9062-452e-a34a-75c604348faf tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:03.139140 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b842b460-9062-452e-a34a-75c604348faf tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:03.231797 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-b842b460-9062-452e-a34a-75c604348faf tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action" status: 200 len: 33138 microversion: 2.1 time: 0.104830 Oct 29 01:47:03.232342 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1070/2313] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:47:03 2021] POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action => generated 33138 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:47:03.477576 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-04c491b4-d1a7-49d5-b344-e1bfdbdfd823 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:03.478184 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-04c491b4-d1a7-49d5-b344-e1bfdbdfd823 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:03.484603 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-04c491b4-d1a7-49d5-b344-e1bfdbdfd823 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:03.484993 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-04c491b4-d1a7-49d5-b344-e1bfdbdfd823 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:03.485748 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-04c491b4-d1a7-49d5-b344-e1bfdbdfd823 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:03.486188 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-04c491b4-d1a7-49d5-b344-e1bfdbdfd823 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:03.546855 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-04c491b4-d1a7-49d5-b344-e1bfdbdfd823 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:03.554660 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-04c491b4-d1a7-49d5-b344-e1bfdbdfd823 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.080733 Oct 29 01:47:03.555208 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1244/2314] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:03 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:03.786146 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d1c7b328-89c4-410c-ab77-53f940bf59f6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:03.786790 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d1c7b328-89c4-410c-ab77-53f940bf59f6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:03.793533 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d1c7b328-89c4-410c-ab77-53f940bf59f6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:03.793983 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d1c7b328-89c4-410c-ab77-53f940bf59f6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:03.794776 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d1c7b328-89c4-410c-ab77-53f940bf59f6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:03.795213 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d1c7b328-89c4-410c-ab77-53f940bf59f6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:03.855571 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-d1c7b328-89c4-410c-ab77-53f940bf59f6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:03.863883 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d1c7b328-89c4-410c-ab77-53f940bf59f6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.081940 Oct 29 01:47:03.864441 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1071/2315] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:03 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:04.243673 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a8367161-bd87-4a7b-b6d7-c35336f3ed99 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:47:04.244588 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a8367161-bd87-4a7b-b6d7-c35336f3ed99 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:04.251474 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a8367161-bd87-4a7b-b6d7-c35336f3ed99 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:04.251920 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a8367161-bd87-4a7b-b6d7-c35336f3ed99 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:04.252676 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a8367161-bd87-4a7b-b6d7-c35336f3ed99 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:04.253108 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a8367161-bd87-4a7b-b6d7-c35336f3ed99 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:04.344344 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a8367161-bd87-4a7b-b6d7-c35336f3ed99 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action" status: 200 len: 34036 microversion: 2.1 time: 0.103596 Oct 29 01:47:04.344974 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1245/2316] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:47:04 2021] POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action => generated 34036 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:47:04.571851 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-1a7263e3-426c-4c66-a307-9386ef691ef9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:04.572400 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-1a7263e3-426c-4c66-a307-9386ef691ef9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:04.579006 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1a7263e3-426c-4c66-a307-9386ef691ef9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:04.579453 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1a7263e3-426c-4c66-a307-9386ef691ef9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:04.580205 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1a7263e3-426c-4c66-a307-9386ef691ef9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:04.580635 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1a7263e3-426c-4c66-a307-9386ef691ef9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:04.638621 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-1a7263e3-426c-4c66-a307-9386ef691ef9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:04.646318 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-1a7263e3-426c-4c66-a307-9386ef691ef9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.078185 Oct 29 01:47:04.646914 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1072/2317] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:04 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:04.880749 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-2736d8ec-a789-4423-a890-9666acda010a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:04.881442 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-2736d8ec-a789-4423-a890-9666acda010a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:04.888182 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2736d8ec-a789-4423-a890-9666acda010a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:04.888629 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2736d8ec-a789-4423-a890-9666acda010a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:04.889378 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2736d8ec-a789-4423-a890-9666acda010a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:04.889808 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2736d8ec-a789-4423-a890-9666acda010a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:04.949767 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-2736d8ec-a789-4423-a890-9666acda010a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:04.958501 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-2736d8ec-a789-4423-a890-9666acda010a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.081233 Oct 29 01:47:04.958813 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1246/2318] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:04 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:05.356277 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-ea16dbf4-fa51-45d9-9aa8-9e9bed3db177 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:47:05.357220 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-ea16dbf4-fa51-45d9-9aa8-9e9bed3db177 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:05.363564 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ea16dbf4-fa51-45d9-9aa8-9e9bed3db177 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:05.364019 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ea16dbf4-fa51-45d9-9aa8-9e9bed3db177 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:05.364791 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ea16dbf4-fa51-45d9-9aa8-9e9bed3db177 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:05.365230 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-ea16dbf4-fa51-45d9-9aa8-9e9bed3db177 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:05.477347 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-ea16dbf4-fa51-45d9-9aa8-9e9bed3db177 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action" status: 200 len: 35167 microversion: 2.1 time: 0.124672 Oct 29 01:47:05.477971 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1073/2319] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:47:05 2021] POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action => generated 35167 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:47:05.663278 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-305d5772-5ce0-4fc9-af33-42ddae1e0c12 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:05.663805 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-305d5772-5ce0-4fc9-af33-42ddae1e0c12 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:05.670044 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-305d5772-5ce0-4fc9-af33-42ddae1e0c12 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:05.670527 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-305d5772-5ce0-4fc9-af33-42ddae1e0c12 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:05.671305 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-305d5772-5ce0-4fc9-af33-42ddae1e0c12 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:05.672382 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-305d5772-5ce0-4fc9-af33-42ddae1e0c12 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:05.733109 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-305d5772-5ce0-4fc9-af33-42ddae1e0c12 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:05.741631 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-305d5772-5ce0-4fc9-af33-42ddae1e0c12 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.082167 Oct 29 01:47:05.742346 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1247/2320] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:05 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:05.975318 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-b6a9c003-bb6b-4620-a9ea-6a6cd9b0bb46 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:05.976018 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-b6a9c003-bb6b-4620-a9ea-6a6cd9b0bb46 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:05.982744 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b6a9c003-bb6b-4620-a9ea-6a6cd9b0bb46 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:05.983197 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b6a9c003-bb6b-4620-a9ea-6a6cd9b0bb46 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:05.983955 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b6a9c003-bb6b-4620-a9ea-6a6cd9b0bb46 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:05.984381 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b6a9c003-bb6b-4620-a9ea-6a6cd9b0bb46 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:06.044060 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-b6a9c003-bb6b-4620-a9ea-6a6cd9b0bb46 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:06.052193 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-b6a9c003-bb6b-4620-a9ea-6a6cd9b0bb46 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.080865 Oct 29 01:47:06.052757 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1074/2321] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:05 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:06.489044 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9be9d3f2-95c0-4e94-b446-06d586b6a3b7 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:47:06.490049 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9be9d3f2-95c0-4e94-b446-06d586b6a3b7 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:06.496346 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9be9d3f2-95c0-4e94-b446-06d586b6a3b7 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:06.496796 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9be9d3f2-95c0-4e94-b446-06d586b6a3b7 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:06.497571 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9be9d3f2-95c0-4e94-b446-06d586b6a3b7 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:06.497983 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9be9d3f2-95c0-4e94-b446-06d586b6a3b7 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:06.590757 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9be9d3f2-95c0-4e94-b446-06d586b6a3b7 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action" status: 200 len: 36496 microversion: 2.1 time: 0.105244 Oct 29 01:47:06.591433 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1248/2322] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:47:06 2021] POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action => generated 36496 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:47:06.757727 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e57cb35b-09ff-4da5-ad3b-40ba41bc2745 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:06.758263 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-e57cb35b-09ff-4da5-ad3b-40ba41bc2745 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:06.764507 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e57cb35b-09ff-4da5-ad3b-40ba41bc2745 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:06.764959 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e57cb35b-09ff-4da5-ad3b-40ba41bc2745 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:06.765724 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e57cb35b-09ff-4da5-ad3b-40ba41bc2745 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:06.766164 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e57cb35b-09ff-4da5-ad3b-40ba41bc2745 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:06.824677 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-e57cb35b-09ff-4da5-ad3b-40ba41bc2745 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:06.832827 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-e57cb35b-09ff-4da5-ad3b-40ba41bc2745 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.078903 Oct 29 01:47:06.833382 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1075/2323] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:06 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:07.069482 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-4bcdb6af-8328-4dbb-a355-41e545e6c6d1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:07.070221 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-4bcdb6af-8328-4dbb-a355-41e545e6c6d1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:07.077237 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4bcdb6af-8328-4dbb-a355-41e545e6c6d1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:07.077688 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4bcdb6af-8328-4dbb-a355-41e545e6c6d1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:07.078483 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4bcdb6af-8328-4dbb-a355-41e545e6c6d1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:07.078921 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4bcdb6af-8328-4dbb-a355-41e545e6c6d1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:07.146954 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-4bcdb6af-8328-4dbb-a355-41e545e6c6d1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:07.154774 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-4bcdb6af-8328-4dbb-a355-41e545e6c6d1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.089270 Oct 29 01:47:07.155333 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1249/2324] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:07 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:07.602102 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-154080ca-94fd-4d23-aab9-7f6764e5adec tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:47:07.603077 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-154080ca-94fd-4d23-aab9-7f6764e5adec tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:07.609347 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-154080ca-94fd-4d23-aab9-7f6764e5adec tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:07.609792 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-154080ca-94fd-4d23-aab9-7f6764e5adec tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:07.610742 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-154080ca-94fd-4d23-aab9-7f6764e5adec tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:07.611180 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-154080ca-94fd-4d23-aab9-7f6764e5adec tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:07.708576 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-154080ca-94fd-4d23-aab9-7f6764e5adec tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action" status: 200 len: 38002 microversion: 2.1 time: 0.110021 Oct 29 01:47:07.709213 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1076/2325] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:47:07 2021] POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action => generated 38002 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:47:07.849974 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c19e5f47-186d-4e22-8518-18a5c6a464b9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:07.850621 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c19e5f47-186d-4e22-8518-18a5c6a464b9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:07.856881 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c19e5f47-186d-4e22-8518-18a5c6a464b9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:07.857270 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c19e5f47-186d-4e22-8518-18a5c6a464b9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:07.858025 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c19e5f47-186d-4e22-8518-18a5c6a464b9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:07.858487 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c19e5f47-186d-4e22-8518-18a5c6a464b9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:07.922476 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c19e5f47-186d-4e22-8518-18a5c6a464b9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:07.930175 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c19e5f47-186d-4e22-8518-18a5c6a464b9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.083808 Oct 29 01:47:07.930768 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1250/2326] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:07 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:08.172914 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-98ded080-3e35-4491-a8f3-e68868b28219 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:08.173530 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-98ded080-3e35-4491-a8f3-e68868b28219 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:08.180318 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-98ded080-3e35-4491-a8f3-e68868b28219 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:08.180767 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-98ded080-3e35-4491-a8f3-e68868b28219 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:08.181533 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-98ded080-3e35-4491-a8f3-e68868b28219 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:08.181971 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-98ded080-3e35-4491-a8f3-e68868b28219 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:08.242537 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-98ded080-3e35-4491-a8f3-e68868b28219 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:08.250318 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-98ded080-3e35-4491-a8f3-e68868b28219 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.082152 Oct 29 01:47:08.250903 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1077/2327] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:08 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:08.720348 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ea31eb00-400e-445e-92c3-d4476b6abfae tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:47:08.721260 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ea31eb00-400e-445e-92c3-d4476b6abfae tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:08.727577 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ea31eb00-400e-445e-92c3-d4476b6abfae tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:08.728032 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ea31eb00-400e-445e-92c3-d4476b6abfae tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:08.728791 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ea31eb00-400e-445e-92c3-d4476b6abfae tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:08.729222 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ea31eb00-400e-445e-92c3-d4476b6abfae tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:08.825198 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ea31eb00-400e-445e-92c3-d4476b6abfae tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action" status: 200 len: 38199 microversion: 2.1 time: 0.108469 Oct 29 01:47:08.826111 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1251/2328] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:47:08 2021] POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action => generated 38199 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:47:08.947391 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-58073998-2ac3-4d59-8daa-bb1f49a803df tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:08.948044 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-58073998-2ac3-4d59-8daa-bb1f49a803df tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:08.955468 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-58073998-2ac3-4d59-8daa-bb1f49a803df tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:08.955921 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-58073998-2ac3-4d59-8daa-bb1f49a803df tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:08.956694 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-58073998-2ac3-4d59-8daa-bb1f49a803df tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:08.957133 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-58073998-2ac3-4d59-8daa-bb1f49a803df tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:09.018974 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-58073998-2ac3-4d59-8daa-bb1f49a803df tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:09.026650 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-58073998-2ac3-4d59-8daa-bb1f49a803df tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.082905 Oct 29 01:47:09.027210 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1078/2329] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:08 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:09.267218 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-45188dad-090c-4ec1-a420-53a782e533c3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:09.267844 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-45188dad-090c-4ec1-a420-53a782e533c3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:09.274666 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-45188dad-090c-4ec1-a420-53a782e533c3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:09.275115 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-45188dad-090c-4ec1-a420-53a782e533c3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:09.275880 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-45188dad-090c-4ec1-a420-53a782e533c3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:09.276316 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-45188dad-090c-4ec1-a420-53a782e533c3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:09.336771 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-45188dad-090c-4ec1-a420-53a782e533c3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:09.345481 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-45188dad-090c-4ec1-a420-53a782e533c3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.082441 Oct 29 01:47:09.346056 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1252/2330] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:09 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:09.837731 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-5c6cc63b-6511-4770-a21c-a58fbb291137 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:47:09.838679 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-5c6cc63b-6511-4770-a21c-a58fbb291137 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:09.845247 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5c6cc63b-6511-4770-a21c-a58fbb291137 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:09.845718 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5c6cc63b-6511-4770-a21c-a58fbb291137 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:09.846678 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5c6cc63b-6511-4770-a21c-a58fbb291137 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:09.847111 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5c6cc63b-6511-4770-a21c-a58fbb291137 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:09.931839 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-5c6cc63b-6511-4770-a21c-a58fbb291137 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action" status: 200 len: 38199 microversion: 2.1 time: 0.097679 Oct 29 01:47:09.932456 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1079/2331] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:47:09 2021] POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action => generated 38199 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:47:10.043052 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-2db4c995-8545-48e6-887b-122d9cdea4b1 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:10.043654 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-2db4c995-8545-48e6-887b-122d9cdea4b1 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:10.050284 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2db4c995-8545-48e6-887b-122d9cdea4b1 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:10.050765 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2db4c995-8545-48e6-887b-122d9cdea4b1 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:10.051548 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2db4c995-8545-48e6-887b-122d9cdea4b1 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:10.051977 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2db4c995-8545-48e6-887b-122d9cdea4b1 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:10.111190 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-2db4c995-8545-48e6-887b-122d9cdea4b1 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:10.118888 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-2db4c995-8545-48e6-887b-122d9cdea4b1 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.079443 Oct 29 01:47:10.119430 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1253/2332] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:10 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:10.363402 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-0052055a-e2b7-49e6-b0bd-e182f7b7fe79 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:10.364056 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-0052055a-e2b7-49e6-b0bd-e182f7b7fe79 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:10.370823 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0052055a-e2b7-49e6-b0bd-e182f7b7fe79 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:10.371275 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0052055a-e2b7-49e6-b0bd-e182f7b7fe79 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:10.372033 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0052055a-e2b7-49e6-b0bd-e182f7b7fe79 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:10.372488 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0052055a-e2b7-49e6-b0bd-e182f7b7fe79 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:10.435537 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-0052055a-e2b7-49e6-b0bd-e182f7b7fe79 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:10.443807 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-0052055a-e2b7-49e6-b0bd-e182f7b7fe79 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.085354 Oct 29 01:47:10.444371 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1080/2333] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:10 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:10.943023 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-8f37fb15-dd31-4501-ab39-4dea5bf2b04b tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:47:10.943947 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-8f37fb15-dd31-4501-ab39-4dea5bf2b04b tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:10.951007 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8f37fb15-dd31-4501-ab39-4dea5bf2b04b tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:10.951555 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8f37fb15-dd31-4501-ab39-4dea5bf2b04b tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:10.952383 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8f37fb15-dd31-4501-ab39-4dea5bf2b04b tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:10.953407 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-8f37fb15-dd31-4501-ab39-4dea5bf2b04b tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:11.038573 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-8f37fb15-dd31-4501-ab39-4dea5bf2b04b tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action" status: 200 len: 38199 microversion: 2.1 time: 0.099028 Oct 29 01:47:11.039206 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1254/2334] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:47:10 2021] POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action => generated 38199 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:47:11.134515 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c2353eaa-2b56-4521-a73f-6f355ac0e861 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:11.135121 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c2353eaa-2b56-4521-a73f-6f355ac0e861 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:11.141851 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c2353eaa-2b56-4521-a73f-6f355ac0e861 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:11.142294 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c2353eaa-2b56-4521-a73f-6f355ac0e861 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:11.143070 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c2353eaa-2b56-4521-a73f-6f355ac0e861 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:11.143499 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c2353eaa-2b56-4521-a73f-6f355ac0e861 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:11.204014 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-c2353eaa-2b56-4521-a73f-6f355ac0e861 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:11.211790 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c2353eaa-2b56-4521-a73f-6f355ac0e861 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.081042 Oct 29 01:47:11.212345 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1081/2335] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:11 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:11.461168 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-5fa8620b-4397-45c2-84f3-c642672a9dbc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:11.461791 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-5fa8620b-4397-45c2-84f3-c642672a9dbc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:11.468833 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5fa8620b-4397-45c2-84f3-c642672a9dbc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:11.469306 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5fa8620b-4397-45c2-84f3-c642672a9dbc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:11.470060 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5fa8620b-4397-45c2-84f3-c642672a9dbc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:11.470521 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5fa8620b-4397-45c2-84f3-c642672a9dbc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:11.529685 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-5fa8620b-4397-45c2-84f3-c642672a9dbc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:11.538202 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-5fa8620b-4397-45c2-84f3-c642672a9dbc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.081135 Oct 29 01:47:11.538795 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1255/2336] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:11 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:12.050712 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-332d1a69-cec8-42f1-b2ab-d679960ab3aa tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:47:12.051636 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-332d1a69-cec8-42f1-b2ab-d679960ab3aa tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:12.057851 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-332d1a69-cec8-42f1-b2ab-d679960ab3aa tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:12.058306 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-332d1a69-cec8-42f1-b2ab-d679960ab3aa tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:12.059105 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-332d1a69-cec8-42f1-b2ab-d679960ab3aa tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:12.059546 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-332d1a69-cec8-42f1-b2ab-d679960ab3aa tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:12.150749 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-332d1a69-cec8-42f1-b2ab-d679960ab3aa tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action" status: 200 len: 38330 microversion: 2.1 time: 0.103994 Oct 29 01:47:12.151374 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1082/2337] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:47:12 2021] POST /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/action => generated 38330 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:47:12.160940 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-96a5e606-41e9-4cea-b7e5-f0c3e4fa45a0 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:12.161438 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-96a5e606-41e9-4cea-b7e5-f0c3e4fa45a0 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:12.167784 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-96a5e606-41e9-4cea-b7e5-f0c3e4fa45a0 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:12.168241 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-96a5e606-41e9-4cea-b7e5-f0c3e4fa45a0 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:12.169007 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-96a5e606-41e9-4cea-b7e5-f0c3e4fa45a0 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:12.169446 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-96a5e606-41e9-4cea-b7e5-f0c3e4fa45a0 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:12.192902 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-96a5e606-41e9-4cea-b7e5-f0c3e4fa45a0 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "GET /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/ips" status: 200 len: 146 microversion: 2.1 time: 0.035649 Oct 29 01:47:12.193473 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1256/2338] 10.222.0.90 () {58 vars in 1247 bytes} [Fri Oct 29 01:47:12 2021] GET /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019/ips => generated 146 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:47:12.228761 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f332ede3-4145-4206-89d7-ee3abeb4df94 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:12.229399 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f332ede3-4145-4206-89d7-ee3abeb4df94 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:12.236804 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f332ede3-4145-4206-89d7-ee3abeb4df94 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:12.237252 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f332ede3-4145-4206-89d7-ee3abeb4df94 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:12.238016 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f332ede3-4145-4206-89d7-ee3abeb4df94 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:12.238475 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f332ede3-4145-4206-89d7-ee3abeb4df94 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:12.302030 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-f332ede3-4145-4206-89d7-ee3abeb4df94 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:12.310341 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f332ede3-4145-4206-89d7-ee3abeb4df94 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.085648 Oct 29 01:47:12.310931 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1083/2339] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:12 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:12.555263 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-02fb9e15-b74e-45a7-918f-bf79ffe3a2c0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:12.555814 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-02fb9e15-b74e-45a7-918f-bf79ffe3a2c0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:12.562042 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-02fb9e15-b74e-45a7-918f-bf79ffe3a2c0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:12.562539 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-02fb9e15-b74e-45a7-918f-bf79ffe3a2c0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:12.563292 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-02fb9e15-b74e-45a7-918f-bf79ffe3a2c0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:12.563721 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-02fb9e15-b74e-45a7-918f-bf79ffe3a2c0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:12.624114 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-02fb9e15-b74e-45a7-918f-bf79ffe3a2c0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:12.632211 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-02fb9e15-b74e-45a7-918f-bf79ffe3a2c0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.080688 Oct 29 01:47:12.632790 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1257/2340] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:12 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:13.328780 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-dae39974-527c-42f0-8512-a59d54744f7f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:13.329487 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-dae39974-527c-42f0-8512-a59d54744f7f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:13.335978 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dae39974-527c-42f0-8512-a59d54744f7f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:13.336430 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dae39974-527c-42f0-8512-a59d54744f7f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:13.337203 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dae39974-527c-42f0-8512-a59d54744f7f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:13.337643 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dae39974-527c-42f0-8512-a59d54744f7f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:13.397271 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-dae39974-527c-42f0-8512-a59d54744f7f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:13.405394 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-dae39974-527c-42f0-8512-a59d54744f7f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.081225 Oct 29 01:47:13.405966 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1084/2341] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:13 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:13.648706 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-601afb5d-512a-44b8-abbc-2e2d9ff62a58 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:13.649307 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-601afb5d-512a-44b8-abbc-2e2d9ff62a58 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:13.657441 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-601afb5d-512a-44b8-abbc-2e2d9ff62a58 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:13.657441 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-601afb5d-512a-44b8-abbc-2e2d9ff62a58 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:13.657441 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-601afb5d-512a-44b8-abbc-2e2d9ff62a58 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:13.657441 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-601afb5d-512a-44b8-abbc-2e2d9ff62a58 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:13.715377 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-601afb5d-512a-44b8-abbc-2e2d9ff62a58 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:13.723044 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-601afb5d-512a-44b8-abbc-2e2d9ff62a58 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.078027 Oct 29 01:47:13.723593 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1258/2342] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:13 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:14.422976 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-cb06226e-fb72-4226-97de-8eb39ac0824f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:14.423579 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-cb06226e-fb72-4226-97de-8eb39ac0824f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:14.429723 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cb06226e-fb72-4226-97de-8eb39ac0824f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:14.430174 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cb06226e-fb72-4226-97de-8eb39ac0824f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:14.430966 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cb06226e-fb72-4226-97de-8eb39ac0824f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:14.431406 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cb06226e-fb72-4226-97de-8eb39ac0824f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:14.490873 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-cb06226e-fb72-4226-97de-8eb39ac0824f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:14.498641 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-cb06226e-fb72-4226-97de-8eb39ac0824f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.080092 Oct 29 01:47:14.499204 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1085/2343] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:14 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:14.740396 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c9318bb1-5b31-4902-8056-117467222436 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:14.740943 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c9318bb1-5b31-4902-8056-117467222436 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:14.747120 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c9318bb1-5b31-4902-8056-117467222436 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:14.747561 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c9318bb1-5b31-4902-8056-117467222436 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:14.748311 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c9318bb1-5b31-4902-8056-117467222436 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:14.748740 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c9318bb1-5b31-4902-8056-117467222436 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:15.004132 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c9318bb1-5b31-4902-8056-117467222436 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:15.011770 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c9318bb1-5b31-4902-8056-117467222436 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.275076 Oct 29 01:47:15.012327 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1259/2344] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:14 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:15.515315 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-db12f400-c580-409f-827e-6f96b934ca0d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:15.515924 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-db12f400-c580-409f-827e-6f96b934ca0d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:15.522230 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-db12f400-c580-409f-827e-6f96b934ca0d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:15.522710 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-db12f400-c580-409f-827e-6f96b934ca0d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:15.523465 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-db12f400-c580-409f-827e-6f96b934ca0d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:15.523896 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-db12f400-c580-409f-827e-6f96b934ca0d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:15.585643 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-db12f400-c580-409f-827e-6f96b934ca0d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:15.593852 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-db12f400-c580-409f-827e-6f96b934ca0d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.081700 Oct 29 01:47:15.594431 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1086/2345] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:15 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:16.028803 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-979b21a2-4c57-4dec-801c-9cabbc315e22 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:16.029446 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-979b21a2-4c57-4dec-801c-9cabbc315e22 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:16.035763 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-979b21a2-4c57-4dec-801c-9cabbc315e22 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:16.036224 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-979b21a2-4c57-4dec-801c-9cabbc315e22 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:16.036988 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-979b21a2-4c57-4dec-801c-9cabbc315e22 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:16.037526 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-979b21a2-4c57-4dec-801c-9cabbc315e22 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:16.096729 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-979b21a2-4c57-4dec-801c-9cabbc315e22 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:16.104440 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-979b21a2-4c57-4dec-801c-9cabbc315e22 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.079303 Oct 29 01:47:16.105007 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1260/2346] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:16 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:16.611035 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-a36875f4-27a1-41fe-9b2a-5a53558464d7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:16.611626 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-a36875f4-27a1-41fe-9b2a-5a53558464d7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:16.617847 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a36875f4-27a1-41fe-9b2a-5a53558464d7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:16.618300 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a36875f4-27a1-41fe-9b2a-5a53558464d7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:16.619093 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a36875f4-27a1-41fe-9b2a-5a53558464d7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:16.619525 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a36875f4-27a1-41fe-9b2a-5a53558464d7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:16.681020 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-a36875f4-27a1-41fe-9b2a-5a53558464d7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:16.688746 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-a36875f4-27a1-41fe-9b2a-5a53558464d7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.081459 Oct 29 01:47:16.689301 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1087/2347] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:16 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:17.120753 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-062a7b90-e2e3-45da-940b-f3e45ac4682d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:17.121370 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-062a7b90-e2e3-45da-940b-f3e45ac4682d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:17.128279 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-062a7b90-e2e3-45da-940b-f3e45ac4682d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:17.128766 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-062a7b90-e2e3-45da-940b-f3e45ac4682d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:17.129531 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-062a7b90-e2e3-45da-940b-f3e45ac4682d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:17.129970 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-062a7b90-e2e3-45da-940b-f3e45ac4682d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:17.188527 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-062a7b90-e2e3-45da-940b-f3e45ac4682d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:17.196164 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-062a7b90-e2e3-45da-940b-f3e45ac4682d tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.079074 Oct 29 01:47:17.196733 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1261/2348] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:17 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:17.706336 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-bcc6bafa-6a0f-4b2f-90a3-34f339c8e2c0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:17.707086 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-bcc6bafa-6a0f-4b2f-90a3-34f339c8e2c0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:17.713322 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bcc6bafa-6a0f-4b2f-90a3-34f339c8e2c0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:17.713924 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bcc6bafa-6a0f-4b2f-90a3-34f339c8e2c0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:17.714743 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bcc6bafa-6a0f-4b2f-90a3-34f339c8e2c0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:17.715179 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bcc6bafa-6a0f-4b2f-90a3-34f339c8e2c0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:17.776676 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-bcc6bafa-6a0f-4b2f-90a3-34f339c8e2c0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:17.784627 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-bcc6bafa-6a0f-4b2f-90a3-34f339c8e2c0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.082679 Oct 29 01:47:17.785327 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1088/2349] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:17 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:18.213144 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9c36a73e-2577-47d2-af8d-1ddc77655ac2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:18.213731 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9c36a73e-2577-47d2-af8d-1ddc77655ac2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:18.219924 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9c36a73e-2577-47d2-af8d-1ddc77655ac2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:18.220370 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9c36a73e-2577-47d2-af8d-1ddc77655ac2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:18.221122 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9c36a73e-2577-47d2-af8d-1ddc77655ac2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:18.221552 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9c36a73e-2577-47d2-af8d-1ddc77655ac2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:18.280322 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-9c36a73e-2577-47d2-af8d-1ddc77655ac2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:18.288051 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9c36a73e-2577-47d2-af8d-1ddc77655ac2 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.078513 Oct 29 01:47:18.288615 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1262/2350] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:18 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:18.800801 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-369ca6de-28d0-459e-b674-e2c00161ea0b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:18.801427 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-369ca6de-28d0-459e-b674-e2c00161ea0b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:18.807775 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-369ca6de-28d0-459e-b674-e2c00161ea0b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:18.808222 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-369ca6de-28d0-459e-b674-e2c00161ea0b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:18.808982 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-369ca6de-28d0-459e-b674-e2c00161ea0b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:18.809415 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-369ca6de-28d0-459e-b674-e2c00161ea0b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:18.871065 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-369ca6de-28d0-459e-b674-e2c00161ea0b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:18.878880 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-369ca6de-28d0-459e-b674-e2c00161ea0b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.081712 Oct 29 01:47:18.879448 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1089/2351] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:18 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:47:19.305045 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-5bd536de-aa95-48e4-9ff6-bac252853b58 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:19.316422 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-5bd536de-aa95-48e4-9ff6-bac252853b58 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:19.318254 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5bd536de-aa95-48e4-9ff6-bac252853b58 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:19.318771 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5bd536de-aa95-48e4-9ff6-bac252853b58 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:19.319568 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5bd536de-aa95-48e4-9ff6-bac252853b58 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:19.320010 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5bd536de-aa95-48e4-9ff6-bac252853b58 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:19.380046 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-5bd536de-aa95-48e4-9ff6-bac252853b58 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:19.387636 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-5bd536de-aa95-48e4-9ff6-bac252853b58 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.086382 Oct 29 01:47:19.388195 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1263/2352] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:19 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:19.895295 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c15ced5c-2c9d-40b8-95d3-7fce1d45714b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:19.895984 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c15ced5c-2c9d-40b8-95d3-7fce1d45714b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:19.902852 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c15ced5c-2c9d-40b8-95d3-7fce1d45714b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:19.903299 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c15ced5c-2c9d-40b8-95d3-7fce1d45714b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:19.904056 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c15ced5c-2c9d-40b8-95d3-7fce1d45714b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:19.904487 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c15ced5c-2c9d-40b8-95d3-7fce1d45714b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:19.963958 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-c15ced5c-2c9d-40b8-95d3-7fce1d45714b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:19.971782 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c15ced5c-2c9d-40b8-95d3-7fce1d45714b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.080250 Oct 29 01:47:19.972342 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1090/2353] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:19 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:20.404763 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d8fbb74f-5bcf-4040-9a98-35341a0de0a8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:20.405372 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d8fbb74f-5bcf-4040-9a98-35341a0de0a8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:20.411662 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d8fbb74f-5bcf-4040-9a98-35341a0de0a8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:20.412115 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d8fbb74f-5bcf-4040-9a98-35341a0de0a8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:20.412876 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d8fbb74f-5bcf-4040-9a98-35341a0de0a8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:20.413311 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d8fbb74f-5bcf-4040-9a98-35341a0de0a8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:20.473482 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-d8fbb74f-5bcf-4040-9a98-35341a0de0a8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:20.481121 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d8fbb74f-5bcf-4040-9a98-35341a0de0a8 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.080067 Oct 29 01:47:20.481675 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1264/2354] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:20 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:20.988737 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c23ce7d7-92cd-4994-bcb6-04357c800afd tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:20.989359 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c23ce7d7-92cd-4994-bcb6-04357c800afd tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:20.995579 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c23ce7d7-92cd-4994-bcb6-04357c800afd tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:20.996029 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c23ce7d7-92cd-4994-bcb6-04357c800afd tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:20.996789 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c23ce7d7-92cd-4994-bcb6-04357c800afd tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:20.997223 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c23ce7d7-92cd-4994-bcb6-04357c800afd tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:21.056657 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-c23ce7d7-92cd-4994-bcb6-04357c800afd tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:21.064533 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c23ce7d7-92cd-4994-bcb6-04357c800afd tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.079621 Oct 29 01:47:21.065089 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1091/2355] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:20 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:21.497934 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b4bf5422-06f8-42d5-a112-1cac252d1bf5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:21.498581 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b4bf5422-06f8-42d5-a112-1cac252d1bf5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:21.505630 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b4bf5422-06f8-42d5-a112-1cac252d1bf5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:21.506079 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b4bf5422-06f8-42d5-a112-1cac252d1bf5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:21.506880 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b4bf5422-06f8-42d5-a112-1cac252d1bf5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:21.507313 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b4bf5422-06f8-42d5-a112-1cac252d1bf5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:21.565957 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-b4bf5422-06f8-42d5-a112-1cac252d1bf5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:21.573642 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b4bf5422-06f8-42d5-a112-1cac252d1bf5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.079352 Oct 29 01:47:21.574203 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1265/2356] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:21 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:22.081692 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-96629330-aa23-46d3-86c0-4a8aa5cde0e0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:22.082340 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-96629330-aa23-46d3-86c0-4a8aa5cde0e0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:22.088531 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-96629330-aa23-46d3-86c0-4a8aa5cde0e0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:22.088976 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-96629330-aa23-46d3-86c0-4a8aa5cde0e0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:22.089737 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-96629330-aa23-46d3-86c0-4a8aa5cde0e0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:22.090181 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-96629330-aa23-46d3-86c0-4a8aa5cde0e0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:22.153316 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-96629330-aa23-46d3-86c0-4a8aa5cde0e0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:22.162200 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-96629330-aa23-46d3-86c0-4a8aa5cde0e0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.084448 Oct 29 01:47:22.162801 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1092/2357] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:22 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:22.591022 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9d08236c-bb3a-4ca8-aa81-cdc5084e9645 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:22.591642 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9d08236c-bb3a-4ca8-aa81-cdc5084e9645 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:22.598691 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9d08236c-bb3a-4ca8-aa81-cdc5084e9645 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:22.599139 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9d08236c-bb3a-4ca8-aa81-cdc5084e9645 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:22.599897 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9d08236c-bb3a-4ca8-aa81-cdc5084e9645 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:22.600330 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9d08236c-bb3a-4ca8-aa81-cdc5084e9645 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:22.658347 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-9d08236c-bb3a-4ca8-aa81-cdc5084e9645 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:22.666098 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9d08236c-bb3a-4ca8-aa81-cdc5084e9645 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.078730 Oct 29 01:47:22.666695 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1266/2358] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:22 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:23.178854 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-8d4bc08a-8860-4b78-a341-cea121d07aa4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:23.179465 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-8d4bc08a-8860-4b78-a341-cea121d07aa4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:23.185670 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8d4bc08a-8860-4b78-a341-cea121d07aa4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:23.186115 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8d4bc08a-8860-4b78-a341-cea121d07aa4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:23.186897 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8d4bc08a-8860-4b78-a341-cea121d07aa4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:23.187399 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8d4bc08a-8860-4b78-a341-cea121d07aa4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:23.248031 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-8d4bc08a-8860-4b78-a341-cea121d07aa4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:23.257169 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-8d4bc08a-8860-4b78-a341-cea121d07aa4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.081931 Oct 29 01:47:23.257764 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1093/2359] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:23 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:23.682308 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-dfc92163-4e0a-4d62-99ad-022d0a521021 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:23.682954 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-dfc92163-4e0a-4d62-99ad-022d0a521021 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:23.689767 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dfc92163-4e0a-4d62-99ad-022d0a521021 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:23.690216 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dfc92163-4e0a-4d62-99ad-022d0a521021 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:23.691009 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dfc92163-4e0a-4d62-99ad-022d0a521021 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:23.691451 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dfc92163-4e0a-4d62-99ad-022d0a521021 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:23.754887 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-dfc92163-4e0a-4d62-99ad-022d0a521021 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:23.762697 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-dfc92163-4e0a-4d62-99ad-022d0a521021 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.084042 Oct 29 01:47:23.763258 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1267/2360] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:23 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:24.274106 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-a58bc5f5-0a9f-46dd-b8e5-fe758752e1b0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:24.274667 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-a58bc5f5-0a9f-46dd-b8e5-fe758752e1b0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:24.280975 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a58bc5f5-0a9f-46dd-b8e5-fe758752e1b0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:24.281427 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a58bc5f5-0a9f-46dd-b8e5-fe758752e1b0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:24.282187 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a58bc5f5-0a9f-46dd-b8e5-fe758752e1b0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:24.282648 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a58bc5f5-0a9f-46dd-b8e5-fe758752e1b0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:24.340553 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-a58bc5f5-0a9f-46dd-b8e5-fe758752e1b0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:24.348866 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-a58bc5f5-0a9f-46dd-b8e5-fe758752e1b0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.078490 Oct 29 01:47:24.349424 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1094/2361] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:24 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:24.779751 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-693203aa-4140-4878-914d-442896a461cc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:24.780382 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-693203aa-4140-4878-914d-442896a461cc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:24.787145 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-693203aa-4140-4878-914d-442896a461cc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:24.787594 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-693203aa-4140-4878-914d-442896a461cc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:24.788342 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-693203aa-4140-4878-914d-442896a461cc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:24.788769 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-693203aa-4140-4878-914d-442896a461cc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:24.847794 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-693203aa-4140-4878-914d-442896a461cc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:24.855449 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-693203aa-4140-4878-914d-442896a461cc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.079323 Oct 29 01:47:24.856013 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1268/2362] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:24 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:25.365714 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f5aa2a35-eded-41fc-946c-4b4d7821ac8c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:25.366311 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f5aa2a35-eded-41fc-946c-4b4d7821ac8c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:25.372731 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f5aa2a35-eded-41fc-946c-4b4d7821ac8c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:25.373179 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f5aa2a35-eded-41fc-946c-4b4d7821ac8c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:25.373970 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f5aa2a35-eded-41fc-946c-4b4d7821ac8c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:25.374915 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f5aa2a35-eded-41fc-946c-4b4d7821ac8c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:25.436484 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-f5aa2a35-eded-41fc-946c-4b4d7821ac8c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:25.444764 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f5aa2a35-eded-41fc-946c-4b4d7821ac8c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.082714 Oct 29 01:47:25.445316 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1095/2363] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:25 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:25.871422 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ded31a23-13fa-48cb-a984-d01d5399756c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:25.872018 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ded31a23-13fa-48cb-a984-d01d5399756c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:25.878843 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ded31a23-13fa-48cb-a984-d01d5399756c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:25.879292 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ded31a23-13fa-48cb-a984-d01d5399756c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:25.880047 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ded31a23-13fa-48cb-a984-d01d5399756c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:25.880478 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ded31a23-13fa-48cb-a984-d01d5399756c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:25.939719 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-ded31a23-13fa-48cb-a984-d01d5399756c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:25.947590 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ded31a23-13fa-48cb-a984-d01d5399756c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.079826 Oct 29 01:47:25.948151 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1269/2364] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:25 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:26.462809 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-579b9594-efa1-4572-87c0-50613fed721f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:26.463414 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-579b9594-efa1-4572-87c0-50613fed721f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:26.470092 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-579b9594-efa1-4572-87c0-50613fed721f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:26.470572 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-579b9594-efa1-4572-87c0-50613fed721f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:26.471325 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-579b9594-efa1-4572-87c0-50613fed721f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:26.471756 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-579b9594-efa1-4572-87c0-50613fed721f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:26.529341 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-579b9594-efa1-4572-87c0-50613fed721f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:26.537879 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-579b9594-efa1-4572-87c0-50613fed721f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.078735 Oct 29 01:47:26.538468 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1096/2365] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:26 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:26.964533 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-5baeed70-eea6-44cc-a314-ad76a5e44bde tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:26.965176 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-5baeed70-eea6-44cc-a314-ad76a5e44bde tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:26.971584 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5baeed70-eea6-44cc-a314-ad76a5e44bde tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:26.972028 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5baeed70-eea6-44cc-a314-ad76a5e44bde tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:26.972787 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5baeed70-eea6-44cc-a314-ad76a5e44bde tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:26.973222 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5baeed70-eea6-44cc-a314-ad76a5e44bde tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:27.034679 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-5baeed70-eea6-44cc-a314-ad76a5e44bde tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:27.042587 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-5baeed70-eea6-44cc-a314-ad76a5e44bde tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.081679 Oct 29 01:47:27.043151 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1270/2366] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:26 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:27.553804 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-fb02a70b-2d20-47dc-805c-f379b0090f28 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:27.554420 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-fb02a70b-2d20-47dc-805c-f379b0090f28 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:27.560626 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fb02a70b-2d20-47dc-805c-f379b0090f28 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:27.561075 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fb02a70b-2d20-47dc-805c-f379b0090f28 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:27.561874 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fb02a70b-2d20-47dc-805c-f379b0090f28 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:27.562315 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fb02a70b-2d20-47dc-805c-f379b0090f28 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:27.622316 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-fb02a70b-2d20-47dc-805c-f379b0090f28 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:27.629988 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-fb02a70b-2d20-47dc-805c-f379b0090f28 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.079842 Oct 29 01:47:27.630567 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1097/2367] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:27 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:28.059610 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-69e158ca-3cec-4e91-8ca2-ab360508db78 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:28.060251 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-69e158ca-3cec-4e91-8ca2-ab360508db78 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:28.067235 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-69e158ca-3cec-4e91-8ca2-ab360508db78 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:28.067690 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-69e158ca-3cec-4e91-8ca2-ab360508db78 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:28.068456 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-69e158ca-3cec-4e91-8ca2-ab360508db78 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:28.068896 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-69e158ca-3cec-4e91-8ca2-ab360508db78 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:28.128415 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-69e158ca-3cec-4e91-8ca2-ab360508db78 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:28.136308 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-69e158ca-3cec-4e91-8ca2-ab360508db78 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.080489 Oct 29 01:47:28.136875 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1271/2368] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:28 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:28.646069 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2edd2512-2ffa-4132-a2d5-4bb6c9d57448 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:28.646684 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2edd2512-2ffa-4132-a2d5-4bb6c9d57448 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:28.652820 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2edd2512-2ffa-4132-a2d5-4bb6c9d57448 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:28.653265 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2edd2512-2ffa-4132-a2d5-4bb6c9d57448 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:28.654041 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2edd2512-2ffa-4132-a2d5-4bb6c9d57448 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:28.654497 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2edd2512-2ffa-4132-a2d5-4bb6c9d57448 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:28.715961 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-2edd2512-2ffa-4132-a2d5-4bb6c9d57448 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:28.724293 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2edd2512-2ffa-4132-a2d5-4bb6c9d57448 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.081892 Oct 29 01:47:28.724848 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1098/2369] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:28 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:29.152846 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c99f4d3b-5aa1-4e39-a645-4a89fc94a236 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:29.153454 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c99f4d3b-5aa1-4e39-a645-4a89fc94a236 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:29.159633 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c99f4d3b-5aa1-4e39-a645-4a89fc94a236 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:29.160077 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c99f4d3b-5aa1-4e39-a645-4a89fc94a236 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:29.160827 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c99f4d3b-5aa1-4e39-a645-4a89fc94a236 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:29.161254 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c99f4d3b-5aa1-4e39-a645-4a89fc94a236 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:29.219865 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c99f4d3b-5aa1-4e39-a645-4a89fc94a236 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:29.227476 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c99f4d3b-5aa1-4e39-a645-4a89fc94a236 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.078352 Oct 29 01:47:29.228032 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1272/2370] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:29 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:29.741316 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2487516a-6c02-4e54-b883-2622ec2901de tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:29.741962 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2487516a-6c02-4e54-b883-2622ec2901de tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:29.748385 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2487516a-6c02-4e54-b883-2622ec2901de tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:29.748830 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2487516a-6c02-4e54-b883-2622ec2901de tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:29.749585 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2487516a-6c02-4e54-b883-2622ec2901de tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:29.750105 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2487516a-6c02-4e54-b883-2622ec2901de tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:29.808845 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-2487516a-6c02-4e54-b883-2622ec2901de tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:29.817199 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2487516a-6c02-4e54-b883-2622ec2901de tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.079552 Oct 29 01:47:29.817755 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1099/2371] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:29 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:30.244289 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-75b0956c-ca60-4dd0-925d-97590932a9ee tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:30.244897 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-75b0956c-ca60-4dd0-925d-97590932a9ee tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:30.251699 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-75b0956c-ca60-4dd0-925d-97590932a9ee tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:30.252146 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-75b0956c-ca60-4dd0-925d-97590932a9ee tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:30.252899 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-75b0956c-ca60-4dd0-925d-97590932a9ee tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:30.253332 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-75b0956c-ca60-4dd0-925d-97590932a9ee tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:30.311415 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-75b0956c-ca60-4dd0-925d-97590932a9ee tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:30.319833 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-75b0956c-ca60-4dd0-925d-97590932a9ee tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.079294 Oct 29 01:47:30.320389 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1273/2372] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:30 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:30.834462 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-b081a56c-9e82-4cab-905f-f71c2d224154 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:30.835072 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-b081a56c-9e82-4cab-905f-f71c2d224154 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:30.841186 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b081a56c-9e82-4cab-905f-f71c2d224154 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:30.841631 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b081a56c-9e82-4cab-905f-f71c2d224154 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:30.842407 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b081a56c-9e82-4cab-905f-f71c2d224154 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:30.842908 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b081a56c-9e82-4cab-905f-f71c2d224154 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:30.902695 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-b081a56c-9e82-4cab-905f-f71c2d224154 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:30.911120 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-b081a56c-9e82-4cab-905f-f71c2d224154 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.080336 Oct 29 01:47:30.911680 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1100/2373] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:30 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:31.336366 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-3a66af1e-c0b8-4aba-9aad-b655063553dd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:31.336956 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-3a66af1e-c0b8-4aba-9aad-b655063553dd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:31.343170 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3a66af1e-c0b8-4aba-9aad-b655063553dd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:31.344117 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3a66af1e-c0b8-4aba-9aad-b655063553dd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:31.344869 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3a66af1e-c0b8-4aba-9aad-b655063553dd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:31.345303 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3a66af1e-c0b8-4aba-9aad-b655063553dd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:31.403819 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-3a66af1e-c0b8-4aba-9aad-b655063553dd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:31.412008 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-3a66af1e-c0b8-4aba-9aad-b655063553dd tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.079363 Oct 29 01:47:31.412567 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1274/2374] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:31 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:31.927850 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-81945e06-71f8-44de-93fd-d16a8551de2f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:31.928460 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-81945e06-71f8-44de-93fd-d16a8551de2f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:31.934701 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-81945e06-71f8-44de-93fd-d16a8551de2f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:31.935153 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-81945e06-71f8-44de-93fd-d16a8551de2f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:31.935914 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-81945e06-71f8-44de-93fd-d16a8551de2f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:31.936348 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-81945e06-71f8-44de-93fd-d16a8551de2f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:32.001634 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-81945e06-71f8-44de-93fd-d16a8551de2f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:32.009390 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-81945e06-71f8-44de-93fd-d16a8551de2f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.085286 Oct 29 01:47:32.009958 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1101/2375] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:31 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:32.428485 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-721edc6c-fb17-4d11-aab4-8910e701a131 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:32.429100 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-721edc6c-fb17-4d11-aab4-8910e701a131 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:32.435276 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-721edc6c-fb17-4d11-aab4-8910e701a131 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:32.435720 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-721edc6c-fb17-4d11-aab4-8910e701a131 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:32.436479 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-721edc6c-fb17-4d11-aab4-8910e701a131 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:32.436910 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-721edc6c-fb17-4d11-aab4-8910e701a131 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:32.495457 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-721edc6c-fb17-4d11-aab4-8910e701a131 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:32.503246 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-721edc6c-fb17-4d11-aab4-8910e701a131 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.078511 Oct 29 01:47:32.503808 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1275/2376] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:32 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:33.033185 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-1b4d4545-e5a5-4aa8-891f-38668dffaef2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:33.033798 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-1b4d4545-e5a5-4aa8-891f-38668dffaef2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:33.040025 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1b4d4545-e5a5-4aa8-891f-38668dffaef2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:33.040478 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1b4d4545-e5a5-4aa8-891f-38668dffaef2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:33.041239 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1b4d4545-e5a5-4aa8-891f-38668dffaef2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:33.041672 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1b4d4545-e5a5-4aa8-891f-38668dffaef2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:33.100640 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-1b4d4545-e5a5-4aa8-891f-38668dffaef2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:33.108281 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-1b4d4545-e5a5-4aa8-891f-38668dffaef2 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.079316 Oct 29 01:47:33.108845 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1102/2377] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:33 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:33.520818 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9249f0c2-28a3-4f0b-91b7-5200757e579a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:33.521364 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9249f0c2-28a3-4f0b-91b7-5200757e579a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:33.527559 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9249f0c2-28a3-4f0b-91b7-5200757e579a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:33.528009 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9249f0c2-28a3-4f0b-91b7-5200757e579a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:33.528769 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9249f0c2-28a3-4f0b-91b7-5200757e579a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:33.529205 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9249f0c2-28a3-4f0b-91b7-5200757e579a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:33.587589 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-9249f0c2-28a3-4f0b-91b7-5200757e579a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:33.595368 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9249f0c2-28a3-4f0b-91b7-5200757e579a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.078417 Oct 29 01:47:33.595933 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1276/2378] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:33 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:34.124896 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2b93f561-079f-4adf-808e-cadf87efbe46 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:34.125490 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2b93f561-079f-4adf-808e-cadf87efbe46 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:34.131721 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2b93f561-079f-4adf-808e-cadf87efbe46 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:34.132165 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2b93f561-079f-4adf-808e-cadf87efbe46 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:34.132928 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2b93f561-079f-4adf-808e-cadf87efbe46 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:34.133353 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2b93f561-079f-4adf-808e-cadf87efbe46 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:34.191360 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-2b93f561-079f-4adf-808e-cadf87efbe46 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:34.199005 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2b93f561-079f-4adf-808e-cadf87efbe46 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.077910 Oct 29 01:47:34.199560 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1103/2379] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:34 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:34.611672 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b7a85ccf-09d5-4c43-8835-35f255d70cb0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:34.612253 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b7a85ccf-09d5-4c43-8835-35f255d70cb0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:34.618441 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b7a85ccf-09d5-4c43-8835-35f255d70cb0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:34.618890 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b7a85ccf-09d5-4c43-8835-35f255d70cb0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:34.619639 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b7a85ccf-09d5-4c43-8835-35f255d70cb0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:34.620065 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b7a85ccf-09d5-4c43-8835-35f255d70cb0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:34.679209 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-b7a85ccf-09d5-4c43-8835-35f255d70cb0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:34.686837 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b7a85ccf-09d5-4c43-8835-35f255d70cb0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.078857 Oct 29 01:47:34.687525 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1277/2380] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:34 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:35.216418 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-4a8822b8-9306-4107-8a64-2a52acb41f98 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:35.216997 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-4a8822b8-9306-4107-8a64-2a52acb41f98 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:35.223838 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4a8822b8-9306-4107-8a64-2a52acb41f98 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:35.224284 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4a8822b8-9306-4107-8a64-2a52acb41f98 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:35.225039 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4a8822b8-9306-4107-8a64-2a52acb41f98 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:35.225468 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4a8822b8-9306-4107-8a64-2a52acb41f98 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:35.287345 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-4a8822b8-9306-4107-8a64-2a52acb41f98 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:35.295019 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-4a8822b8-9306-4107-8a64-2a52acb41f98 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.082415 Oct 29 01:47:35.295574 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1104/2381] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:35 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:35.704371 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-7c97d818-7c57-4b93-98b3-4d7406473d38 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:35.704974 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-7c97d818-7c57-4b93-98b3-4d7406473d38 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:35.711151 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7c97d818-7c57-4b93-98b3-4d7406473d38 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:35.711603 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7c97d818-7c57-4b93-98b3-4d7406473d38 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:35.712357 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7c97d818-7c57-4b93-98b3-4d7406473d38 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:35.712790 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7c97d818-7c57-4b93-98b3-4d7406473d38 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:35.771183 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-7c97d818-7c57-4b93-98b3-4d7406473d38 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:35.778835 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-7c97d818-7c57-4b93-98b3-4d7406473d38 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.079009 Oct 29 01:47:35.779393 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1278/2382] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:35 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:36.310970 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-66755950-c737-4f84-b859-ff887556bad7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:36.311528 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-66755950-c737-4f84-b859-ff887556bad7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:36.318306 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-66755950-c737-4f84-b859-ff887556bad7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:36.318788 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-66755950-c737-4f84-b859-ff887556bad7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:36.319557 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-66755950-c737-4f84-b859-ff887556bad7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:36.319991 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-66755950-c737-4f84-b859-ff887556bad7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:36.378896 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-66755950-c737-4f84-b859-ff887556bad7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:36.387222 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-66755950-c737-4f84-b859-ff887556bad7 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.080112 Oct 29 01:47:36.387787 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1105/2383] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:36 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:36.795132 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a1338983-c5bc-419f-94df-6ec5510310eb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:36.795754 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a1338983-c5bc-419f-94df-6ec5510310eb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:36.802495 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a1338983-c5bc-419f-94df-6ec5510310eb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:36.803191 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a1338983-c5bc-419f-94df-6ec5510310eb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:36.803693 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a1338983-c5bc-419f-94df-6ec5510310eb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:36.804129 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a1338983-c5bc-419f-94df-6ec5510310eb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:36.862933 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-a1338983-c5bc-419f-94df-6ec5510310eb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:36.870453 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a1338983-c5bc-419f-94df-6ec5510310eb tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.079025 Oct 29 01:47:36.871012 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1279/2384] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:36 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:37.404557 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-5f6fcb51-07a1-4c93-b27d-8795307259fd tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:37.405155 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-5f6fcb51-07a1-4c93-b27d-8795307259fd tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:37.411327 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5f6fcb51-07a1-4c93-b27d-8795307259fd tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:37.411774 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5f6fcb51-07a1-4c93-b27d-8795307259fd tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:37.412526 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5f6fcb51-07a1-4c93-b27d-8795307259fd tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:37.412957 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5f6fcb51-07a1-4c93-b27d-8795307259fd tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:37.474684 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-5f6fcb51-07a1-4c93-b27d-8795307259fd tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:37.482505 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-5f6fcb51-07a1-4c93-b27d-8795307259fd tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.081598 Oct 29 01:47:37.483075 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1106/2385] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:37 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:37.887065 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-a6d816f1-4777-4144-9f87-20f0718f662f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:37.887666 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-a6d816f1-4777-4144-9f87-20f0718f662f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:37.894156 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a6d816f1-4777-4144-9f87-20f0718f662f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:37.894632 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a6d816f1-4777-4144-9f87-20f0718f662f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:37.895384 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a6d816f1-4777-4144-9f87-20f0718f662f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:37.895813 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-a6d816f1-4777-4144-9f87-20f0718f662f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:37.955246 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-a6d816f1-4777-4144-9f87-20f0718f662f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:37.963073 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-a6d816f1-4777-4144-9f87-20f0718f662f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.079603 Oct 29 01:47:37.963623 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1280/2386] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:37 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:38.499601 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-0727c13d-26e6-442e-9b0e-115b5be1a5f0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:38.500771 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-0727c13d-26e6-442e-9b0e-115b5be1a5f0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:38.506988 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0727c13d-26e6-442e-9b0e-115b5be1a5f0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:38.507436 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0727c13d-26e6-442e-9b0e-115b5be1a5f0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:38.508184 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0727c13d-26e6-442e-9b0e-115b5be1a5f0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:38.508614 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-0727c13d-26e6-442e-9b0e-115b5be1a5f0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:38.570801 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-0727c13d-26e6-442e-9b0e-115b5be1a5f0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:38.578737 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-0727c13d-26e6-442e-9b0e-115b5be1a5f0 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.082743 Oct 29 01:47:38.579293 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1107/2387] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:38 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:38.980848 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-eec0d35e-77f7-4128-8d64-36a49eeef62a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:38.981460 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-eec0d35e-77f7-4128-8d64-36a49eeef62a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:38.987617 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-eec0d35e-77f7-4128-8d64-36a49eeef62a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:38.988064 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-eec0d35e-77f7-4128-8d64-36a49eeef62a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:38.988813 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-eec0d35e-77f7-4128-8d64-36a49eeef62a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:38.989243 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-eec0d35e-77f7-4128-8d64-36a49eeef62a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:39.047132 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-eec0d35e-77f7-4128-8d64-36a49eeef62a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:39.055238 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-eec0d35e-77f7-4128-8d64-36a49eeef62a tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.077984 Oct 29 01:47:39.055747 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1281/2388] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:38 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:39.595356 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d16e064c-f69c-4865-9c40-3ff78da3a913 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:39.595940 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d16e064c-f69c-4865-9c40-3ff78da3a913 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:39.602346 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d16e064c-f69c-4865-9c40-3ff78da3a913 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:39.602830 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d16e064c-f69c-4865-9c40-3ff78da3a913 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:39.603631 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d16e064c-f69c-4865-9c40-3ff78da3a913 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:39.604065 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d16e064c-f69c-4865-9c40-3ff78da3a913 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:39.662471 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-d16e064c-f69c-4865-9c40-3ff78da3a913 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:39.670100 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d16e064c-f69c-4865-9c40-3ff78da3a913 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.078453 Oct 29 01:47:39.670692 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1108/2389] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:39 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:40.071374 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-4c4d8bd0-d7f7-42a0-bfb6-58e2e88fc0e6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:40.071986 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-4c4d8bd0-d7f7-42a0-bfb6-58e2e88fc0e6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:40.079168 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4c4d8bd0-d7f7-42a0-bfb6-58e2e88fc0e6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:40.079620 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4c4d8bd0-d7f7-42a0-bfb6-58e2e88fc0e6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:40.080377 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4c4d8bd0-d7f7-42a0-bfb6-58e2e88fc0e6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:40.080812 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-4c4d8bd0-d7f7-42a0-bfb6-58e2e88fc0e6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:40.139060 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-4c4d8bd0-d7f7-42a0-bfb6-58e2e88fc0e6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:40.146836 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-4c4d8bd0-d7f7-42a0-bfb6-58e2e88fc0e6 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.079071 Oct 29 01:47:40.147393 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1282/2390] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:40 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:40.687154 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-b984b199-a601-40b4-966a-97becca12632 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:40.688299 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-b984b199-a601-40b4-966a-97becca12632 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:40.694513 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b984b199-a601-40b4-966a-97becca12632 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:40.694960 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b984b199-a601-40b4-966a-97becca12632 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:40.695712 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b984b199-a601-40b4-966a-97becca12632 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:40.696141 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b984b199-a601-40b4-966a-97becca12632 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:40.756641 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-b984b199-a601-40b4-966a-97becca12632 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:40.764339 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-b984b199-a601-40b4-966a-97becca12632 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.080865 Oct 29 01:47:40.764901 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1109/2391] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:40 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:40.843233 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:47:40.843390 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: Fri Oct 29 01:47:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 29 01:47:41.162894 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-5019d904-8dbc-4911-a032-9d55b7c40bfa tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:41.163555 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-5019d904-8dbc-4911-a032-9d55b7c40bfa tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:41.169625 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5019d904-8dbc-4911-a032-9d55b7c40bfa tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:41.170069 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5019d904-8dbc-4911-a032-9d55b7c40bfa tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:41.170854 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5019d904-8dbc-4911-a032-9d55b7c40bfa tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:41.171283 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5019d904-8dbc-4911-a032-9d55b7c40bfa tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:41.231914 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-5019d904-8dbc-4911-a032-9d55b7c40bfa tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:41.239698 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-5019d904-8dbc-4911-a032-9d55b7c40bfa tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.080495 Oct 29 01:47:41.240261 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1283/2392] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:41 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:41.781435 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e3eb6ca4-b5a9-44f3-a6e5-b8f120903106 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:41.782356 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-e3eb6ca4-b5a9-44f3-a6e5-b8f120903106 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:41.789265 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e3eb6ca4-b5a9-44f3-a6e5-b8f120903106 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:41.789708 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e3eb6ca4-b5a9-44f3-a6e5-b8f120903106 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:41.790493 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e3eb6ca4-b5a9-44f3-a6e5-b8f120903106 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:41.790924 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e3eb6ca4-b5a9-44f3-a6e5-b8f120903106 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:41.852064 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-e3eb6ca4-b5a9-44f3-a6e5-b8f120903106 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:41.859681 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-e3eb6ca4-b5a9-44f3-a6e5-b8f120903106 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.082459 Oct 29 01:47:41.860238 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1110/2393] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:41 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:42.256012 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-af6f4f4f-a8b2-46d8-b170-ebffb9ccf0a5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:42.256611 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-af6f4f4f-a8b2-46d8-b170-ebffb9ccf0a5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:42.262909 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-af6f4f4f-a8b2-46d8-b170-ebffb9ccf0a5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:42.263354 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-af6f4f4f-a8b2-46d8-b170-ebffb9ccf0a5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:42.264111 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-af6f4f4f-a8b2-46d8-b170-ebffb9ccf0a5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:42.264544 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-af6f4f4f-a8b2-46d8-b170-ebffb9ccf0a5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:42.573408 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-af6f4f4f-a8b2-46d8-b170-ebffb9ccf0a5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:42.582127 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-af6f4f4f-a8b2-46d8-b170-ebffb9ccf0a5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.329815 Oct 29 01:47:42.582710 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1284/2394] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:42 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:42.876855 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-bd38be67-0cd6-46bf-af62-0d58752540f4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:42.877473 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-bd38be67-0cd6-46bf-af62-0d58752540f4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:42.883789 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bd38be67-0cd6-46bf-af62-0d58752540f4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:42.884243 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bd38be67-0cd6-46bf-af62-0d58752540f4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:42.885016 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bd38be67-0cd6-46bf-af62-0d58752540f4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:42.885457 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bd38be67-0cd6-46bf-af62-0d58752540f4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:42.943531 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-bd38be67-0cd6-46bf-af62-0d58752540f4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:42.951513 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-bd38be67-0cd6-46bf-af62-0d58752540f4 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.078952 Oct 29 01:47:42.952078 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1111/2395] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:42 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:43.599094 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-3113f4f8-7a25-4b75-b225-4fd26cc45142 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:43.599683 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-3113f4f8-7a25-4b75-b225-4fd26cc45142 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:43.605826 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3113f4f8-7a25-4b75-b225-4fd26cc45142 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:43.606270 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3113f4f8-7a25-4b75-b225-4fd26cc45142 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:43.607048 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3113f4f8-7a25-4b75-b225-4fd26cc45142 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:43.607484 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3113f4f8-7a25-4b75-b225-4fd26cc45142 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:43.665397 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-3113f4f8-7a25-4b75-b225-4fd26cc45142 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:43.673368 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-3113f4f8-7a25-4b75-b225-4fd26cc45142 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.077901 Oct 29 01:47:43.673915 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1285/2396] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:43 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:47:43.968908 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d9c26855-aae5-4015-a683-e9f41bf1e7fa tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:43.969646 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d9c26855-aae5-4015-a683-e9f41bf1e7fa tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:43.976180 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d9c26855-aae5-4015-a683-e9f41bf1e7fa tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:43.976632 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d9c26855-aae5-4015-a683-e9f41bf1e7fa tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:43.977409 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d9c26855-aae5-4015-a683-e9f41bf1e7fa tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:43.977850 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d9c26855-aae5-4015-a683-e9f41bf1e7fa tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:44.036240 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-d9c26855-aae5-4015-a683-e9f41bf1e7fa tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:44.043851 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d9c26855-aae5-4015-a683-e9f41bf1e7fa tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.078651 Oct 29 01:47:44.044410 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1112/2397] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:43 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:44.689509 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c05903e9-24bd-48e2-8c1d-77b7378bb97c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:44.690118 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c05903e9-24bd-48e2-8c1d-77b7378bb97c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:44.696555 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c05903e9-24bd-48e2-8c1d-77b7378bb97c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:44.697133 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c05903e9-24bd-48e2-8c1d-77b7378bb97c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:44.697944 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c05903e9-24bd-48e2-8c1d-77b7378bb97c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:44.698376 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c05903e9-24bd-48e2-8c1d-77b7378bb97c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:44.759576 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c05903e9-24bd-48e2-8c1d-77b7378bb97c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:44.767372 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c05903e9-24bd-48e2-8c1d-77b7378bb97c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.081569 Oct 29 01:47:44.767927 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1286/2398] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:44 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:45.060452 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-087b0819-eddf-475a-a8db-b8b8a1a170d9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:45.061069 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-087b0819-eddf-475a-a8db-b8b8a1a170d9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:45.067345 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-087b0819-eddf-475a-a8db-b8b8a1a170d9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:45.067794 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-087b0819-eddf-475a-a8db-b8b8a1a170d9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:45.068555 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-087b0819-eddf-475a-a8db-b8b8a1a170d9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:45.068989 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-087b0819-eddf-475a-a8db-b8b8a1a170d9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:45.129156 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-087b0819-eddf-475a-a8db-b8b8a1a170d9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:45.136771 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-087b0819-eddf-475a-a8db-b8b8a1a170d9 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.080022 Oct 29 01:47:45.137329 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1113/2399] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:45 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:45.783427 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-efbacf3d-1729-49c3-9cae-32fd22221fb4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:45.784031 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-efbacf3d-1729-49c3-9cae-32fd22221fb4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:45.790022 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-efbacf3d-1729-49c3-9cae-32fd22221fb4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:45.790418 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-efbacf3d-1729-49c3-9cae-32fd22221fb4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:45.791180 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-efbacf3d-1729-49c3-9cae-32fd22221fb4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:45.791608 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-efbacf3d-1729-49c3-9cae-32fd22221fb4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:45.850728 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-efbacf3d-1729-49c3-9cae-32fd22221fb4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:45.860120 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-efbacf3d-1729-49c3-9cae-32fd22221fb4 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.080434 Oct 29 01:47:45.860686 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1287/2400] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:45 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:46.152832 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c83b2dd5-2caf-4ba7-97e8-6b7b4e289c43 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:46.153449 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c83b2dd5-2caf-4ba7-97e8-6b7b4e289c43 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:46.159599 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c83b2dd5-2caf-4ba7-97e8-6b7b4e289c43 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:46.160054 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c83b2dd5-2caf-4ba7-97e8-6b7b4e289c43 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:46.160821 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c83b2dd5-2caf-4ba7-97e8-6b7b4e289c43 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:46.161263 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c83b2dd5-2caf-4ba7-97e8-6b7b4e289c43 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:46.219724 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-c83b2dd5-2caf-4ba7-97e8-6b7b4e289c43 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:46.227400 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c83b2dd5-2caf-4ba7-97e8-6b7b4e289c43 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.078222 Oct 29 01:47:46.227952 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1114/2401] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:46 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:46.876391 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-24894054-1213-4d9e-90f2-b495426f1dfe tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:46.877031 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-24894054-1213-4d9e-90f2-b495426f1dfe tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:46.883207 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-24894054-1213-4d9e-90f2-b495426f1dfe tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:46.883652 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-24894054-1213-4d9e-90f2-b495426f1dfe tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:46.884400 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-24894054-1213-4d9e-90f2-b495426f1dfe tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:46.884830 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-24894054-1213-4d9e-90f2-b495426f1dfe tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:46.943058 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-24894054-1213-4d9e-90f2-b495426f1dfe tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:46.950984 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-24894054-1213-4d9e-90f2-b495426f1dfe tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.078248 Oct 29 01:47:46.951538 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1288/2402] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:46 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:47.244278 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-9ff1cfe0-e5b0-4af3-a826-8215d1c29cce tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:47.244895 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-9ff1cfe0-e5b0-4af3-a826-8215d1c29cce tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:47.251138 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9ff1cfe0-e5b0-4af3-a826-8215d1c29cce tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:47.251582 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9ff1cfe0-e5b0-4af3-a826-8215d1c29cce tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:47.252340 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9ff1cfe0-e5b0-4af3-a826-8215d1c29cce tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:47.252775 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9ff1cfe0-e5b0-4af3-a826-8215d1c29cce tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:47.314569 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-9ff1cfe0-e5b0-4af3-a826-8215d1c29cce tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:47.322452 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-9ff1cfe0-e5b0-4af3-a826-8215d1c29cce tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.081844 Oct 29 01:47:47.323012 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1115/2403] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:47 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:47.967276 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-e4dfe5aa-8d65-43ed-b92f-91898e1a182c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:47.967884 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-e4dfe5aa-8d65-43ed-b92f-91898e1a182c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:47.974561 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e4dfe5aa-8d65-43ed-b92f-91898e1a182c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:47.975014 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e4dfe5aa-8d65-43ed-b92f-91898e1a182c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:47.975765 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e4dfe5aa-8d65-43ed-b92f-91898e1a182c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:47.976193 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e4dfe5aa-8d65-43ed-b92f-91898e1a182c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:48.039838 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-e4dfe5aa-8d65-43ed-b92f-91898e1a182c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:48.048188 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-e4dfe5aa-8d65-43ed-b92f-91898e1a182c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.084588 Oct 29 01:47:48.048747 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1289/2404] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:47 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:47:48.339976 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-70c3a0e7-f2fc-423b-8899-e7037429874c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:48.340534 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-70c3a0e7-f2fc-423b-8899-e7037429874c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:48.347889 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-70c3a0e7-f2fc-423b-8899-e7037429874c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:48.348345 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-70c3a0e7-f2fc-423b-8899-e7037429874c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:48.349107 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-70c3a0e7-f2fc-423b-8899-e7037429874c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:48.349546 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-70c3a0e7-f2fc-423b-8899-e7037429874c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:48.408039 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-70c3a0e7-f2fc-423b-8899-e7037429874c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:48.415741 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-70c3a0e7-f2fc-423b-8899-e7037429874c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.079517 Oct 29 01:47:48.416305 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1116/2405] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:48 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:49.064931 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-e5d5424d-1c82-4c6f-96df-259b4ce54c3b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:49.065473 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-e5d5424d-1c82-4c6f-96df-259b4ce54c3b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:49.071674 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e5d5424d-1c82-4c6f-96df-259b4ce54c3b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:49.072118 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e5d5424d-1c82-4c6f-96df-259b4ce54c3b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:49.072873 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e5d5424d-1c82-4c6f-96df-259b4ce54c3b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:49.073301 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-e5d5424d-1c82-4c6f-96df-259b4ce54c3b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:49.133557 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-e5d5424d-1c82-4c6f-96df-259b4ce54c3b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:49.141123 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-e5d5424d-1c82-4c6f-96df-259b4ce54c3b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.080405 Oct 29 01:47:49.141672 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1290/2406] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:49 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:49.432970 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-3f3b6b20-8513-4a29-a308-77fa55baebda tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:49.433582 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-3f3b6b20-8513-4a29-a308-77fa55baebda tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:49.440021 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3f3b6b20-8513-4a29-a308-77fa55baebda tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:49.440474 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3f3b6b20-8513-4a29-a308-77fa55baebda tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:49.441233 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3f3b6b20-8513-4a29-a308-77fa55baebda tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:49.441668 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3f3b6b20-8513-4a29-a308-77fa55baebda tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:49.499532 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-3f3b6b20-8513-4a29-a308-77fa55baebda tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:49.507191 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-3f3b6b20-8513-4a29-a308-77fa55baebda tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.077962 Oct 29 01:47:49.507755 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1117/2407] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:49 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:50.156721 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9ecc4a11-ac4b-4af7-9f3e-ae5e212e36a1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:50.157348 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9ecc4a11-ac4b-4af7-9f3e-ae5e212e36a1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:50.164209 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9ecc4a11-ac4b-4af7-9f3e-ae5e212e36a1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:50.164658 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9ecc4a11-ac4b-4af7-9f3e-ae5e212e36a1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:50.165419 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9ecc4a11-ac4b-4af7-9f3e-ae5e212e36a1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:50.165885 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9ecc4a11-ac4b-4af7-9f3e-ae5e212e36a1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:50.225546 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-9ecc4a11-ac4b-4af7-9f3e-ae5e212e36a1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:50.233328 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9ecc4a11-ac4b-4af7-9f3e-ae5e212e36a1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.080239 Oct 29 01:47:50.233887 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1291/2408] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:50 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:50.524359 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-da9b9ff2-4fb2-49cf-868c-a23d1c7449cb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:50.524992 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-da9b9ff2-4fb2-49cf-868c-a23d1c7449cb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:50.531151 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-da9b9ff2-4fb2-49cf-868c-a23d1c7449cb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:50.531597 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-da9b9ff2-4fb2-49cf-868c-a23d1c7449cb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:50.532837 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-da9b9ff2-4fb2-49cf-868c-a23d1c7449cb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:50.533267 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-da9b9ff2-4fb2-49cf-868c-a23d1c7449cb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:50.594134 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-da9b9ff2-4fb2-49cf-868c-a23d1c7449cb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:50.603355 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-da9b9ff2-4fb2-49cf-868c-a23d1c7449cb tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.082660 Oct 29 01:47:50.603925 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1118/2409] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:50 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:51.249444 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-dceb2a7b-d548-402d-a1de-e2eddfa493e1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:51.250046 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-dceb2a7b-d548-402d-a1de-e2eddfa493e1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:51.256923 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dceb2a7b-d548-402d-a1de-e2eddfa493e1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:51.257373 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dceb2a7b-d548-402d-a1de-e2eddfa493e1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:51.258132 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dceb2a7b-d548-402d-a1de-e2eddfa493e1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:51.258602 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dceb2a7b-d548-402d-a1de-e2eddfa493e1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:51.316831 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-dceb2a7b-d548-402d-a1de-e2eddfa493e1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:51.324401 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-dceb2a7b-d548-402d-a1de-e2eddfa493e1 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.078592 Oct 29 01:47:51.325240 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1292/2410] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:51 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:51.620667 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-87e1f3a8-735f-4620-a9d7-417c48b965ea tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:51.621281 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-87e1f3a8-735f-4620-a9d7-417c48b965ea tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:51.627573 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-87e1f3a8-735f-4620-a9d7-417c48b965ea tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:51.628031 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-87e1f3a8-735f-4620-a9d7-417c48b965ea tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:51.628798 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-87e1f3a8-735f-4620-a9d7-417c48b965ea tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:51.629237 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-87e1f3a8-735f-4620-a9d7-417c48b965ea tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:51.687161 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-87e1f3a8-735f-4620-a9d7-417c48b965ea tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:51.694787 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-87e1f3a8-735f-4620-a9d7-417c48b965ea tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.077770 Oct 29 01:47:51.695351 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1119/2411] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:51 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:52.341840 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-25947faf-ccba-4089-8183-16550de916a0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:52.342551 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-25947faf-ccba-4089-8183-16550de916a0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:52.349158 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-25947faf-ccba-4089-8183-16550de916a0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:52.349613 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-25947faf-ccba-4089-8183-16550de916a0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:52.350375 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-25947faf-ccba-4089-8183-16550de916a0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:52.350837 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-25947faf-ccba-4089-8183-16550de916a0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:52.410537 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-25947faf-ccba-4089-8183-16550de916a0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:52.418543 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-25947faf-ccba-4089-8183-16550de916a0 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.080452 Oct 29 01:47:52.419112 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1293/2412] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:52 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:52.712227 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e1cf69bb-be74-453d-a7e1-fa8d95c68f7f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:52.712863 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-e1cf69bb-be74-453d-a7e1-fa8d95c68f7f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:52.719092 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e1cf69bb-be74-453d-a7e1-fa8d95c68f7f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:52.719534 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e1cf69bb-be74-453d-a7e1-fa8d95c68f7f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:52.720289 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e1cf69bb-be74-453d-a7e1-fa8d95c68f7f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:52.720716 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e1cf69bb-be74-453d-a7e1-fa8d95c68f7f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:52.780944 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-e1cf69bb-be74-453d-a7e1-fa8d95c68f7f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:52.789515 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-e1cf69bb-be74-453d-a7e1-fa8d95c68f7f tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.080992 Oct 29 01:47:52.790076 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1120/2413] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:52 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:53.435043 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-45797b24-2929-4c54-b971-8173ca26cda7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:53.435663 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-45797b24-2929-4c54-b971-8173ca26cda7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:53.441857 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-45797b24-2929-4c54-b971-8173ca26cda7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:53.442307 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-45797b24-2929-4c54-b971-8173ca26cda7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:53.443110 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-45797b24-2929-4c54-b971-8173ca26cda7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:53.443551 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-45797b24-2929-4c54-b971-8173ca26cda7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:53.502776 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-45797b24-2929-4c54-b971-8173ca26cda7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:53.510518 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-45797b24-2929-4c54-b971-8173ca26cda7 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.079131 Oct 29 01:47:53.511080 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1294/2414] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:53 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:53.807520 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-cfe1b494-ffeb-4357-b157-f7c86d56c011 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:53.808062 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-cfe1b494-ffeb-4357-b157-f7c86d56c011 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:53.814792 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cfe1b494-ffeb-4357-b157-f7c86d56c011 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:53.815249 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cfe1b494-ffeb-4357-b157-f7c86d56c011 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:53.816018 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cfe1b494-ffeb-4357-b157-f7c86d56c011 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:53.816459 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cfe1b494-ffeb-4357-b157-f7c86d56c011 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:53.878233 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-cfe1b494-ffeb-4357-b157-f7c86d56c011 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:53.885980 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-cfe1b494-ffeb-4357-b157-f7c86d56c011 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.082224 Oct 29 01:47:53.886573 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1121/2415] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:53 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:54.527663 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-3b91a6f2-fbe0-4edc-b9c1-fd236cd9a28b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:54.528274 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-3b91a6f2-fbe0-4edc-b9c1-fd236cd9a28b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:54.535224 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3b91a6f2-fbe0-4edc-b9c1-fd236cd9a28b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:54.535669 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3b91a6f2-fbe0-4edc-b9c1-fd236cd9a28b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:54.536460 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3b91a6f2-fbe0-4edc-b9c1-fd236cd9a28b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:54.536988 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3b91a6f2-fbe0-4edc-b9c1-fd236cd9a28b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:54.600893 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-3b91a6f2-fbe0-4edc-b9c1-fd236cd9a28b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:54.608612 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-3b91a6f2-fbe0-4edc-b9c1-fd236cd9a28b tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.084619 Oct 29 01:47:54.609192 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1295/2416] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:54 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:54.902324 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e0770f30-3c2a-4571-8d1c-670b7768bc02 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:54.902963 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-e0770f30-3c2a-4571-8d1c-670b7768bc02 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:54.909771 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e0770f30-3c2a-4571-8d1c-670b7768bc02 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:54.910220 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e0770f30-3c2a-4571-8d1c-670b7768bc02 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:54.911010 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e0770f30-3c2a-4571-8d1c-670b7768bc02 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:54.911443 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e0770f30-3c2a-4571-8d1c-670b7768bc02 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:54.972833 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-e0770f30-3c2a-4571-8d1c-670b7768bc02 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:54.980601 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-e0770f30-3c2a-4571-8d1c-670b7768bc02 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.082003 Oct 29 01:47:54.981159 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1122/2417] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:54 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:55.626493 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-b64f68aa-0be9-4f91-a702-699ebab7cca3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:55.627087 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-b64f68aa-0be9-4f91-a702-699ebab7cca3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:55.633236 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b64f68aa-0be9-4f91-a702-699ebab7cca3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:55.633710 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b64f68aa-0be9-4f91-a702-699ebab7cca3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:55.634490 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b64f68aa-0be9-4f91-a702-699ebab7cca3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:55.634923 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-b64f68aa-0be9-4f91-a702-699ebab7cca3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:55.694315 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-b64f68aa-0be9-4f91-a702-699ebab7cca3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:55.702223 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-b64f68aa-0be9-4f91-a702-699ebab7cca3 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.079977 Oct 29 01:47:55.702811 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1296/2418] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:55 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:55.997126 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-764758e9-1c41-4232-83bf-8acec3a949ed tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:55.997745 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-764758e9-1c41-4232-83bf-8acec3a949ed tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:56.004032 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-764758e9-1c41-4232-83bf-8acec3a949ed tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:56.004484 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-764758e9-1c41-4232-83bf-8acec3a949ed tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:56.005250 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-764758e9-1c41-4232-83bf-8acec3a949ed tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:56.005689 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-764758e9-1c41-4232-83bf-8acec3a949ed tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:56.063946 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-764758e9-1c41-4232-83bf-8acec3a949ed tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:56.071676 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-764758e9-1c41-4232-83bf-8acec3a949ed tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.078283 Oct 29 01:47:56.072246 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1123/2419] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:55 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:56.718360 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-3b39a2c3-8ffc-43fa-bf68-1959ddac7ad5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:56.719616 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-3b39a2c3-8ffc-43fa-bf68-1959ddac7ad5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:56.725713 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3b39a2c3-8ffc-43fa-bf68-1959ddac7ad5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:56.726167 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3b39a2c3-8ffc-43fa-bf68-1959ddac7ad5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:56.727023 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3b39a2c3-8ffc-43fa-bf68-1959ddac7ad5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:56.727462 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3b39a2c3-8ffc-43fa-bf68-1959ddac7ad5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:56.785134 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-3b39a2c3-8ffc-43fa-bf68-1959ddac7ad5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:56.792920 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-3b39a2c3-8ffc-43fa-bf68-1959ddac7ad5 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.078267 Oct 29 01:47:56.793476 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1297/2420] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:56 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:57.088515 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-9e7ed489-b762-47e9-b0f0-c5c1eac2dc1b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:57.089096 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-9e7ed489-b762-47e9-b0f0-c5c1eac2dc1b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:57.096155 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9e7ed489-b762-47e9-b0f0-c5c1eac2dc1b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:57.096614 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9e7ed489-b762-47e9-b0f0-c5c1eac2dc1b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:57.097385 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9e7ed489-b762-47e9-b0f0-c5c1eac2dc1b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:57.097828 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9e7ed489-b762-47e9-b0f0-c5c1eac2dc1b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:57.159442 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-9e7ed489-b762-47e9-b0f0-c5c1eac2dc1b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:57.167256 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-9e7ed489-b762-47e9-b0f0-c5c1eac2dc1b tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.082488 Oct 29 01:47:57.167822 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1124/2421] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:57 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:57.811022 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d8117660-39bd-4477-8206-c9d0f5e3b1dc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:57.811893 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d8117660-39bd-4477-8206-c9d0f5e3b1dc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:57.818725 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d8117660-39bd-4477-8206-c9d0f5e3b1dc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:57.819174 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d8117660-39bd-4477-8206-c9d0f5e3b1dc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:57.819931 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d8117660-39bd-4477-8206-c9d0f5e3b1dc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:57.820365 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d8117660-39bd-4477-8206-c9d0f5e3b1dc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:57.879168 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-d8117660-39bd-4477-8206-c9d0f5e3b1dc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:57.886723 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d8117660-39bd-4477-8206-c9d0f5e3b1dc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.079478 Oct 29 01:47:57.887278 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1298/2422] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:57 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:58.183917 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2458752d-4605-4be4-aa18-20d0c5cae169 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:58.184516 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2458752d-4605-4be4-aa18-20d0c5cae169 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:58.191233 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2458752d-4605-4be4-aa18-20d0c5cae169 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:58.191684 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2458752d-4605-4be4-aa18-20d0c5cae169 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:58.192441 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2458752d-4605-4be4-aa18-20d0c5cae169 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:58.192869 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2458752d-4605-4be4-aa18-20d0c5cae169 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:58.251253 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-2458752d-4605-4be4-aa18-20d0c5cae169 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:58.258876 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2458752d-4605-4be4-aa18-20d0c5cae169 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.078642 Oct 29 01:47:58.259440 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1125/2423] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:58 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:58.902945 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d57a9b25-3493-4411-b44e-78839dfd39db tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:58.903558 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d57a9b25-3493-4411-b44e-78839dfd39db tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:58.909924 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d57a9b25-3493-4411-b44e-78839dfd39db tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:58.910372 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d57a9b25-3493-4411-b44e-78839dfd39db tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:58.911157 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d57a9b25-3493-4411-b44e-78839dfd39db tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:58.911589 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d57a9b25-3493-4411-b44e-78839dfd39db tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:58.971290 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-d57a9b25-3493-4411-b44e-78839dfd39db tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:58.979047 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d57a9b25-3493-4411-b44e-78839dfd39db tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.079743 Oct 29 01:47:58.979610 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1299/2424] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:58 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:59.275989 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-3fc88a57-e8a1-416c-a946-20225f2de62e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:59.276625 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-3fc88a57-e8a1-416c-a946-20225f2de62e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:47:59.283644 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3fc88a57-e8a1-416c-a946-20225f2de62e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:59.284225 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3fc88a57-e8a1-416c-a946-20225f2de62e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:59.284986 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3fc88a57-e8a1-416c-a946-20225f2de62e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:47:59.285426 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3fc88a57-e8a1-416c-a946-20225f2de62e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:47:59.349755 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-3fc88a57-e8a1-416c-a946-20225f2de62e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:59.357455 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-3fc88a57-e8a1-416c-a946-20225f2de62e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.085088 Oct 29 01:47:59.358029 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1126/2425] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:59 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:59.995733 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-fa88ccdc-9e20-48dc-b941-8d38e312f733 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:59.996347 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-fa88ccdc-9e20-48dc-b941-8d38e312f733 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:48:00.003258 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fa88ccdc-9e20-48dc-b941-8d38e312f733 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:00.003708 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fa88ccdc-9e20-48dc-b941-8d38e312f733 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:00.004466 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fa88ccdc-9e20-48dc-b941-8d38e312f733 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:00.004901 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-fa88ccdc-9e20-48dc-b941-8d38e312f733 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:00.062242 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-fa88ccdc-9e20-48dc-b941-8d38e312f733 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:00.070576 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-fa88ccdc-9e20-48dc-b941-8d38e312f733 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.078425 Oct 29 01:48:00.071134 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1300/2426] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:47:59 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:00.374110 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-2aa92942-e120-4c88-8ae5-84456237943e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:00.374728 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-2aa92942-e120-4c88-8ae5-84456237943e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:48:00.381219 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2aa92942-e120-4c88-8ae5-84456237943e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:00.381660 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2aa92942-e120-4c88-8ae5-84456237943e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:00.382435 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2aa92942-e120-4c88-8ae5-84456237943e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:00.382870 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-2aa92942-e120-4c88-8ae5-84456237943e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:00.444972 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-2aa92942-e120-4c88-8ae5-84456237943e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:00.453262 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-2aa92942-e120-4c88-8ae5-84456237943e tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.082741 Oct 29 01:48:00.453814 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1127/2427] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:48:00 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:01.087244 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c5b4d069-96d9-46b9-b340-e60d41f18336 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:01.087788 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c5b4d069-96d9-46b9-b340-e60d41f18336 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:48:01.094634 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c5b4d069-96d9-46b9-b340-e60d41f18336 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:01.095079 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c5b4d069-96d9-46b9-b340-e60d41f18336 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:01.095833 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c5b4d069-96d9-46b9-b340-e60d41f18336 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:01.096263 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c5b4d069-96d9-46b9-b340-e60d41f18336 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:01.154244 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c5b4d069-96d9-46b9-b340-e60d41f18336 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:01.162284 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c5b4d069-96d9-46b9-b340-e60d41f18336 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.078708 Oct 29 01:48:01.162866 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1301/2428] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:48:01 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:01.469929 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-cb492aee-a872-4385-a1f5-14c3a6614091 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:01.470554 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-cb492aee-a872-4385-a1f5-14c3a6614091 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:48:01.476676 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cb492aee-a872-4385-a1f5-14c3a6614091 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:01.477122 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cb492aee-a872-4385-a1f5-14c3a6614091 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:01.477874 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cb492aee-a872-4385-a1f5-14c3a6614091 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:01.478303 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-cb492aee-a872-4385-a1f5-14c3a6614091 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:01.537130 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-cb492aee-a872-4385-a1f5-14c3a6614091 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:01.544746 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-cb492aee-a872-4385-a1f5-14c3a6614091 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.078539 Oct 29 01:48:01.545296 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1128/2429] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:48:01 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:02.178118 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9e9be05d-403e-4ab9-bbe1-f5f0e6cdbc42 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:02.178871 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9e9be05d-403e-4ab9-bbe1-f5f0e6cdbc42 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:48:02.185188 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9e9be05d-403e-4ab9-bbe1-f5f0e6cdbc42 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:02.185635 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9e9be05d-403e-4ab9-bbe1-f5f0e6cdbc42 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:02.186411 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9e9be05d-403e-4ab9-bbe1-f5f0e6cdbc42 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:02.186851 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9e9be05d-403e-4ab9-bbe1-f5f0e6cdbc42 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:02.245338 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-9e9be05d-403e-4ab9-bbe1-f5f0e6cdbc42 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:02.253116 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9e9be05d-403e-4ab9-bbe1-f5f0e6cdbc42 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.078748 Oct 29 01:48:02.253678 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1302/2430] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:48:02 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:02.562209 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-92dc1180-a832-416f-983a-d684e738b983 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:02.562810 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-92dc1180-a832-416f-983a-d684e738b983 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:48:02.568958 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-92dc1180-a832-416f-983a-d684e738b983 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:02.569403 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-92dc1180-a832-416f-983a-d684e738b983 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:02.570151 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-92dc1180-a832-416f-983a-d684e738b983 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:02.570607 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-92dc1180-a832-416f-983a-d684e738b983 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:02.629744 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-92dc1180-a832-416f-983a-d684e738b983 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:02.637365 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-92dc1180-a832-416f-983a-d684e738b983 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.079068 Oct 29 01:48:02.637919 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1129/2431] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:48:02 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:03.268844 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-eb14930b-0150-4a84-8929-1a9b88b7ce0c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:03.269435 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-eb14930b-0150-4a84-8929-1a9b88b7ce0c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:48:03.275809 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-eb14930b-0150-4a84-8929-1a9b88b7ce0c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:03.276306 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-eb14930b-0150-4a84-8929-1a9b88b7ce0c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:03.277069 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-eb14930b-0150-4a84-8929-1a9b88b7ce0c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:03.277506 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-eb14930b-0150-4a84-8929-1a9b88b7ce0c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:03.337212 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-eb14930b-0150-4a84-8929-1a9b88b7ce0c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:03.345659 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-eb14930b-0150-4a84-8929-1a9b88b7ce0c tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.080540 Oct 29 01:48:03.346229 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1303/2432] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:48:03 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:03.655049 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-42c30f9f-b739-4cf7-8a3e-416f9d70a042 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:03.655669 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-42c30f9f-b739-4cf7-8a3e-416f9d70a042 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:48:03.662380 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-42c30f9f-b739-4cf7-8a3e-416f9d70a042 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:03.662854 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-42c30f9f-b739-4cf7-8a3e-416f9d70a042 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:03.663610 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-42c30f9f-b739-4cf7-8a3e-416f9d70a042 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:03.664050 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-42c30f9f-b739-4cf7-8a3e-416f9d70a042 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:03.729553 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-42c30f9f-b739-4cf7-8a3e-416f9d70a042 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:03.737864 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-42c30f9f-b739-4cf7-8a3e-416f9d70a042 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.086731 Oct 29 01:48:03.738623 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1130/2433] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:48:03 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:04.361413 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-96cd7df2-5ac5-40ff-a061-0177a66b9b22 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:04.362016 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-96cd7df2-5ac5-40ff-a061-0177a66b9b22 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:48:04.368213 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-96cd7df2-5ac5-40ff-a061-0177a66b9b22 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:04.368652 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-96cd7df2-5ac5-40ff-a061-0177a66b9b22 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:04.369399 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-96cd7df2-5ac5-40ff-a061-0177a66b9b22 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:04.369825 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-96cd7df2-5ac5-40ff-a061-0177a66b9b22 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:04.427933 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-96cd7df2-5ac5-40ff-a061-0177a66b9b22 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:04.435724 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-96cd7df2-5ac5-40ff-a061-0177a66b9b22 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.078624 Oct 29 01:48:04.436318 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1304/2434] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:48:04 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:04.755148 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-3d81df21-f891-4a01-a263-7d756079400a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:04.755760 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-3d81df21-f891-4a01-a263-7d756079400a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:48:04.761976 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3d81df21-f891-4a01-a263-7d756079400a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:04.762463 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3d81df21-f891-4a01-a263-7d756079400a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:04.763233 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3d81df21-f891-4a01-a263-7d756079400a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:04.763670 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-3d81df21-f891-4a01-a263-7d756079400a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:04.821961 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-3d81df21-f891-4a01-a263-7d756079400a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:04.830078 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-3d81df21-f891-4a01-a263-7d756079400a tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.078710 Oct 29 01:48:04.830672 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1131/2435] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:48:04 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:05.455062 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-884ace3a-6481-46dd-b830-4bc8a2da2caf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:05.455658 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-884ace3a-6481-46dd-b830-4bc8a2da2caf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:48:05.461863 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-884ace3a-6481-46dd-b830-4bc8a2da2caf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:05.462312 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-884ace3a-6481-46dd-b830-4bc8a2da2caf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:05.463106 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-884ace3a-6481-46dd-b830-4bc8a2da2caf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:05.463536 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-884ace3a-6481-46dd-b830-4bc8a2da2caf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:05.523395 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-884ace3a-6481-46dd-b830-4bc8a2da2caf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:05.531535 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-884ace3a-6481-46dd-b830-4bc8a2da2caf tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.080756 Oct 29 01:48:05.532107 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1305/2436] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:48:05 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:05.846720 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-efc1f297-9ec0-4bbc-81f0-5dce0f83f825 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:05.847364 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-efc1f297-9ec0-4bbc-81f0-5dce0f83f825 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:48:05.853633 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-efc1f297-9ec0-4bbc-81f0-5dce0f83f825 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:05.854089 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-efc1f297-9ec0-4bbc-81f0-5dce0f83f825 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:05.854891 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-efc1f297-9ec0-4bbc-81f0-5dce0f83f825 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:05.855331 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-efc1f297-9ec0-4bbc-81f0-5dce0f83f825 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:05.913513 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-efc1f297-9ec0-4bbc-81f0-5dce0f83f825 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:05.921173 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-efc1f297-9ec0-4bbc-81f0-5dce0f83f825 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.078114 Oct 29 01:48:05.922231 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1132/2437] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:48:05 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:06.548456 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-2356e529-15b3-4c6c-92c4-fc3a9f58400e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:06.549046 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-2356e529-15b3-4c6c-92c4-fc3a9f58400e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:48:06.555353 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2356e529-15b3-4c6c-92c4-fc3a9f58400e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:06.555806 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2356e529-15b3-4c6c-92c4-fc3a9f58400e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:06.556562 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2356e529-15b3-4c6c-92c4-fc3a9f58400e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:06.557001 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2356e529-15b3-4c6c-92c4-fc3a9f58400e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:06.615893 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-2356e529-15b3-4c6c-92c4-fc3a9f58400e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:06.623585 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-2356e529-15b3-4c6c-92c4-fc3a9f58400e tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.079394 Oct 29 01:48:06.624141 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1306/2438] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:48:06 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:06.939249 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-a098d923-5e94-4f83-a155-12624124ef1d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:06.939888 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-a098d923-5e94-4f83-a155-12624124ef1d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:48:06.945988 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a098d923-5e94-4f83-a155-12624124ef1d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:06.946456 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a098d923-5e94-4f83-a155-12624124ef1d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:06.947210 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a098d923-5e94-4f83-a155-12624124ef1d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:06.947642 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a098d923-5e94-4f83-a155-12624124ef1d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:07.012812 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-a098d923-5e94-4f83-a155-12624124ef1d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:07.020447 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-a098d923-5e94-4f83-a155-12624124ef1d tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.085405 Oct 29 01:48:07.021013 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1133/2439] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:48:06 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:07.639916 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-cf5e92cc-fc34-48e3-a289-f6eca7588fea tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:07.640530 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-cf5e92cc-fc34-48e3-a289-f6eca7588fea tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:48:07.646777 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cf5e92cc-fc34-48e3-a289-f6eca7588fea tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:07.647231 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cf5e92cc-fc34-48e3-a289-f6eca7588fea tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:07.647994 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cf5e92cc-fc34-48e3-a289-f6eca7588fea tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:07.648433 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-cf5e92cc-fc34-48e3-a289-f6eca7588fea tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:07.707272 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-cf5e92cc-fc34-48e3-a289-f6eca7588fea tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:07.714915 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-cf5e92cc-fc34-48e3-a289-f6eca7588fea tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.078689 Oct 29 01:48:07.715472 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1307/2440] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:48:07 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:08.037345 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f996a6a6-d5d8-46d8-81e1-f2a243b6d18c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:08.037954 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f996a6a6-d5d8-46d8-81e1-f2a243b6d18c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:48:08.044362 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f996a6a6-d5d8-46d8-81e1-f2a243b6d18c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:08.044809 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f996a6a6-d5d8-46d8-81e1-f2a243b6d18c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:08.045554 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f996a6a6-d5d8-46d8-81e1-f2a243b6d18c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:08.045982 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f996a6a6-d5d8-46d8-81e1-f2a243b6d18c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:08.108138 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-f996a6a6-d5d8-46d8-81e1-f2a243b6d18c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:08.116797 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f996a6a6-d5d8-46d8-81e1-f2a243b6d18c tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.083127 Oct 29 01:48:08.117363 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1134/2441] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:48:08 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:08.730699 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-66680eb1-65b1-4193-b27d-033a46fc6249 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:08.731306 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-66680eb1-65b1-4193-b27d-033a46fc6249 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:48:08.737553 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-66680eb1-65b1-4193-b27d-033a46fc6249 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:08.737995 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-66680eb1-65b1-4193-b27d-033a46fc6249 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:08.738777 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-66680eb1-65b1-4193-b27d-033a46fc6249 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:08.739208 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-66680eb1-65b1-4193-b27d-033a46fc6249 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:08.797320 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-66680eb1-65b1-4193-b27d-033a46fc6249 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:08.804924 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-66680eb1-65b1-4193-b27d-033a46fc6249 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.077974 Oct 29 01:48:08.805479 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1308/2442] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:48:08 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:09.133486 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-76465dd5-42a1-4fb3-8c50-aea07e64cca6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:09.134102 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-76465dd5-42a1-4fb3-8c50-aea07e64cca6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:48:09.140536 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-76465dd5-42a1-4fb3-8c50-aea07e64cca6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:09.140985 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-76465dd5-42a1-4fb3-8c50-aea07e64cca6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:09.141744 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-76465dd5-42a1-4fb3-8c50-aea07e64cca6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:09.142180 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-76465dd5-42a1-4fb3-8c50-aea07e64cca6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:09.200543 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-76465dd5-42a1-4fb3-8c50-aea07e64cca6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:09.208245 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-76465dd5-42a1-4fb3-8c50-aea07e64cca6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.078505 Oct 29 01:48:09.208804 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1135/2443] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:48:09 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:48:09.821854 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ca7c309e-60e4-4785-8d8b-0cf08432bd07 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:09.822467 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ca7c309e-60e4-4785-8d8b-0cf08432bd07 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:48:09.829292 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ca7c309e-60e4-4785-8d8b-0cf08432bd07 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:09.829714 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ca7c309e-60e4-4785-8d8b-0cf08432bd07 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:09.830490 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ca7c309e-60e4-4785-8d8b-0cf08432bd07 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:09.830921 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ca7c309e-60e4-4785-8d8b-0cf08432bd07 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:09.890936 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-ca7c309e-60e4-4785-8d8b-0cf08432bd07 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:09.898472 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ca7c309e-60e4-4785-8d8b-0cf08432bd07 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.080376 Oct 29 01:48:09.899027 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1309/2444] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:48:09 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:10.224912 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-a3f3d8da-86eb-4a75-af82-52aef877d943 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:10.225532 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-a3f3d8da-86eb-4a75-af82-52aef877d943 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:48:10.231906 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a3f3d8da-86eb-4a75-af82-52aef877d943 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:10.232358 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a3f3d8da-86eb-4a75-af82-52aef877d943 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:10.233159 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a3f3d8da-86eb-4a75-af82-52aef877d943 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:10.233596 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a3f3d8da-86eb-4a75-af82-52aef877d943 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:10.298402 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-a3f3d8da-86eb-4a75-af82-52aef877d943 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:10.306183 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-a3f3d8da-86eb-4a75-af82-52aef877d943 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.085024 Oct 29 01:48:10.306785 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1136/2445] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:48:10 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:10.915696 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-1191e31e-3e15-4093-846a-8c5040fa5abc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:10.916303 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-1191e31e-3e15-4093-846a-8c5040fa5abc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:48:10.922512 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1191e31e-3e15-4093-846a-8c5040fa5abc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:10.922957 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1191e31e-3e15-4093-846a-8c5040fa5abc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:10.923708 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1191e31e-3e15-4093-846a-8c5040fa5abc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:10.924132 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-1191e31e-3e15-4093-846a-8c5040fa5abc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:10.985250 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-1191e31e-3e15-4093-846a-8c5040fa5abc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:10.993005 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-1191e31e-3e15-4093-846a-8c5040fa5abc tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.081004 Oct 29 01:48:10.993561 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1310/2446] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:48:10 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:11.323584 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-7c57a3ea-02da-452b-81f0-693e35ceb2d5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:11.324194 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-7c57a3ea-02da-452b-81f0-693e35ceb2d5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:48:11.330773 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7c57a3ea-02da-452b-81f0-693e35ceb2d5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:11.331225 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7c57a3ea-02da-452b-81f0-693e35ceb2d5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:11.331993 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7c57a3ea-02da-452b-81f0-693e35ceb2d5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:11.332437 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7c57a3ea-02da-452b-81f0-693e35ceb2d5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:11.390973 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-7c57a3ea-02da-452b-81f0-693e35ceb2d5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:11.398670 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-7c57a3ea-02da-452b-81f0-693e35ceb2d5 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.078828 Oct 29 01:48:11.399240 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1137/2447] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:48:11 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:12.011234 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-df845d27-46a1-4425-bc2f-e3f09e4efc03 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:12.011850 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-df845d27-46a1-4425-bc2f-e3f09e4efc03 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:48:12.019090 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-df845d27-46a1-4425-bc2f-e3f09e4efc03 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:12.019545 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-df845d27-46a1-4425-bc2f-e3f09e4efc03 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:12.020307 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-df845d27-46a1-4425-bc2f-e3f09e4efc03 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:12.020740 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-df845d27-46a1-4425-bc2f-e3f09e4efc03 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:12.079675 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-df845d27-46a1-4425-bc2f-e3f09e4efc03 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:12.087393 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-df845d27-46a1-4425-bc2f-e3f09e4efc03 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.079865 Oct 29 01:48:12.087957 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1311/2448] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:48:12 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:12.265620 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-fbf8b1cf-12c8-464c-b719-d33f12a17a4a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:12.266036 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-fbf8b1cf-12c8-464c-b719-d33f12a17a4a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:48:12.274042 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fbf8b1cf-12c8-464c-b719-d33f12a17a4a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:12.274636 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fbf8b1cf-12c8-464c-b719-d33f12a17a4a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:12.275428 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fbf8b1cf-12c8-464c-b719-d33f12a17a4a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:12.275848 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fbf8b1cf-12c8-464c-b719-d33f12a17a4a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:12.299488 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-fbf8b1cf-12c8-464c-b719-d33f12a17a4a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Going to try to terminate instance {{(pid=115748) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 01:48:12.371423 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-fbf8b1cf-12c8-464c-b719-d33f12a17a4a tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "DELETE /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019" status: 204 len: 0 microversion: 2.1 time: 0.109396 Oct 29 01:48:12.372167 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1138/2449] 10.222.0.90 () {58 vars in 1238 bytes} [Fri Oct 29 01:48:12 2021] DELETE /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:48:12.380821 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-81cab65b-9dec-402b-9ed0-c85598813c36 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:12.381622 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-81cab65b-9dec-402b-9ed0-c85598813c36 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:48:12.387486 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-81cab65b-9dec-402b-9ed0-c85598813c36 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:12.387929 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-81cab65b-9dec-402b-9ed0-c85598813c36 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:12.388690 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-81cab65b-9dec-402b-9ed0-c85598813c36 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:12.389121 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-81cab65b-9dec-402b-9ed0-c85598813c36 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:12.416150 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-88e9a8ea-23c2-4df3-8e42-83173bddfa42 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:12.416850 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-88e9a8ea-23c2-4df3-8e42-83173bddfa42 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:48:12.422844 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-88e9a8ea-23c2-4df3-8e42-83173bddfa42 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:12.423302 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-88e9a8ea-23c2-4df3-8e42-83173bddfa42 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:12.424068 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-88e9a8ea-23c2-4df3-8e42-83173bddfa42 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:12.424503 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-88e9a8ea-23c2-4df3-8e42-83173bddfa42 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:12.502235 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-88e9a8ea-23c2-4df3-8e42-83173bddfa42 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:12.510162 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-88e9a8ea-23c2-4df3-8e42-83173bddfa42 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.097956 Oct 29 01:48:12.510777 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1139/2450] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:48:12 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:48:12.533787 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-81cab65b-9dec-402b-9ed0-c85598813c36 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2e7072a6214e9fb3b1fdc341b2d702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9478c9b68c774f5cbffc9f7b559fc86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:12.541023 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-81cab65b-9dec-402b-9ed0-c85598813c36 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "GET /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019" status: 200 len: 1673 microversion: 2.1 time: 0.163946 Oct 29 01:48:12.541579 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1312/2451] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:48:12 2021] GET /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019 => generated 1673 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:48:13.228128 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-7510f8f0-e10b-4075-ad23-d5c6a9ca6122 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:13.228744 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-7510f8f0-e10b-4075-ad23-d5c6a9ca6122 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:48:13.234738 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7510f8f0-e10b-4075-ad23-d5c6a9ca6122 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:13.235195 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7510f8f0-e10b-4075-ad23-d5c6a9ca6122 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:13.235957 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7510f8f0-e10b-4075-ad23-d5c6a9ca6122 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:13.236960 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7510f8f0-e10b-4075-ad23-d5c6a9ca6122 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:13.295686 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-7510f8f0-e10b-4075-ad23-d5c6a9ca6122 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:13.303885 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-7510f8f0-e10b-4075-ad23-d5c6a9ca6122 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.203086 Oct 29 01:48:13.304443 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1140/2452] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:48:13 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:13.527941 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c89fa0cc-ae15-4f84-a4ce-d5a69b0fe9e6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:13.528548 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c89fa0cc-ae15-4f84-a4ce-d5a69b0fe9e6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] [instance: 97b0ab6c-d7cb-4e53-9288-3b6b2040a24d] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:48:13.535788 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c89fa0cc-ae15-4f84-a4ce-d5a69b0fe9e6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:13.536388 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c89fa0cc-ae15-4f84-a4ce-d5a69b0fe9e6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:13.537193 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c89fa0cc-ae15-4f84-a4ce-d5a69b0fe9e6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:13.537839 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c89fa0cc-ae15-4f84-a4ce-d5a69b0fe9e6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:13.558438 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-7edf411c-20b7-4397-b43a-69da40b43a40 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:13.559156 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-7edf411c-20b7-4397-b43a-69da40b43a40 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:48:13.576225 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7edf411c-20b7-4397-b43a-69da40b43a40 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:13.576763 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7edf411c-20b7-4397-b43a-69da40b43a40 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:13.577626 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7edf411c-20b7-4397-b43a-69da40b43a40 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:13.578146 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7edf411c-20b7-4397-b43a-69da40b43a40 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:13.610853 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c89fa0cc-ae15-4f84-a4ce-d5a69b0fe9e6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b5e84fef6c4b3dabb6caaa8ad3aa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b83d8a1a4943748e8980793c6fbec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:13.619044 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c89fa0cc-ae15-4f84-a4ce-d5a69b0fe9e6 tempest-VolumesSnapshotTestJSON-860400721 tempest-VolumesSnapshotTestJSON-860400721-project] 10.222.0.90 "GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d" status: 200 len: 1349 microversion: 2.1 time: 0.095283 Oct 29 01:48:13.619826 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1313/2453] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:48:13 2021] GET /compute/v2.1/servers/97b0ab6c-d7cb-4e53-9288-3b6b2040a24d => generated 1349 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:13.718543 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-7edf411c-20b7-4397-b43a-69da40b43a40 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2e7072a6214e9fb3b1fdc341b2d702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9478c9b68c774f5cbffc9f7b559fc86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:13.727018 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-7edf411c-20b7-4397-b43a-69da40b43a40 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "GET /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019" status: 200 len: 1673 microversion: 2.1 time: 0.172676 Oct 29 01:48:13.728166 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1141/2454] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:48:13 2021] GET /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019 => generated 1673 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:48:14.320301 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-6c92be8f-3f99-4c54-8195-128d2b7fbe6f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:14.320912 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-6c92be8f-3f99-4c54-8195-128d2b7fbe6f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:48:14.326985 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6c92be8f-3f99-4c54-8195-128d2b7fbe6f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:14.327438 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6c92be8f-3f99-4c54-8195-128d2b7fbe6f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:14.328206 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6c92be8f-3f99-4c54-8195-128d2b7fbe6f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:14.328644 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6c92be8f-3f99-4c54-8195-128d2b7fbe6f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:14.393632 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-6c92be8f-3f99-4c54-8195-128d2b7fbe6f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:14.401783 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-6c92be8f-3f99-4c54-8195-128d2b7fbe6f tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1353 microversion: 2.1 time: 0.085098 Oct 29 01:48:14.402351 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1314/2455] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:48:14 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:14.747210 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-394def1a-27e0-4fa6-8b3a-8bbda461e994 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:14.747835 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-394def1a-27e0-4fa6-8b3a-8bbda461e994 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:48:14.754699 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-394def1a-27e0-4fa6-8b3a-8bbda461e994 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:14.755167 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-394def1a-27e0-4fa6-8b3a-8bbda461e994 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:14.755960 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-394def1a-27e0-4fa6-8b3a-8bbda461e994 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:14.756391 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-394def1a-27e0-4fa6-8b3a-8bbda461e994 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:14.818306 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-394def1a-27e0-4fa6-8b3a-8bbda461e994 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2e7072a6214e9fb3b1fdc341b2d702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9478c9b68c774f5cbffc9f7b559fc86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:14.841015 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-394def1a-27e0-4fa6-8b3a-8bbda461e994 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "GET /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019" status: 200 len: 1606 microversion: 2.1 time: 0.097417 Oct 29 01:48:14.841731 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1142/2456] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:48:14 2021] GET /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019 => generated 1606 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:48:15.360324 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [req-44da0a79-8764-4b68-8cb6-e2d67fc82066 req-b0ad9118-2b3d-452c-be49-dd22c597a3d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0014609-7d4d-4959-a30a-1f7001aa2019", "name": "network-vif-deleted", "tag": "82e879d7-87f5-437f-9a71-954eb07957ab"}]} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:48:15.362287 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:48:15.362287 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: warnings.warn(msg) Oct 29 01:48:15.370921 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-44da0a79-8764-4b68-8cb6-e2d67fc82066 req-b0ad9118-2b3d-452c-be49-dd22c597a3d1 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:15.371438 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-44da0a79-8764-4b68-8cb6-e2d67fc82066 req-b0ad9118-2b3d-452c-be49-dd22c597a3d1 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:15.386837 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.compute.server_external_events [req-44da0a79-8764-4b68-8cb6-e2d67fc82066 req-b0ad9118-2b3d-452c-be49-dd22c597a3d1 service nova] Creating event network-vif-deleted:82e879d7-87f5-437f-9a71-954eb07957ab for instance d0014609-7d4d-4959-a30a-1f7001aa2019 on hv-cinder-81558 Oct 29 01:48:15.393438 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [req-44da0a79-8764-4b68-8cb6-e2d67fc82066 req-b0ad9118-2b3d-452c-be49-dd22c597a3d1 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036354 Oct 29 01:48:15.394340 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1315/2457] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:48:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:48:15.424048 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-b5f1b84d-0f12-4205-80c8-d5e979442020 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:15.424657 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-b5f1b84d-0f12-4205-80c8-d5e979442020 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:48:15.433106 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b5f1b84d-0f12-4205-80c8-d5e979442020 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:15.433289 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b5f1b84d-0f12-4205-80c8-d5e979442020 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:15.434077 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b5f1b84d-0f12-4205-80c8-d5e979442020 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:15.434559 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b5f1b84d-0f12-4205-80c8-d5e979442020 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:15.474525 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b5f1b84d-0f12-4205-80c8-d5e979442020 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:15.475096 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b5f1b84d-0f12-4205-80c8-d5e979442020 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:15.475754 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.objects.instance [None req-b5f1b84d-0f12-4205-80c8-d5e979442020 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lazy-loading 'fault' on Instance uuid 0ff6277c-b59e-467c-82d4-631046fb03d9 {{(pid=115748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:48:15.559336 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-b5f1b84d-0f12-4205-80c8-d5e979442020 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a83b53318d4a5c8e9ed1e42647d5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31da6d496ca244679f9c7cfc129ca1c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:15.568701 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-b5f1b84d-0f12-4205-80c8-d5e979442020 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 200 len: 1447 microversion: 2.1 time: 0.148210 Oct 29 01:48:15.569382 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1143/2458] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:48:15 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 1447 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:15.858698 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ee47bc93-a46b-4faa-8a7a-cc11203c9a62 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:15.859689 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ee47bc93-a46b-4faa-8a7a-cc11203c9a62 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:48:15.866769 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ee47bc93-a46b-4faa-8a7a-cc11203c9a62 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:15.867222 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ee47bc93-a46b-4faa-8a7a-cc11203c9a62 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:15.867987 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ee47bc93-a46b-4faa-8a7a-cc11203c9a62 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:15.868413 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ee47bc93-a46b-4faa-8a7a-cc11203c9a62 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:15.902933 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ee47bc93-a46b-4faa-8a7a-cc11203c9a62 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:15.903381 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ee47bc93-a46b-4faa-8a7a-cc11203c9a62 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:15.903847 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.objects.instance [None req-ee47bc93-a46b-4faa-8a7a-cc11203c9a62 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lazy-loading 'fault' on Instance uuid d0014609-7d4d-4959-a30a-1f7001aa2019 {{(pid=115747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:48:15.949433 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-ee47bc93-a46b-4faa-8a7a-cc11203c9a62 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2e7072a6214e9fb3b1fdc341b2d702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9478c9b68c774f5cbffc9f7b559fc86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:15.968581 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ee47bc93-a46b-4faa-8a7a-cc11203c9a62 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "GET /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019" status: 200 len: 1327 microversion: 2.1 time: 0.113832 Oct 29 01:48:15.969585 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1316/2459] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:48:15 2021] GET /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019 => generated 1327 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:16.586430 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-61d93de6-4611-43a8-8ac2-31e6bc6e9559 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:16.587143 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-61d93de6-4611-43a8-8ac2-31e6bc6e9559 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] [instance: 0ff6277c-b59e-467c-82d4-631046fb03d9] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:48:16.593013 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-61d93de6-4611-43a8-8ac2-31e6bc6e9559 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:16.593913 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-61d93de6-4611-43a8-8ac2-31e6bc6e9559 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:16.594717 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-61d93de6-4611-43a8-8ac2-31e6bc6e9559 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:16.595166 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-61d93de6-4611-43a8-8ac2-31e6bc6e9559 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:16.608651 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.wsgi [None req-61d93de6-4611-43a8-8ac2-31e6bc6e9559 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] HTTP exception thrown: Instance 0ff6277c-b59e-467c-82d4-631046fb03d9 could not be found. Oct 29 01:48:16.609247 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-61d93de6-4611-43a8-8ac2-31e6bc6e9559 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] Returning 404 to user: Instance 0ff6277c-b59e-467c-82d4-631046fb03d9 could not be found. {{(pid=115748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:48:16.610082 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-61d93de6-4611-43a8-8ac2-31e6bc6e9559 tempest-ServerRescueNegativeTestJSON-1280322587 tempest-ServerRescueNegativeTestJSON-1280322587-project] 10.222.0.90 "GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9" status: 404 len: 111 microversion: 2.1 time: 0.027729 Oct 29 01:48:16.610670 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1144/2460] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:48:16 2021] GET /compute/v2.1/servers/0ff6277c-b59e-467c-82d4-631046fb03d9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:48:16.986926 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-5616e51c-1095-449c-9163-ad8af86a97ce tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:16.987539 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-5616e51c-1095-449c-9163-ad8af86a97ce tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:48:16.993745 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5616e51c-1095-449c-9163-ad8af86a97ce tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:16.994127 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5616e51c-1095-449c-9163-ad8af86a97ce tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:16.994918 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5616e51c-1095-449c-9163-ad8af86a97ce tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:16.995358 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-5616e51c-1095-449c-9163-ad8af86a97ce tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:17.009636 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.wsgi [None req-5616e51c-1095-449c-9163-ad8af86a97ce tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] HTTP exception thrown: Instance d0014609-7d4d-4959-a30a-1f7001aa2019 could not be found. Oct 29 01:48:17.010233 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-5616e51c-1095-449c-9163-ad8af86a97ce tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Returning 404 to user: Instance d0014609-7d4d-4959-a30a-1f7001aa2019 could not be found. {{(pid=115747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:48:17.011118 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-5616e51c-1095-449c-9163-ad8af86a97ce tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "GET /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019" status: 404 len: 111 microversion: 2.1 time: 0.027952 Oct 29 01:48:17.011674 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1317/2461] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:48:16 2021] GET /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:48:17.020603 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c9e9e1af-8443-4b91-ace6-e9138625db45 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Calling method '.version_select at 0x7f60292b3700>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:17.042529 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c9e9e1af-8443-4b91-ace6-e9138625db45 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-203162948" status: 202 len: 0 microversion: 2.1 time: 0.026217 Oct 29 01:48:17.043111 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1145/2462] 10.222.0.90 () {58 vars in 1217 bytes} [Fri Oct 29 01:48:17 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-203162948 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:48:17.982306 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-446275b7-eaed-4d29-b86b-7ca8dcf82ef8 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:17.982842 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-446275b7-eaed-4d29-b86b-7ca8dcf82ef8 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:48:17.988521 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-446275b7-eaed-4d29-b86b-7ca8dcf82ef8 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:17.989095 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-446275b7-eaed-4d29-b86b-7ca8dcf82ef8 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:17.989713 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-446275b7-eaed-4d29-b86b-7ca8dcf82ef8 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:17.990146 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-446275b7-eaed-4d29-b86b-7ca8dcf82ef8 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:18.009825 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.wsgi [None req-446275b7-eaed-4d29-b86b-7ca8dcf82ef8 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] HTTP exception thrown: Instance d0014609-7d4d-4959-a30a-1f7001aa2019 could not be found. Oct 29 01:48:18.010474 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-446275b7-eaed-4d29-b86b-7ca8dcf82ef8 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Returning 404 to user: Instance d0014609-7d4d-4959-a30a-1f7001aa2019 could not be found. {{(pid=115747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:48:18.011300 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-446275b7-eaed-4d29-b86b-7ca8dcf82ef8 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "DELETE /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019" status: 404 len: 111 microversion: 2.1 time: 0.032679 Oct 29 01:48:18.011851 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1318/2463] 10.222.0.90 () {58 vars in 1238 bytes} [Fri Oct 29 01:48:17 2021] DELETE /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:48:18.020799 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-6afcc7d4-db18-478d-a48b-2d7ea40e6c66 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:18.021419 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-6afcc7d4-db18-478d-a48b-2d7ea40e6c66 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: d0014609-7d4d-4959-a30a-1f7001aa2019] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:48:18.028674 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6afcc7d4-db18-478d-a48b-2d7ea40e6c66 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:18.029341 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6afcc7d4-db18-478d-a48b-2d7ea40e6c66 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:18.030122 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6afcc7d4-db18-478d-a48b-2d7ea40e6c66 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:18.030600 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6afcc7d4-db18-478d-a48b-2d7ea40e6c66 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:18.044727 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.wsgi [None req-6afcc7d4-db18-478d-a48b-2d7ea40e6c66 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] HTTP exception thrown: Instance d0014609-7d4d-4959-a30a-1f7001aa2019 could not be found. Oct 29 01:48:18.045298 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-6afcc7d4-db18-478d-a48b-2d7ea40e6c66 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Returning 404 to user: Instance d0014609-7d4d-4959-a30a-1f7001aa2019 could not be found. {{(pid=115748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:48:18.046130 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-6afcc7d4-db18-478d-a48b-2d7ea40e6c66 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "GET /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019" status: 404 len: 111 microversion: 2.1 time: 0.029542 Oct 29 01:48:18.049653 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1146/2464] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:48:18 2021] GET /compute/v2.1/servers/d0014609-7d4d-4959-a30a-1f7001aa2019 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:48:21.275654 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-63f6eb20-6a7f-4ad0-9320-50d0891abc16 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:21.276157 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-63f6eb20-6a7f-4ad0-9320-50d0891abc16 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:48:21.282359 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-63f6eb20-6a7f-4ad0-9320-50d0891abc16 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:21.283333 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-63f6eb20-6a7f-4ad0-9320-50d0891abc16 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:21.284105 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-63f6eb20-6a7f-4ad0-9320-50d0891abc16 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:21.284544 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-63f6eb20-6a7f-4ad0-9320-50d0891abc16 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:21.298067 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.wsgi [None req-63f6eb20-6a7f-4ad0-9320-50d0891abc16 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] HTTP exception thrown: Instance a271df91-65af-42bb-a06e-b3d97b359807 could not be found. Oct 29 01:48:21.299457 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-63f6eb20-6a7f-4ad0-9320-50d0891abc16 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Returning 404 to user: Instance a271df91-65af-42bb-a06e-b3d97b359807 could not be found. {{(pid=115747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:48:21.300285 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-63f6eb20-6a7f-4ad0-9320-50d0891abc16 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "DELETE /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807" status: 404 len: 111 microversion: 2.1 time: 0.028316 Oct 29 01:48:21.300814 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1319/2465] 10.222.0.90 () {58 vars in 1238 bytes} [Fri Oct 29 01:48:21 2021] DELETE /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:48:21.308543 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-fdc5a308-a42b-489f-a5fe-3aefdfc96027 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:21.309155 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-fdc5a308-a42b-489f-a5fe-3aefdfc96027 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] [instance: a271df91-65af-42bb-a06e-b3d97b359807] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:48:21.316037 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fdc5a308-a42b-489f-a5fe-3aefdfc96027 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:21.316556 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fdc5a308-a42b-489f-a5fe-3aefdfc96027 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:21.317499 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fdc5a308-a42b-489f-a5fe-3aefdfc96027 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:48:21.318006 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-fdc5a308-a42b-489f-a5fe-3aefdfc96027 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:48:21.331970 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.wsgi [None req-fdc5a308-a42b-489f-a5fe-3aefdfc96027 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] HTTP exception thrown: Instance a271df91-65af-42bb-a06e-b3d97b359807 could not be found. Oct 29 01:48:21.332541 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-fdc5a308-a42b-489f-a5fe-3aefdfc96027 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] Returning 404 to user: Instance a271df91-65af-42bb-a06e-b3d97b359807 could not be found. {{(pid=115748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:48:21.333512 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-fdc5a308-a42b-489f-a5fe-3aefdfc96027 tempest-AttachVolumeTestJSON-1067450963 tempest-AttachVolumeTestJSON-1067450963-project] 10.222.0.90 "GET /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807" status: 404 len: 111 microversion: 2.1 time: 0.028641 Oct 29 01:48:21.334055 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1147/2466] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:48:21 2021] GET /compute/v2.1/servers/a271df91-65af-42bb-a06e-b3d97b359807 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:49:07.864735 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:49:07.865369 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: Fri Oct 29 01:49:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 29 01:49:20.980613 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:49:20.981217 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: Fri Oct 29 01:49:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 29 01:49:38.768965 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-f31d5c10-b375-4ddd-8567-046f409df0ea tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Action: 'create', calling method: .version_select at 0x7f6029e4b5e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-200730336"}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:49:38.787490 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.quota [None req-f31d5c10-b375-4ddd-8567-046f409df0ea tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Getting quotas for project f3012e3c014548df9b30d08c9deb4dbd. Resources: {'key_pairs'} {{(pid=115747) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:49:38.791218 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.quota [None req-f31d5c10-b375-4ddd-8567-046f409df0ea tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Getting quotas for user ee4de3d6437246eaad32b4c8ea1992c8 and project f3012e3c014548df9b30d08c9deb4dbd. Resources: {'key_pairs'} {{(pid=115747) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:49:38.929652 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.quota [None req-f31d5c10-b375-4ddd-8567-046f409df0ea tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Getting quotas for project f3012e3c014548df9b30d08c9deb4dbd. Resources: {'key_pairs'} {{(pid=115747) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:49:38.933626 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.quota [None req-f31d5c10-b375-4ddd-8567-046f409df0ea tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Getting quotas for user ee4de3d6437246eaad32b4c8ea1992c8 and project f3012e3c014548df9b30d08c9deb4dbd. Resources: {'key_pairs'} {{(pid=115747) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:49:38.947157 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-f31d5c10-b375-4ddd-8567-046f409df0ea tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.182777 Oct 29 01:49:38.947742 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1320/2467] 10.222.0.90 () {60 vars in 1157 bytes} [Fri Oct 29 01:49:38 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:49:38.999332 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-7df08765-cddc-4fa8-8760-7b5d6248f2d9 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1737430349", "imageRef": "c9149f0d-d4fd-4329-814e-2bc7e17e8dc9", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-200730336", "networks": [{"uuid": "1abd9f03-80d3-4975-b9df-fdd840d826fa"}]}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:49:39.048903 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.network.neutron [None req-7df08765-cddc-4fa8-8760-7b5d6248f2d9 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] validate_networks() for [('1abd9f03-80d3-4975-b9df-fdd840d826fa', None, None, None, None, None)] {{(pid=115748) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 01:49:39.422298 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.virt.hardware [None req-7df08765-cddc-4fa8-8760-7b5d6248f2d9 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Flavor limits 0:0:0 {{(pid=115748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:49:39.422744 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.virt.hardware [None req-7df08765-cddc-4fa8-8760-7b5d6248f2d9 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Image limits 0:0:0 {{(pid=115748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:49:39.423209 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.virt.hardware [None req-7df08765-cddc-4fa8-8760-7b5d6248f2d9 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Flavor pref 0:0:0 {{(pid=115748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:49:39.423610 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.virt.hardware [None req-7df08765-cddc-4fa8-8760-7b5d6248f2d9 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Image pref 0:0:0 {{(pid=115748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:49:39.424011 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.virt.hardware [None req-7df08765-cddc-4fa8-8760-7b5d6248f2d9 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:49:39.433123 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7df08765-cddc-4fa8-8760-7b5d6248f2d9 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:49:39.435379 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7df08765-cddc-4fa8-8760-7b5d6248f2d9 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:49:39.436233 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7df08765-cddc-4fa8-8760-7b5d6248f2d9 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:49:39.436667 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-7df08765-cddc-4fa8-8760-7b5d6248f2d9 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:49:39.453063 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.quota [None req-7df08765-cddc-4fa8-8760-7b5d6248f2d9 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Getting quotas for project f3012e3c014548df9b30d08c9deb4dbd. Resources: {'instances', 'cores', 'ram'} {{(pid=115748) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:49:39.456889 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.quota [None req-7df08765-cddc-4fa8-8760-7b5d6248f2d9 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Getting quotas for user ee4de3d6437246eaad32b4c8ea1992c8 and project f3012e3c014548df9b30d08c9deb4dbd. Resources: {'instances', 'cores', 'ram'} {{(pid=115748) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:49:39.467553 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-7df08765-cddc-4fa8-8760-7b5d6248f2d9 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Going to run 1 instances... {{(pid=115748) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 01:49:39.469789 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-7df08765-cddc-4fa8-8760-7b5d6248f2d9 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9149f0d-d4fd-4329-814e-2bc7e17e8dc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 01:49:39.514487 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-7df08765-cddc-4fa8-8760-7b5d6248f2d9 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.519749 Oct 29 01:49:39.515032 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1148/2468] 10.222.0.90 () {60 vars in 1146 bytes} [Fri Oct 29 01:49:38 2021] POST /compute/v2.1/servers => generated 380 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:49:39.525292 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-dd5563c9-eafb-4630-a634-d55482d9b82a tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:49:39.525902 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-dd5563c9-eafb-4630-a634-d55482d9b82a tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:49:39.580669 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-dd5563c9-eafb-4630-a634-d55482d9b82a tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4de3d6437246eaad32b4c8ea1992c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3012e3c014548df9b30d08c9deb4dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:49:39.587883 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-dd5563c9-eafb-4630-a634-d55482d9b82a tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491" status: 200 len: 1258 microversion: 2.1 time: 0.066293 Oct 29 01:49:39.588435 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1321/2469] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:49:39 2021] GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491 => generated 1258 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:49:40.605851 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-37fe9b80-f4bd-4f24-bc74-37962bb5bcba tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:49:40.607306 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-37fe9b80-f4bd-4f24-bc74-37962bb5bcba tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:49:40.613333 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-37fe9b80-f4bd-4f24-bc74-37962bb5bcba tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:49:40.613809 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-37fe9b80-f4bd-4f24-bc74-37962bb5bcba tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:49:40.614807 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-37fe9b80-f4bd-4f24-bc74-37962bb5bcba tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:49:40.615406 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-37fe9b80-f4bd-4f24-bc74-37962bb5bcba tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:49:40.680594 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-37fe9b80-f4bd-4f24-bc74-37962bb5bcba tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4de3d6437246eaad32b4c8ea1992c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3012e3c014548df9b30d08c9deb4dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:49:40.692225 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-37fe9b80-f4bd-4f24-bc74-37962bb5bcba tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491" status: 200 len: 1328 microversion: 2.1 time: 0.090607 Oct 29 01:49:40.692783 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1149/2470] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:49:40 2021] GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491 => generated 1328 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:49:41.709759 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-291c47fb-8fb6-4694-8dfc-ae4d5b97ee6d tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:49:41.711235 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-291c47fb-8fb6-4694-8dfc-ae4d5b97ee6d tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:49:41.719626 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-291c47fb-8fb6-4694-8dfc-ae4d5b97ee6d tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:49:41.720068 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-291c47fb-8fb6-4694-8dfc-ae4d5b97ee6d tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:49:41.720942 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-291c47fb-8fb6-4694-8dfc-ae4d5b97ee6d tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:49:41.721508 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-291c47fb-8fb6-4694-8dfc-ae4d5b97ee6d tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:49:41.850972 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-291c47fb-8fb6-4694-8dfc-ae4d5b97ee6d tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4de3d6437246eaad32b4c8ea1992c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3012e3c014548df9b30d08c9deb4dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:49:41.858605 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-291c47fb-8fb6-4694-8dfc-ae4d5b97ee6d tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491" status: 200 len: 1358 microversion: 2.1 time: 0.153233 Oct 29 01:49:41.859189 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1322/2471] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:49:41 2021] GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:49:42.876406 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-dc66e7dc-a0a2-4c25-8863-4f0bb77455d4 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:49:42.877728 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-dc66e7dc-a0a2-4c25-8863-4f0bb77455d4 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:49:42.884816 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dc66e7dc-a0a2-4c25-8863-4f0bb77455d4 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:49:42.885486 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dc66e7dc-a0a2-4c25-8863-4f0bb77455d4 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:49:42.886349 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dc66e7dc-a0a2-4c25-8863-4f0bb77455d4 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:49:42.886888 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-dc66e7dc-a0a2-4c25-8863-4f0bb77455d4 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:49:43.023598 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-dc66e7dc-a0a2-4c25-8863-4f0bb77455d4 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4de3d6437246eaad32b4c8ea1992c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3012e3c014548df9b30d08c9deb4dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:49:43.031280 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-dc66e7dc-a0a2-4c25-8863-4f0bb77455d4 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491" status: 200 len: 1358 microversion: 2.1 time: 0.158775 Oct 29 01:49:43.031853 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1150/2472] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:49:42 2021] GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:49:44.048533 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-66313036-978f-4025-987d-1bbd5eeaa49d tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:49:44.049079 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-66313036-978f-4025-987d-1bbd5eeaa49d tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:49:44.055456 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-66313036-978f-4025-987d-1bbd5eeaa49d tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:49:44.055910 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-66313036-978f-4025-987d-1bbd5eeaa49d tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:49:44.056671 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-66313036-978f-4025-987d-1bbd5eeaa49d tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:49:44.057105 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-66313036-978f-4025-987d-1bbd5eeaa49d tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:49:44.181707 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-66313036-978f-4025-987d-1bbd5eeaa49d tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4de3d6437246eaad32b4c8ea1992c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3012e3c014548df9b30d08c9deb4dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:49:44.189184 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-66313036-978f-4025-987d-1bbd5eeaa49d tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491" status: 200 len: 1358 microversion: 2.1 time: 0.144373 Oct 29 01:49:44.199251 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1323/2473] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:49:44 2021] GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:49:45.206061 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-9b1b3fdb-6197-485d-ad31-4181a54d063b tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:49:45.206836 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-9b1b3fdb-6197-485d-ad31-4181a54d063b tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:49:45.213481 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9b1b3fdb-6197-485d-ad31-4181a54d063b tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:49:45.213949 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9b1b3fdb-6197-485d-ad31-4181a54d063b tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:49:45.214831 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9b1b3fdb-6197-485d-ad31-4181a54d063b tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:49:45.215336 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9b1b3fdb-6197-485d-ad31-4181a54d063b tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:49:45.345519 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-9b1b3fdb-6197-485d-ad31-4181a54d063b tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4de3d6437246eaad32b4c8ea1992c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3012e3c014548df9b30d08c9deb4dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:49:45.353365 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-9b1b3fdb-6197-485d-ad31-4181a54d063b tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491" status: 200 len: 1358 microversion: 2.1 time: 0.151051 Oct 29 01:49:45.354104 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1151/2474] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:49:45 2021] GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:49:46.369036 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-eb6e182c-1c79-4abe-a06e-25fb7c26ba3c tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:49:46.369674 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-eb6e182c-1c79-4abe-a06e-25fb7c26ba3c tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:49:46.375951 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-eb6e182c-1c79-4abe-a06e-25fb7c26ba3c tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:49:46.376404 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-eb6e182c-1c79-4abe-a06e-25fb7c26ba3c tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:49:46.377181 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-eb6e182c-1c79-4abe-a06e-25fb7c26ba3c tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:49:46.377618 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-eb6e182c-1c79-4abe-a06e-25fb7c26ba3c tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:49:46.508233 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-eb6e182c-1c79-4abe-a06e-25fb7c26ba3c tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4de3d6437246eaad32b4c8ea1992c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3012e3c014548df9b30d08c9deb4dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:49:46.516679 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-eb6e182c-1c79-4abe-a06e-25fb7c26ba3c tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491" status: 200 len: 1358 microversion: 2.1 time: 0.151351 Oct 29 01:49:46.522582 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1324/2475] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:49:46 2021] GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:49:47.537073 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-775c75e1-5875-4542-ac0f-46bfed61e0b0 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:49:47.537795 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-775c75e1-5875-4542-ac0f-46bfed61e0b0 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:49:47.543672 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-775c75e1-5875-4542-ac0f-46bfed61e0b0 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:49:47.544123 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-775c75e1-5875-4542-ac0f-46bfed61e0b0 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:49:47.544885 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-775c75e1-5875-4542-ac0f-46bfed61e0b0 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:49:47.545326 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-775c75e1-5875-4542-ac0f-46bfed61e0b0 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:49:47.669831 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-775c75e1-5875-4542-ac0f-46bfed61e0b0 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4de3d6437246eaad32b4c8ea1992c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3012e3c014548df9b30d08c9deb4dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:49:47.677872 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-775c75e1-5875-4542-ac0f-46bfed61e0b0 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491" status: 200 len: 1358 microversion: 2.1 time: 0.145150 Oct 29 01:49:47.678478 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1152/2476] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:49:47 2021] GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491 => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:49:48.695558 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-2a68497e-6c35-4af6-a771-1fc9b9d12b73 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:49:48.697021 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-2a68497e-6c35-4af6-a771-1fc9b9d12b73 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:49:48.704405 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2a68497e-6c35-4af6-a771-1fc9b9d12b73 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:49:48.705248 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2a68497e-6c35-4af6-a771-1fc9b9d12b73 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:49:48.706260 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2a68497e-6c35-4af6-a771-1fc9b9d12b73 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:49:48.707097 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2a68497e-6c35-4af6-a771-1fc9b9d12b73 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:49:48.852257 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-2a68497e-6c35-4af6-a771-1fc9b9d12b73 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4de3d6437246eaad32b4c8ea1992c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3012e3c014548df9b30d08c9deb4dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:49:48.861276 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-2a68497e-6c35-4af6-a771-1fc9b9d12b73 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491" status: 200 len: 1358 microversion: 2.1 time: 0.168828 Oct 29 01:49:48.861276 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1325/2477] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:49:48 2021] GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:49:49.877281 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-bae1be5e-0d2c-4218-b9ec-8e71ee66d43c tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:49:49.878149 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-bae1be5e-0d2c-4218-b9ec-8e71ee66d43c tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:49:49.885460 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bae1be5e-0d2c-4218-b9ec-8e71ee66d43c tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:49:49.886063 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bae1be5e-0d2c-4218-b9ec-8e71ee66d43c tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:49:49.886907 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bae1be5e-0d2c-4218-b9ec-8e71ee66d43c tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:49:49.887338 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bae1be5e-0d2c-4218-b9ec-8e71ee66d43c tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:49:50.038621 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-bae1be5e-0d2c-4218-b9ec-8e71ee66d43c tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4de3d6437246eaad32b4c8ea1992c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3012e3c014548df9b30d08c9deb4dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:49:50.047572 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-bae1be5e-0d2c-4218-b9ec-8e71ee66d43c tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491" status: 200 len: 1358 microversion: 2.1 time: 0.173976 Oct 29 01:49:50.053709 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1153/2478] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:49:49 2021] GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:49:51.064716 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-3cb47cc5-fce3-4e37-ac9d-0ffdfe57b7ac tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:49:51.065681 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-3cb47cc5-fce3-4e37-ac9d-0ffdfe57b7ac tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:49:51.072059 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3cb47cc5-fce3-4e37-ac9d-0ffdfe57b7ac tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:49:51.072506 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3cb47cc5-fce3-4e37-ac9d-0ffdfe57b7ac tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:49:51.073541 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3cb47cc5-fce3-4e37-ac9d-0ffdfe57b7ac tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:49:51.073977 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3cb47cc5-fce3-4e37-ac9d-0ffdfe57b7ac tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:49:51.195777 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-3cb47cc5-fce3-4e37-ac9d-0ffdfe57b7ac tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4de3d6437246eaad32b4c8ea1992c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3012e3c014548df9b30d08c9deb4dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:49:51.203539 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-3cb47cc5-fce3-4e37-ac9d-0ffdfe57b7ac tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491" status: 200 len: 1358 microversion: 2.1 time: 0.142645 Oct 29 01:49:51.204106 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1326/2479] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:49:51 2021] GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491 => generated 1358 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:49:52.221963 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-907e178f-32aa-4681-b7c3-1db3025b711d tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:49:52.223459 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-907e178f-32aa-4681-b7c3-1db3025b711d tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:49:52.235974 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-907e178f-32aa-4681-b7c3-1db3025b711d tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:49:52.236507 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-907e178f-32aa-4681-b7c3-1db3025b711d tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:49:52.237361 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-907e178f-32aa-4681-b7c3-1db3025b711d tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:49:52.237857 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-907e178f-32aa-4681-b7c3-1db3025b711d tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:49:52.432605 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-907e178f-32aa-4681-b7c3-1db3025b711d tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4de3d6437246eaad32b4c8ea1992c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3012e3c014548df9b30d08c9deb4dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:49:52.443890 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-907e178f-32aa-4681-b7c3-1db3025b711d tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491" status: 200 len: 1358 microversion: 2.1 time: 0.224062 Oct 29 01:49:52.446261 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1154/2480] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:49:52 2021] GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491 => generated 1358 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:49:52.455125 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [req-222dee11-d1e4-4802-88a4-12c4e546b6b9 req-dc430026-f67e-4711-a48a-e9dd3268f57c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "086997a1-a486-4628-ac24-0d6f31459491", "tag": "69a2fb36-b158-4efc-b306-832f2972d25f"}]} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:49:52.457849 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:49:52.457849 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: warnings.warn(msg) Oct 29 01:49:52.465690 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-222dee11-d1e4-4802-88a4-12c4e546b6b9 req-dc430026-f67e-4711-a48a-e9dd3268f57c service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:49:52.466127 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-222dee11-d1e4-4802-88a4-12c4e546b6b9 req-dc430026-f67e-4711-a48a-e9dd3268f57c service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:49:52.478465 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.compute.server_external_events [req-222dee11-d1e4-4802-88a4-12c4e546b6b9 req-dc430026-f67e-4711-a48a-e9dd3268f57c service nova] Creating event network-changed:69a2fb36-b158-4efc-b306-832f2972d25f for instance 086997a1-a486-4628-ac24-0d6f31459491 on hv-cinder-81558 Oct 29 01:49:52.483779 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [req-222dee11-d1e4-4802-88a4-12c4e546b6b9 req-dc430026-f67e-4711-a48a-e9dd3268f57c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.259300 Oct 29 01:49:52.484610 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1327/2481] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:49:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:49:53.463474 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-5452a0cf-4fa7-4045-be2d-0d176c8a7f29 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:49:53.464129 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-5452a0cf-4fa7-4045-be2d-0d176c8a7f29 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:49:53.472710 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5452a0cf-4fa7-4045-be2d-0d176c8a7f29 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:49:53.473299 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5452a0cf-4fa7-4045-be2d-0d176c8a7f29 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:49:53.474096 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5452a0cf-4fa7-4045-be2d-0d176c8a7f29 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:49:53.474572 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5452a0cf-4fa7-4045-be2d-0d176c8a7f29 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:49:53.601375 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-5452a0cf-4fa7-4045-be2d-0d176c8a7f29 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4de3d6437246eaad32b4c8ea1992c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3012e3c014548df9b30d08c9deb4dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:49:53.608970 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-5452a0cf-4fa7-4045-be2d-0d176c8a7f29 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491" status: 200 len: 1358 microversion: 2.1 time: 0.149445 Oct 29 01:49:53.609532 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1155/2482] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:49:53 2021] GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:49:54.626742 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-dbce0448-f3d9-43b5-b295-f5d206ddaee1 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:49:54.627442 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-dbce0448-f3d9-43b5-b295-f5d206ddaee1 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:49:54.633440 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dbce0448-f3d9-43b5-b295-f5d206ddaee1 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:49:54.633885 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dbce0448-f3d9-43b5-b295-f5d206ddaee1 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:49:54.634664 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dbce0448-f3d9-43b5-b295-f5d206ddaee1 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:49:54.635101 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dbce0448-f3d9-43b5-b295-f5d206ddaee1 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:49:54.755810 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-dbce0448-f3d9-43b5-b295-f5d206ddaee1 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4de3d6437246eaad32b4c8ea1992c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3012e3c014548df9b30d08c9deb4dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:49:54.763148 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-dbce0448-f3d9-43b5-b295-f5d206ddaee1 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491" status: 200 len: 1358 microversion: 2.1 time: 0.140835 Oct 29 01:49:54.763655 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1328/2483] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:49:54 2021] GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491 => generated 1358 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:49:55.780366 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-9ec485f0-b451-471a-82fe-a70d768a7da3 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:49:55.780971 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-9ec485f0-b451-471a-82fe-a70d768a7da3 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:49:55.787234 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9ec485f0-b451-471a-82fe-a70d768a7da3 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:49:55.787677 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9ec485f0-b451-471a-82fe-a70d768a7da3 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:49:55.788424 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9ec485f0-b451-471a-82fe-a70d768a7da3 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:49:55.788934 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9ec485f0-b451-471a-82fe-a70d768a7da3 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:49:55.909681 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-9ec485f0-b451-471a-82fe-a70d768a7da3 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4de3d6437246eaad32b4c8ea1992c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3012e3c014548df9b30d08c9deb4dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:49:55.916747 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-9ec485f0-b451-471a-82fe-a70d768a7da3 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491" status: 200 len: 1358 microversion: 2.1 time: 0.140020 Oct 29 01:49:55.917361 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1156/2484] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:49:55 2021] GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491 => generated 1358 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:49:56.138675 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-d14f29f4-862b-42a8-9577-c0f84aee6340 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-388475426", "imageRef": "3fef3f0d-d772-4999-b764-d6690634a06d", "flavorRef": "452"}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:49:56.187511 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.network.neutron [None req-d14f29f4-862b-42a8-9577-c0f84aee6340 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] validate_networks() for None {{(pid=115747) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 01:49:56.447527 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-d14f29f4-862b-42a8-9577-c0f84aee6340 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Flavor limits 0:0:0 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:49:56.448207 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-d14f29f4-862b-42a8-9577-c0f84aee6340 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Image limits 0:0:0 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:49:56.448679 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-d14f29f4-862b-42a8-9577-c0f84aee6340 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Flavor pref 0:0:0 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:49:56.449088 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-d14f29f4-862b-42a8-9577-c0f84aee6340 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Image pref 0:0:0 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:49:56.449497 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.virt.hardware [None req-d14f29f4-862b-42a8-9577-c0f84aee6340 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:49:56.457875 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d14f29f4-862b-42a8-9577-c0f84aee6340 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:49:56.458323 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d14f29f4-862b-42a8-9577-c0f84aee6340 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:49:56.459145 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d14f29f4-862b-42a8-9577-c0f84aee6340 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:49:56.459579 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-d14f29f4-862b-42a8-9577-c0f84aee6340 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:49:56.478227 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.quota [None req-d14f29f4-862b-42a8-9577-c0f84aee6340 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Getting quotas for project 0d5cde4cbce8439f92d6ee679fcf5976. Resources: {'instances', 'cores', 'ram'} {{(pid=115747) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:49:56.482077 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.quota [None req-d14f29f4-862b-42a8-9577-c0f84aee6340 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Getting quotas for user 9ee770aafb8941e9bb2a714f0a425c76 and project 0d5cde4cbce8439f92d6ee679fcf5976. Resources: {'instances', 'cores', 'ram'} {{(pid=115747) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:49:56.493013 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d14f29f4-862b-42a8-9577-c0f84aee6340 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Going to run 1 instances... {{(pid=115747) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 01:49:56.495791 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-d14f29f4-862b-42a8-9577-c0f84aee6340 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] [instance: a8553cb6-975c-4a28-90bc-9343817899e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3fef3f0d-d772-4999-b764-d6690634a06d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 01:49:56.539584 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-d14f29f4-862b-42a8-9577-c0f84aee6340 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.404458 Oct 29 01:49:56.540388 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1329/2485] 10.222.0.90 () {60 vars in 1146 bytes} [Fri Oct 29 01:49:56 2021] POST /compute/v2.1/servers => generated 380 bytes in 406 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:49:56.549796 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-6d45ccbd-5764-44cd-9e79-23a845e84b36 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:49:56.550423 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-6d45ccbd-5764-44cd-9e79-23a845e84b36 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] [instance: a8553cb6-975c-4a28-90bc-9343817899e3] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:49:56.601438 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-6d45ccbd-5764-44cd-9e79-23a845e84b36 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee770aafb8941e9bb2a714f0a425c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5cde4cbce8439f92d6ee679fcf5976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:49:56.608110 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-6d45ccbd-5764-44cd-9e79-23a845e84b36 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] 10.222.0.90 "GET /compute/v2.1/servers/a8553cb6-975c-4a28-90bc-9343817899e3" status: 200 len: 1214 microversion: 2.1 time: 0.061933 Oct 29 01:49:56.608684 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1157/2486] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:49:56 2021] GET /compute/v2.1/servers/a8553cb6-975c-4a28-90bc-9343817899e3 => generated 1214 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:49:56.932893 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-839b84ed-1abb-4c9b-ad04-8b4f4182a356 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:49:56.933519 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-839b84ed-1abb-4c9b-ad04-8b4f4182a356 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:49:56.941960 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-839b84ed-1abb-4c9b-ad04-8b4f4182a356 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:49:56.942429 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-839b84ed-1abb-4c9b-ad04-8b4f4182a356 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:49:56.943200 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-839b84ed-1abb-4c9b-ad04-8b4f4182a356 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:49:56.943635 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-839b84ed-1abb-4c9b-ad04-8b4f4182a356 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:49:57.069997 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-839b84ed-1abb-4c9b-ad04-8b4f4182a356 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4de3d6437246eaad32b4c8ea1992c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3012e3c014548df9b30d08c9deb4dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:49:57.078612 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-839b84ed-1abb-4c9b-ad04-8b4f4182a356 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491" status: 200 len: 1358 microversion: 2.1 time: 0.149273 Oct 29 01:49:57.079309 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1330/2487] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:49:56 2021] GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:49:57.625202 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-1ad412ba-0d2d-492a-b151-5a6c76fc6776 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:49:57.625917 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-1ad412ba-0d2d-492a-b151-5a6c76fc6776 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] [instance: a8553cb6-975c-4a28-90bc-9343817899e3] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:49:57.631897 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1ad412ba-0d2d-492a-b151-5a6c76fc6776 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:49:57.632341 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1ad412ba-0d2d-492a-b151-5a6c76fc6776 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:49:57.633106 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1ad412ba-0d2d-492a-b151-5a6c76fc6776 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:49:57.633533 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1ad412ba-0d2d-492a-b151-5a6c76fc6776 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:49:57.724804 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-1ad412ba-0d2d-492a-b151-5a6c76fc6776 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee770aafb8941e9bb2a714f0a425c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5cde4cbce8439f92d6ee679fcf5976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:49:57.732286 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-1ad412ba-0d2d-492a-b151-5a6c76fc6776 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] 10.222.0.90 "GET /compute/v2.1/servers/a8553cb6-975c-4a28-90bc-9343817899e3" status: 200 len: 1284 microversion: 2.1 time: 0.110754 Oct 29 01:49:57.732846 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1158/2488] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:49:57 2021] GET /compute/v2.1/servers/a8553cb6-975c-4a28-90bc-9343817899e3 => generated 1284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:49:58.095103 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ee9d3f3c-b644-42e5-a55e-7939aedeb00a tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:49:58.095708 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ee9d3f3c-b644-42e5-a55e-7939aedeb00a tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:49:58.101975 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ee9d3f3c-b644-42e5-a55e-7939aedeb00a tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:49:58.102448 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ee9d3f3c-b644-42e5-a55e-7939aedeb00a tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:49:58.103339 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ee9d3f3c-b644-42e5-a55e-7939aedeb00a tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:49:58.103812 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ee9d3f3c-b644-42e5-a55e-7939aedeb00a tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:49:58.230117 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-ee9d3f3c-b644-42e5-a55e-7939aedeb00a tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4de3d6437246eaad32b4c8ea1992c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3012e3c014548df9b30d08c9deb4dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:49:58.237454 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ee9d3f3c-b644-42e5-a55e-7939aedeb00a tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491" status: 200 len: 1358 microversion: 2.1 time: 0.145997 Oct 29 01:49:58.238566 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1331/2489] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:49:58 2021] GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:49:58.748987 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-1c0325a3-bfc8-426e-bcd2-31f63da16280 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:49:58.749713 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-1c0325a3-bfc8-426e-bcd2-31f63da16280 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] [instance: a8553cb6-975c-4a28-90bc-9343817899e3] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:49:58.755908 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1c0325a3-bfc8-426e-bcd2-31f63da16280 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:49:58.756366 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1c0325a3-bfc8-426e-bcd2-31f63da16280 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:49:58.757139 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1c0325a3-bfc8-426e-bcd2-31f63da16280 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:49:58.757579 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1c0325a3-bfc8-426e-bcd2-31f63da16280 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:49:58.880908 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-1c0325a3-bfc8-426e-bcd2-31f63da16280 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee770aafb8941e9bb2a714f0a425c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5cde4cbce8439f92d6ee679fcf5976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:49:58.889978 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-1c0325a3-bfc8-426e-bcd2-31f63da16280 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] 10.222.0.90 "GET /compute/v2.1/servers/a8553cb6-975c-4a28-90bc-9343817899e3" status: 200 len: 1314 microversion: 2.1 time: 0.144597 Oct 29 01:49:58.890935 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1159/2490] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:49:58 2021] GET /compute/v2.1/servers/a8553cb6-975c-4a28-90bc-9343817899e3 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:49:59.079858 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [req-b56b38f3-740d-4755-982c-c773fbc84b45 req-2f354014-33ba-4e55-a234-c980df44282b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8553cb6-975c-4a28-90bc-9343817899e3", "tag": "0d7a2f19-fbdd-4ad4-81e6-832239e7b2d5"}]} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:49:59.081430 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:49:59.081430 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: warnings.warn(msg) Oct 29 01:49:59.090348 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-b56b38f3-740d-4755-982c-c773fbc84b45 req-2f354014-33ba-4e55-a234-c980df44282b service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:49:59.091312 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-b56b38f3-740d-4755-982c-c773fbc84b45 req-2f354014-33ba-4e55-a234-c980df44282b service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:49:59.104832 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.compute.server_external_events [req-b56b38f3-740d-4755-982c-c773fbc84b45 req-2f354014-33ba-4e55-a234-c980df44282b service nova] Creating event network-changed:0d7a2f19-fbdd-4ad4-81e6-832239e7b2d5 for instance a8553cb6-975c-4a28-90bc-9343817899e3 on hv-cinder-81558 Oct 29 01:49:59.117105 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [req-b56b38f3-740d-4755-982c-c773fbc84b45 req-2f354014-33ba-4e55-a234-c980df44282b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040746 Oct 29 01:49:59.117890 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1332/2491] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:49:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:49:59.245222 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [req-6527af1c-02f4-499b-a7e3-52e768bbbbfa req-83139304-e69c-492e-bb0c-205adf4eeefd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "086997a1-a486-4628-ac24-0d6f31459491", "name": "network-vif-plugged", "status": "completed", "tag": "69a2fb36-b158-4efc-b306-832f2972d25f"}]} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:49:59.247346 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:49:59.247346 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: warnings.warn(msg) Oct 29 01:49:59.255035 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-6527af1c-02f4-499b-a7e3-52e768bbbbfa req-83139304-e69c-492e-bb0c-205adf4eeefd service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:49:59.256827 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-2f811517-286d-4302-8758-3ff0d49d7886 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:49:59.257262 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-6527af1c-02f4-499b-a7e3-52e768bbbbfa req-83139304-e69c-492e-bb0c-205adf4eeefd service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:49:59.257691 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-2f811517-286d-4302-8758-3ff0d49d7886 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:49:59.266375 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2f811517-286d-4302-8758-3ff0d49d7886 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:49:59.267117 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2f811517-286d-4302-8758-3ff0d49d7886 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:49:59.268384 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2f811517-286d-4302-8758-3ff0d49d7886 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:49:59.271019 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2f811517-286d-4302-8758-3ff0d49d7886 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:49:59.273009 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.compute.server_external_events [req-6527af1c-02f4-499b-a7e3-52e768bbbbfa req-83139304-e69c-492e-bb0c-205adf4eeefd service nova] Creating event network-vif-plugged:69a2fb36-b158-4efc-b306-832f2972d25f for instance 086997a1-a486-4628-ac24-0d6f31459491 on hv-cinder-81558 Oct 29 01:49:59.278713 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [req-6527af1c-02f4-499b-a7e3-52e768bbbbfa req-83139304-e69c-492e-bb0c-205adf4eeefd service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036925 Oct 29 01:49:59.279367 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1160/2492] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:49:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:49:59.419217 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-2f811517-286d-4302-8758-3ff0d49d7886 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4de3d6437246eaad32b4c8ea1992c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3012e3c014548df9b30d08c9deb4dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:49:59.427997 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-2f811517-286d-4302-8758-3ff0d49d7886 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491" status: 200 len: 1358 microversion: 2.1 time: 0.176887 Oct 29 01:49:59.428790 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1333/2493] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:49:59 2021] GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:49:59.907946 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-03f6add7-ec54-4598-86ce-0026b7d98108 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:49:59.908650 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-03f6add7-ec54-4598-86ce-0026b7d98108 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] [instance: a8553cb6-975c-4a28-90bc-9343817899e3] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:49:59.914746 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-03f6add7-ec54-4598-86ce-0026b7d98108 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:49:59.915202 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-03f6add7-ec54-4598-86ce-0026b7d98108 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:49:59.915978 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-03f6add7-ec54-4598-86ce-0026b7d98108 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:49:59.916423 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-03f6add7-ec54-4598-86ce-0026b7d98108 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:00.038403 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-03f6add7-ec54-4598-86ce-0026b7d98108 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee770aafb8941e9bb2a714f0a425c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5cde4cbce8439f92d6ee679fcf5976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:00.045965 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-03f6add7-ec54-4598-86ce-0026b7d98108 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] 10.222.0.90 "GET /compute/v2.1/servers/a8553cb6-975c-4a28-90bc-9343817899e3" status: 200 len: 1314 microversion: 2.1 time: 0.142566 Oct 29 01:50:00.046562 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1161/2494] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:49:59 2021] GET /compute/v2.1/servers/a8553cb6-975c-4a28-90bc-9343817899e3 => generated 1314 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:50:00.445063 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-6d0e3085-fa48-4632-814c-f631476a8adb tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:00.445674 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-6d0e3085-fa48-4632-814c-f631476a8adb tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:50:00.452063 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6d0e3085-fa48-4632-814c-f631476a8adb tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:00.452506 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6d0e3085-fa48-4632-814c-f631476a8adb tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:00.453258 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6d0e3085-fa48-4632-814c-f631476a8adb tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:00.453734 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6d0e3085-fa48-4632-814c-f631476a8adb tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:00.570916 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-6d0e3085-fa48-4632-814c-f631476a8adb tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4de3d6437246eaad32b4c8ea1992c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3012e3c014548df9b30d08c9deb4dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:00.578199 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-6d0e3085-fa48-4632-814c-f631476a8adb tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491" status: 200 len: 1358 microversion: 2.1 time: 0.137056 Oct 29 01:50:00.578790 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1334/2495] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:50:00 2021] GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491 => generated 1358 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:50:01.062914 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e1465758-acea-40dc-8f24-d2b0060eee87 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:01.063527 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-e1465758-acea-40dc-8f24-d2b0060eee87 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] [instance: a8553cb6-975c-4a28-90bc-9343817899e3] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:50:01.070370 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e1465758-acea-40dc-8f24-d2b0060eee87 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:01.070850 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e1465758-acea-40dc-8f24-d2b0060eee87 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:01.071614 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e1465758-acea-40dc-8f24-d2b0060eee87 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:01.072052 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e1465758-acea-40dc-8f24-d2b0060eee87 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:01.193020 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-e1465758-acea-40dc-8f24-d2b0060eee87 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee770aafb8941e9bb2a714f0a425c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5cde4cbce8439f92d6ee679fcf5976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:01.200489 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-e1465758-acea-40dc-8f24-d2b0060eee87 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] 10.222.0.90 "GET /compute/v2.1/servers/a8553cb6-975c-4a28-90bc-9343817899e3" status: 200 len: 1314 microversion: 2.1 time: 0.141192 Oct 29 01:50:01.201080 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1162/2496] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:50:01 2021] GET /compute/v2.1/servers/a8553cb6-975c-4a28-90bc-9343817899e3 => generated 1314 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:50:01.595413 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-9746c11b-f650-46a6-a524-f157d4da5a7f tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:01.596019 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-9746c11b-f650-46a6-a524-f157d4da5a7f tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:50:01.602374 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9746c11b-f650-46a6-a524-f157d4da5a7f tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:01.602846 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9746c11b-f650-46a6-a524-f157d4da5a7f tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:01.603600 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9746c11b-f650-46a6-a524-f157d4da5a7f tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:01.604026 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-9746c11b-f650-46a6-a524-f157d4da5a7f tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:01.726460 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-9746c11b-f650-46a6-a524-f157d4da5a7f tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4de3d6437246eaad32b4c8ea1992c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3012e3c014548df9b30d08c9deb4dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:01.733576 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-9746c11b-f650-46a6-a524-f157d4da5a7f tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491" status: 200 len: 1547 microversion: 2.1 time: 0.141916 Oct 29 01:50:01.734140 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1335/2497] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:50:01 2021] GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491 => generated 1547 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:50:01.749000 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d0ef6564-9100-48dd-a2fc-64b440c9490c tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:01.749613 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d0ef6564-9100-48dd-a2fc-64b440c9490c tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:50:01.755853 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d0ef6564-9100-48dd-a2fc-64b440c9490c tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:01.756326 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d0ef6564-9100-48dd-a2fc-64b440c9490c tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:01.757093 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d0ef6564-9100-48dd-a2fc-64b440c9490c tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:01.757619 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d0ef6564-9100-48dd-a2fc-64b440c9490c tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:01.872322 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-d0ef6564-9100-48dd-a2fc-64b440c9490c tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4de3d6437246eaad32b4c8ea1992c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3012e3c014548df9b30d08c9deb4dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:01.880007 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d0ef6564-9100-48dd-a2fc-64b440c9490c tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491" status: 200 len: 1547 microversion: 2.1 time: 0.134157 Oct 29 01:50:01.880573 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1163/2498] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:50:01 2021] GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491 => generated 1547 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:50:01.895819 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-52d7bb2e-d6e7-4d6e-9e2b-6d07730673d5 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:01.899207 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:50:01.899207 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: warnings.warn(msg) Oct 29 01:50:01.900209 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-52d7bb2e-d6e7-4d6e-9e2b-6d07730673d5 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ee4de3d6437246eaad32b4c8ea1992c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3012e3c014548df9b30d08c9deb4dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:01.900965 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-52d7bb2e-d6e7-4d6e-9e2b-6d07730673d5 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Searching by: {'deleted': False, 'project_id': 'f3012e3c014548df9b30d08c9deb4dbd'} {{(pid=115747) get_all /opt/stack/nova/nova/compute/api.py:2905}} Oct 29 01:50:01.907455 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-52d7bb2e-d6e7-4d6e-9e2b-6d07730673d5 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:01.907904 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-52d7bb2e-d6e7-4d6e-9e2b-6d07730673d5 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:01.908715 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-52d7bb2e-d6e7-4d6e-9e2b-6d07730673d5 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:01.909136 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-52d7bb2e-d6e7-4d6e-9e2b-6d07730673d5 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:01.997516 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.multi_cell_list [None req-52d7bb2e-d6e7-4d6e-9e2b-6d07730673d5 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=115747) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Oct 29 01:50:02.095889 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-52d7bb2e-d6e7-4d6e-9e2b-6d07730673d5 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.204231 Oct 29 01:50:02.096470 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1336/2499] 10.222.0.90 () {58 vars in 1124 bytes} [Fri Oct 29 01:50:01 2021] GET /compute/v2.1/servers => generated 343 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:50:02.107208 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-c16af94d-0c29-4084-a309-9c45b8fd65e6 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:02.107819 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-c16af94d-0c29-4084-a309-9c45b8fd65e6 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:50:02.114005 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c16af94d-0c29-4084-a309-9c45b8fd65e6 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:02.114492 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c16af94d-0c29-4084-a309-9c45b8fd65e6 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:02.115255 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c16af94d-0c29-4084-a309-9c45b8fd65e6 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:02.115686 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-c16af94d-0c29-4084-a309-9c45b8fd65e6 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:02.216693 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-6bada278-0185-49b7-afc5-fe6981292eab tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:02.217294 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-6bada278-0185-49b7-afc5-fe6981292eab tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] [instance: a8553cb6-975c-4a28-90bc-9343817899e3] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:50:02.223024 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6bada278-0185-49b7-afc5-fe6981292eab tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:02.224037 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6bada278-0185-49b7-afc5-fe6981292eab tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:02.224790 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6bada278-0185-49b7-afc5-fe6981292eab tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:02.225425 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6bada278-0185-49b7-afc5-fe6981292eab tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:02.236154 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-c16af94d-0c29-4084-a309-9c45b8fd65e6 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4de3d6437246eaad32b4c8ea1992c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3012e3c014548df9b30d08c9deb4dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:02.243517 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-c16af94d-0c29-4084-a309-9c45b8fd65e6 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491" status: 200 len: 1547 microversion: 2.1 time: 0.139929 Oct 29 01:50:02.244084 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1164/2500] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:50:02 2021] GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491 => generated 1547 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:50:02.344721 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-6bada278-0185-49b7-afc5-fe6981292eab tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee770aafb8941e9bb2a714f0a425c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5cde4cbce8439f92d6ee679fcf5976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:02.351943 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-6bada278-0185-49b7-afc5-fe6981292eab tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] 10.222.0.90 "GET /compute/v2.1/servers/a8553cb6-975c-4a28-90bc-9343817899e3" status: 200 len: 1314 microversion: 2.1 time: 0.138860 Oct 29 01:50:02.352507 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1337/2501] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:50:02 2021] GET /compute/v2.1/servers/a8553cb6-975c-4a28-90bc-9343817899e3 => generated 1314 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:50:03.368823 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-90759623-c30f-44aa-a4f5-1074f9bd53df tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:03.369436 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-90759623-c30f-44aa-a4f5-1074f9bd53df tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] [instance: a8553cb6-975c-4a28-90bc-9343817899e3] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:50:03.375728 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-90759623-c30f-44aa-a4f5-1074f9bd53df tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:03.376179 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-90759623-c30f-44aa-a4f5-1074f9bd53df tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:03.376944 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-90759623-c30f-44aa-a4f5-1074f9bd53df tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:03.377381 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-90759623-c30f-44aa-a4f5-1074f9bd53df tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:03.497827 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-90759623-c30f-44aa-a4f5-1074f9bd53df tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee770aafb8941e9bb2a714f0a425c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5cde4cbce8439f92d6ee679fcf5976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:03.505015 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-90759623-c30f-44aa-a4f5-1074f9bd53df tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] 10.222.0.90 "GET /compute/v2.1/servers/a8553cb6-975c-4a28-90bc-9343817899e3" status: 200 len: 1314 microversion: 2.1 time: 0.139860 Oct 29 01:50:03.505577 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1165/2502] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:50:03 2021] GET /compute/v2.1/servers/a8553cb6-975c-4a28-90bc-9343817899e3 => generated 1314 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:50:03.732792 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ef12de69-95a1-47b4-b01a-448e66ad2e1b tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a5545590-4549-42dc-a651-f30f8d450b3a"}} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:50:03.733884 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ef12de69-95a1-47b4-b01a-448e66ad2e1b tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:50:03.740076 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ef12de69-95a1-47b4-b01a-448e66ad2e1b tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:03.740524 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ef12de69-95a1-47b4-b01a-448e66ad2e1b tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:03.741283 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ef12de69-95a1-47b4-b01a-448e66ad2e1b tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:03.741719 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ef12de69-95a1-47b4-b01a-448e66ad2e1b tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:03.986938 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ef12de69-95a1-47b4-b01a-448e66ad2e1b tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "POST /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.257655 Oct 29 01:50:03.987603 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1338/2503] 10.222.0.90 () {60 vars in 1322 bytes} [Fri Oct 29 01:50:03 2021] POST /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491/os-volume_attachments => generated 194 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:50:04.522046 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-e78e486d-a62c-4fb4-862d-15f8889b2661 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:04.522668 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-e78e486d-a62c-4fb4-862d-15f8889b2661 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] [instance: a8553cb6-975c-4a28-90bc-9343817899e3] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:50:04.529540 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e78e486d-a62c-4fb4-862d-15f8889b2661 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:04.530006 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e78e486d-a62c-4fb4-862d-15f8889b2661 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:04.530859 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e78e486d-a62c-4fb4-862d-15f8889b2661 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:04.531328 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-e78e486d-a62c-4fb4-862d-15f8889b2661 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:04.657026 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-e78e486d-a62c-4fb4-862d-15f8889b2661 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee770aafb8941e9bb2a714f0a425c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5cde4cbce8439f92d6ee679fcf5976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:04.664706 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-e78e486d-a62c-4fb4-862d-15f8889b2661 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] 10.222.0.90 "GET /compute/v2.1/servers/a8553cb6-975c-4a28-90bc-9343817899e3" status: 200 len: 1314 microversion: 2.1 time: 0.146927 Oct 29 01:50:04.665267 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1166/2504] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:50:04 2021] GET /compute/v2.1/servers/a8553cb6-975c-4a28-90bc-9343817899e3 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:50:05.238812 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [req-1e7588ac-a7da-4a86-8c9f-d01e092353b4 req-15a7e2ac-32e2-4f02-88d9-03599221c444 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8553cb6-975c-4a28-90bc-9343817899e3", "name": "network-vif-plugged", "status": "completed", "tag": "0d7a2f19-fbdd-4ad4-81e6-832239e7b2d5"}]} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:50:05.240465 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:50:05.240465 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: warnings.warn(msg) Oct 29 01:50:05.248533 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-1e7588ac-a7da-4a86-8c9f-d01e092353b4 req-15a7e2ac-32e2-4f02-88d9-03599221c444 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:05.248977 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-1e7588ac-a7da-4a86-8c9f-d01e092353b4 req-15a7e2ac-32e2-4f02-88d9-03599221c444 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:05.259885 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.compute.server_external_events [req-1e7588ac-a7da-4a86-8c9f-d01e092353b4 req-15a7e2ac-32e2-4f02-88d9-03599221c444 service nova] Creating event network-vif-plugged:0d7a2f19-fbdd-4ad4-81e6-832239e7b2d5 for instance a8553cb6-975c-4a28-90bc-9343817899e3 on hv-cinder-81558 Oct 29 01:50:05.264571 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [req-1e7588ac-a7da-4a86-8c9f-d01e092353b4 req-15a7e2ac-32e2-4f02-88d9-03599221c444 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030467 Oct 29 01:50:05.265150 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1339/2505] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:50:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:50:05.681567 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-1f52495e-3ad8-48ab-89dd-cd616a39b814 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:05.682173 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-1f52495e-3ad8-48ab-89dd-cd616a39b814 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] [instance: a8553cb6-975c-4a28-90bc-9343817899e3] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:50:05.688375 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1f52495e-3ad8-48ab-89dd-cd616a39b814 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:05.688821 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1f52495e-3ad8-48ab-89dd-cd616a39b814 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:05.689574 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1f52495e-3ad8-48ab-89dd-cd616a39b814 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:05.690003 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-1f52495e-3ad8-48ab-89dd-cd616a39b814 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:05.813826 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-1f52495e-3ad8-48ab-89dd-cd616a39b814 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee770aafb8941e9bb2a714f0a425c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5cde4cbce8439f92d6ee679fcf5976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:05.821691 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-1f52495e-3ad8-48ab-89dd-cd616a39b814 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] 10.222.0.90 "GET /compute/v2.1/servers/a8553cb6-975c-4a28-90bc-9343817899e3" status: 200 len: 1314 microversion: 2.1 time: 0.143897 Oct 29 01:50:05.822435 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1167/2506] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:50:05 2021] GET /compute/v2.1/servers/a8553cb6-975c-4a28-90bc-9343817899e3 => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:50:06.839951 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c15522e7-8343-479c-95a1-8a48c1aca46b tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:06.840659 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c15522e7-8343-479c-95a1-8a48c1aca46b tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] [instance: a8553cb6-975c-4a28-90bc-9343817899e3] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:50:06.846634 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c15522e7-8343-479c-95a1-8a48c1aca46b tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:06.847074 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c15522e7-8343-479c-95a1-8a48c1aca46b tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:06.847842 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c15522e7-8343-479c-95a1-8a48c1aca46b tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:06.848268 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c15522e7-8343-479c-95a1-8a48c1aca46b tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:06.965057 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c15522e7-8343-479c-95a1-8a48c1aca46b tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee770aafb8941e9bb2a714f0a425c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5cde4cbce8439f92d6ee679fcf5976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:06.973083 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c15522e7-8343-479c-95a1-8a48c1aca46b tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] 10.222.0.90 "GET /compute/v2.1/servers/a8553cb6-975c-4a28-90bc-9343817899e3" status: 200 len: 1464 microversion: 2.1 time: 0.137286 Oct 29 01:50:06.973856 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1340/2507] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:50:06 2021] GET /compute/v2.1/servers/a8553cb6-975c-4a28-90bc-9343817899e3 => generated 1464 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:50:07.008880 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-a1dd6c53-a1d4-4280-b68c-c1b1216af8bd tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:07.009365 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-a1dd6c53-a1d4-4280-b68c-c1b1216af8bd tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] [instance: a8553cb6-975c-4a28-90bc-9343817899e3] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:50:07.015465 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a1dd6c53-a1d4-4280-b68c-c1b1216af8bd tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:07.015904 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a1dd6c53-a1d4-4280-b68c-c1b1216af8bd tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:07.016654 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a1dd6c53-a1d4-4280-b68c-c1b1216af8bd tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:07.017083 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-a1dd6c53-a1d4-4280-b68c-c1b1216af8bd tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:07.041075 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-a1dd6c53-a1d4-4280-b68c-c1b1216af8bd tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] [instance: a8553cb6-975c-4a28-90bc-9343817899e3] Going to try to terminate instance {{(pid=115748) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 01:50:07.111941 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-a1dd6c53-a1d4-4280-b68c-c1b1216af8bd tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] 10.222.0.90 "DELETE /compute/v2.1/servers/a8553cb6-975c-4a28-90bc-9343817899e3" status: 204 len: 0 microversion: 2.1 time: 0.106563 Oct 29 01:50:07.112634 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1168/2508] 10.222.0.90 () {58 vars in 1238 bytes} [Fri Oct 29 01:50:07 2021] DELETE /compute/v2.1/servers/a8553cb6-975c-4a28-90bc-9343817899e3 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:50:07.120370 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-6a7a7b6c-0f64-4833-8234-731c2ddea795 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:07.120973 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-6a7a7b6c-0f64-4833-8234-731c2ddea795 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] [instance: a8553cb6-975c-4a28-90bc-9343817899e3] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:50:07.127104 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6a7a7b6c-0f64-4833-8234-731c2ddea795 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:07.127551 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6a7a7b6c-0f64-4833-8234-731c2ddea795 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:07.128304 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6a7a7b6c-0f64-4833-8234-731c2ddea795 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:07.128764 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-6a7a7b6c-0f64-4833-8234-731c2ddea795 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:07.500435 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-6a7a7b6c-0f64-4833-8234-731c2ddea795 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee770aafb8941e9bb2a714f0a425c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5cde4cbce8439f92d6ee679fcf5976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:07.508347 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-6a7a7b6c-0f64-4833-8234-731c2ddea795 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] 10.222.0.90 "GET /compute/v2.1/servers/a8553cb6-975c-4a28-90bc-9343817899e3" status: 200 len: 1470 microversion: 2.1 time: 0.391521 Oct 29 01:50:07.508907 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1341/2509] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:50:07 2021] GET /compute/v2.1/servers/a8553cb6-975c-4a28-90bc-9343817899e3 => generated 1470 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:50:08.526788 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-eeae2ab4-f978-46de-ad66-63bce9e7f8c8 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:08.527419 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-eeae2ab4-f978-46de-ad66-63bce9e7f8c8 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] [instance: a8553cb6-975c-4a28-90bc-9343817899e3] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:50:08.536534 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-eeae2ab4-f978-46de-ad66-63bce9e7f8c8 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:08.536977 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-eeae2ab4-f978-46de-ad66-63bce9e7f8c8 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:08.537738 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-eeae2ab4-f978-46de-ad66-63bce9e7f8c8 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:08.538180 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-eeae2ab4-f978-46de-ad66-63bce9e7f8c8 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:08.656735 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-eeae2ab4-f978-46de-ad66-63bce9e7f8c8 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee770aafb8941e9bb2a714f0a425c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5cde4cbce8439f92d6ee679fcf5976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:08.664043 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-eeae2ab4-f978-46de-ad66-63bce9e7f8c8 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] 10.222.0.90 "GET /compute/v2.1/servers/a8553cb6-975c-4a28-90bc-9343817899e3" status: 200 len: 1470 microversion: 2.1 time: 0.141447 Oct 29 01:50:08.664594 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1169/2510] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:50:08 2021] GET /compute/v2.1/servers/a8553cb6-975c-4a28-90bc-9343817899e3 => generated 1470 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:50:09.310745 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [req-89856765-4951-44c8-9a54-c1257d6b78c2 req-d811582f-01d3-4eeb-8c7f-f942847ddc67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8553cb6-975c-4a28-90bc-9343817899e3", "name": "network-vif-deleted", "tag": "0d7a2f19-fbdd-4ad4-81e6-832239e7b2d5"}]} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:50:09.312271 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:50:09.312271 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: warnings.warn(msg) Oct 29 01:50:09.320084 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-89856765-4951-44c8-9a54-c1257d6b78c2 req-d811582f-01d3-4eeb-8c7f-f942847ddc67 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:09.320525 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-89856765-4951-44c8-9a54-c1257d6b78c2 req-d811582f-01d3-4eeb-8c7f-f942847ddc67 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:09.332942 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.compute.server_external_events [req-89856765-4951-44c8-9a54-c1257d6b78c2 req-d811582f-01d3-4eeb-8c7f-f942847ddc67 service nova] Creating event network-vif-deleted:0d7a2f19-fbdd-4ad4-81e6-832239e7b2d5 for instance a8553cb6-975c-4a28-90bc-9343817899e3 on hv-cinder-81558 Oct 29 01:50:09.338743 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [req-89856765-4951-44c8-9a54-c1257d6b78c2 req-d811582f-01d3-4eeb-8c7f-f942847ddc67 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031449 Oct 29 01:50:09.340191 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1342/2511] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:50:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:50:09.681146 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-b43a0125-e331-4b2a-9497-c86675389af9 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:09.681881 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-b43a0125-e331-4b2a-9497-c86675389af9 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] [instance: a8553cb6-975c-4a28-90bc-9343817899e3] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:50:09.688150 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b43a0125-e331-4b2a-9497-c86675389af9 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:09.688594 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b43a0125-e331-4b2a-9497-c86675389af9 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:09.689362 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b43a0125-e331-4b2a-9497-c86675389af9 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:09.689801 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b43a0125-e331-4b2a-9497-c86675389af9 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:09.720373 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b43a0125-e331-4b2a-9497-c86675389af9 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:09.720822 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-b43a0125-e331-4b2a-9497-c86675389af9 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:09.721320 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.objects.instance [None req-b43a0125-e331-4b2a-9497-c86675389af9 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lazy-loading 'fault' on Instance uuid a8553cb6-975c-4a28-90bc-9343817899e3 {{(pid=115748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:50:09.763624 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-b43a0125-e331-4b2a-9497-c86675389af9 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee770aafb8941e9bb2a714f0a425c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5cde4cbce8439f92d6ee679fcf5976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:09.770742 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-b43a0125-e331-4b2a-9497-c86675389af9 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] 10.222.0.90 "GET /compute/v2.1/servers/a8553cb6-975c-4a28-90bc-9343817899e3" status: 200 len: 1304 microversion: 2.1 time: 0.093368 Oct 29 01:50:09.771306 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1170/2512] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:50:09 2021] GET /compute/v2.1/servers/a8553cb6-975c-4a28-90bc-9343817899e3 => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:50:10.788648 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ef81b14c-7307-43e6-ae84-b65b065c9052 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:10.789343 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-ef81b14c-7307-43e6-ae84-b65b065c9052 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] [instance: a8553cb6-975c-4a28-90bc-9343817899e3] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:50:10.795428 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ef81b14c-7307-43e6-ae84-b65b065c9052 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:10.795881 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ef81b14c-7307-43e6-ae84-b65b065c9052 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:10.796640 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ef81b14c-7307-43e6-ae84-b65b065c9052 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:10.797081 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-ef81b14c-7307-43e6-ae84-b65b065c9052 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:10.809749 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.wsgi [None req-ef81b14c-7307-43e6-ae84-b65b065c9052 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] HTTP exception thrown: Instance a8553cb6-975c-4a28-90bc-9343817899e3 could not be found. Oct 29 01:50:10.810331 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-ef81b14c-7307-43e6-ae84-b65b065c9052 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] Returning 404 to user: Instance a8553cb6-975c-4a28-90bc-9343817899e3 could not be found. {{(pid=115747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:50:10.811199 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-ef81b14c-7307-43e6-ae84-b65b065c9052 tempest-VolumesNegativeTest-407118655 tempest-VolumesNegativeTest-407118655-project] 10.222.0.90 "GET /compute/v2.1/servers/a8553cb6-975c-4a28-90bc-9343817899e3" status: 404 len: 111 microversion: 2.1 time: 0.027085 Oct 29 01:50:10.811725 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1343/2513] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:50:10 2021] GET /compute/v2.1/servers/a8553cb6-975c-4a28-90bc-9343817899e3 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:50:11.512524 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-8bdd83f8-5f64-45dd-bc7b-013d6bd81116 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:11.513143 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-8bdd83f8-5f64-45dd-bc7b-013d6bd81116 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:50:11.519479 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8bdd83f8-5f64-45dd-bc7b-013d6bd81116 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:11.519930 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8bdd83f8-5f64-45dd-bc7b-013d6bd81116 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:11.520721 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8bdd83f8-5f64-45dd-bc7b-013d6bd81116 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:11.521159 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-8bdd83f8-5f64-45dd-bc7b-013d6bd81116 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:11.649950 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-8bdd83f8-5f64-45dd-bc7b-013d6bd81116 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4de3d6437246eaad32b4c8ea1992c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3012e3c014548df9b30d08c9deb4dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:11.657900 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-8bdd83f8-5f64-45dd-bc7b-013d6bd81116 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491" status: 200 len: 1593 microversion: 2.1 time: 0.152701 Oct 29 01:50:11.658478 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1171/2514] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:50:11 2021] GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491 => generated 1593 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:50:13.750822 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [req-2926ac3e-c228-436a-ad48-1d41c982368e req-a79038f0-8a97-4eb5-84f3-273e7a6beb9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "086997a1-a486-4628-ac24-0d6f31459491", "tag": "69a2fb36-b158-4efc-b306-832f2972d25f"}]} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:50:13.752557 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:50:13.752557 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: warnings.warn(msg) Oct 29 01:50:13.760743 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-2926ac3e-c228-436a-ad48-1d41c982368e req-a79038f0-8a97-4eb5-84f3-273e7a6beb9c service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:13.761665 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-2926ac3e-c228-436a-ad48-1d41c982368e req-a79038f0-8a97-4eb5-84f3-273e7a6beb9c service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:13.774562 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.compute.server_external_events [req-2926ac3e-c228-436a-ad48-1d41c982368e req-a79038f0-8a97-4eb5-84f3-273e7a6beb9c service nova] Creating event network-changed:69a2fb36-b158-4efc-b306-832f2972d25f for instance 086997a1-a486-4628-ac24-0d6f31459491 on hv-cinder-81558 Oct 29 01:50:13.779712 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [req-2926ac3e-c228-436a-ad48-1d41c982368e req-a79038f0-8a97-4eb5-84f3-273e7a6beb9c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032474 Oct 29 01:50:13.784748 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1344/2515] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:50:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:50:15.062240 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-512e5fe1-78de-4152-bd2b-a3bd2a2aa944 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1150083593"}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:50:15.062847 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-512e5fe1-78de-4152-bd2b-a3bd2a2aa944 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:50:15.071770 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-512e5fe1-78de-4152-bd2b-a3bd2a2aa944 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:15.072238 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-512e5fe1-78de-4152-bd2b-a3bd2a2aa944 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:15.073488 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-512e5fe1-78de-4152-bd2b-a3bd2a2aa944 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:15.073934 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-512e5fe1-78de-4152-bd2b-a3bd2a2aa944 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:15.403808 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.network.security_group_api [None req-512e5fe1-78de-4152-bd2b-a3bd2a2aa944 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Adding security group 39bc6696-48d2-489f-a7a0-c8c4aec366ef to port 69a2fb36-b158-4efc-b306-832f2972d25f Oct 29 01:50:15.737226 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-512e5fe1-78de-4152-bd2b-a3bd2a2aa944 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "POST /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491/action" status: 202 len: 0 microversion: 2.1 time: 0.679109 Oct 29 01:50:15.739074 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1172/2516] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:50:15 2021] POST /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491/action => generated 0 bytes in 681 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:50:15.749640 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-87fa4593-9926-4d39-8a08-fd054d1125dc tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:15.750347 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-87fa4593-9926-4d39-8a08-fd054d1125dc tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:50:15.752699 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [req-ca8f31d7-a1ee-446f-8744-a5f39be8acb2 req-81ee5ea1-cef5-41a9-8394-4a1878484f26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "086997a1-a486-4628-ac24-0d6f31459491", "tag": "69a2fb36-b158-4efc-b306-832f2972d25f"}]} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:50:15.755084 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:50:15.755084 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: warnings.warn(msg) Oct 29 01:50:15.764636 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-ca8f31d7-a1ee-446f-8744-a5f39be8acb2 req-81ee5ea1-cef5-41a9-8394-4a1878484f26 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:15.765095 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-ca8f31d7-a1ee-446f-8744-a5f39be8acb2 req-81ee5ea1-cef5-41a9-8394-4a1878484f26 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:15.772975 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-87fa4593-9926-4d39-8a08-fd054d1125dc tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:15.773368 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-87fa4593-9926-4d39-8a08-fd054d1125dc tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:15.774149 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-87fa4593-9926-4d39-8a08-fd054d1125dc tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:15.778955 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-87fa4593-9926-4d39-8a08-fd054d1125dc tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:15.783237 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.compute.server_external_events [req-ca8f31d7-a1ee-446f-8744-a5f39be8acb2 req-81ee5ea1-cef5-41a9-8394-4a1878484f26 service nova] Creating event network-changed:69a2fb36-b158-4efc-b306-832f2972d25f for instance 086997a1-a486-4628-ac24-0d6f31459491 on hv-cinder-81558 Oct 29 01:50:15.789205 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [req-ca8f31d7-a1ee-446f-8744-a5f39be8acb2 req-81ee5ea1-cef5-41a9-8394-4a1878484f26 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041362 Oct 29 01:50:15.790058 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1173/2517] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:50:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:50:15.930656 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-87fa4593-9926-4d39-8a08-fd054d1125dc tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4de3d6437246eaad32b4c8ea1992c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3012e3c014548df9b30d08c9deb4dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:15.940092 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-87fa4593-9926-4d39-8a08-fd054d1125dc tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491" status: 200 len: 1759 microversion: 2.1 time: 0.197192 Oct 29 01:50:15.942178 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1345/2518] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:50:15 2021] GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491 => generated 1759 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:50:38.267352 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-f2783934-b86c-4e9e-9af4-f8483ed18b11 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:50:38.268290 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-f2783934-b86c-4e9e-9af4-f8483ed18b11 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:50:38.274595 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f2783934-b86c-4e9e-9af4-f8483ed18b11 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:38.275042 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f2783934-b86c-4e9e-9af4-f8483ed18b11 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:38.275804 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f2783934-b86c-4e9e-9af4-f8483ed18b11 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:38.276239 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-f2783934-b86c-4e9e-9af4-f8483ed18b11 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:38.347117 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-f2783934-b86c-4e9e-9af4-f8483ed18b11 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "POST /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491/action" status: 202 len: 0 microversion: 2.1 time: 0.084217 Oct 29 01:50:38.348595 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1174/2519] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:50:38 2021] POST /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:50:38.356753 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-348042f7-a862-4cfa-a876-81e1a57e8a1e tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:38.357993 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-348042f7-a862-4cfa-a876-81e1a57e8a1e tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:50:38.366196 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-348042f7-a862-4cfa-a876-81e1a57e8a1e tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:38.366958 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-348042f7-a862-4cfa-a876-81e1a57e8a1e tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:38.368034 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-348042f7-a862-4cfa-a876-81e1a57e8a1e tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:38.368950 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-348042f7-a862-4cfa-a876-81e1a57e8a1e tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:38.496079 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-348042f7-a862-4cfa-a876-81e1a57e8a1e tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4de3d6437246eaad32b4c8ea1992c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3012e3c014548df9b30d08c9deb4dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:38.503765 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-348042f7-a862-4cfa-a876-81e1a57e8a1e tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491" status: 200 len: 1751 microversion: 2.1 time: 0.151410 Oct 29 01:50:38.504360 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1346/2520] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:50:38 2021] GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491 => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:50:39.522377 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-11c4db9d-62c2-4570-903d-77e126eae18e tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:39.523099 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-11c4db9d-62c2-4570-903d-77e126eae18e tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:50:39.529070 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-11c4db9d-62c2-4570-903d-77e126eae18e tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:39.529516 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-11c4db9d-62c2-4570-903d-77e126eae18e tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:39.530263 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-11c4db9d-62c2-4570-903d-77e126eae18e tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:39.530721 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-11c4db9d-62c2-4570-903d-77e126eae18e tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:39.650531 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-11c4db9d-62c2-4570-903d-77e126eae18e tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4de3d6437246eaad32b4c8ea1992c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3012e3c014548df9b30d08c9deb4dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:39.658118 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-11c4db9d-62c2-4570-903d-77e126eae18e tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491" status: 200 len: 1756 microversion: 2.1 time: 0.140714 Oct 29 01:50:39.658710 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1175/2521] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:50:39 2021] GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491 => generated 1756 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:50:40.675541 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-7ed21156-06df-4016-a6b8-ba470a36ae1f tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:40.676247 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-7ed21156-06df-4016-a6b8-ba470a36ae1f tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:50:40.682914 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7ed21156-06df-4016-a6b8-ba470a36ae1f tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:40.683350 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7ed21156-06df-4016-a6b8-ba470a36ae1f tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:40.684098 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7ed21156-06df-4016-a6b8-ba470a36ae1f tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:40.684526 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-7ed21156-06df-4016-a6b8-ba470a36ae1f tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:40.808070 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-7ed21156-06df-4016-a6b8-ba470a36ae1f tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4de3d6437246eaad32b4c8ea1992c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3012e3c014548df9b30d08c9deb4dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:40.816301 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-7ed21156-06df-4016-a6b8-ba470a36ae1f tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491" status: 200 len: 1756 microversion: 2.1 time: 0.144149 Oct 29 01:50:40.817217 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1347/2522] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:50:40 2021] GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491 => generated 1756 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:50:41.834633 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-d3ce43a2-f640-4d15-b5c8-8ae22c555f0b tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:41.835252 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-d3ce43a2-f640-4d15-b5c8-8ae22c555f0b tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:50:41.841444 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d3ce43a2-f640-4d15-b5c8-8ae22c555f0b tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:41.841897 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d3ce43a2-f640-4d15-b5c8-8ae22c555f0b tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:41.842689 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d3ce43a2-f640-4d15-b5c8-8ae22c555f0b tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:41.843131 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-d3ce43a2-f640-4d15-b5c8-8ae22c555f0b tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:41.971498 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-d3ce43a2-f640-4d15-b5c8-8ae22c555f0b tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4de3d6437246eaad32b4c8ea1992c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3012e3c014548df9b30d08c9deb4dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:41.980396 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-d3ce43a2-f640-4d15-b5c8-8ae22c555f0b tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491" status: 200 len: 1756 microversion: 2.1 time: 0.150049 Oct 29 01:50:41.980955 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1176/2523] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:50:41 2021] GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491 => generated 1756 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:50:42.997105 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-71dedceb-f4a1-4046-bf5d-c4394714d909 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:42.997716 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-71dedceb-f4a1-4046-bf5d-c4394714d909 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:50:43.003945 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-71dedceb-f4a1-4046-bf5d-c4394714d909 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:43.004395 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-71dedceb-f4a1-4046-bf5d-c4394714d909 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:43.005151 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-71dedceb-f4a1-4046-bf5d-c4394714d909 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:43.005585 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-71dedceb-f4a1-4046-bf5d-c4394714d909 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:43.128479 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-71dedceb-f4a1-4046-bf5d-c4394714d909 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4de3d6437246eaad32b4c8ea1992c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3012e3c014548df9b30d08c9deb4dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:43.136221 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-71dedceb-f4a1-4046-bf5d-c4394714d909 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491" status: 200 len: 1756 microversion: 2.1 time: 0.142837 Oct 29 01:50:43.136775 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1348/2524] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:50:42 2021] GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491 => generated 1756 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:50:44.153225 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-4c95b8fc-77a5-4364-a402-4ecb26ee49de tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:44.153830 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-4c95b8fc-77a5-4364-a402-4ecb26ee49de tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:50:44.160131 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4c95b8fc-77a5-4364-a402-4ecb26ee49de tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:44.160575 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4c95b8fc-77a5-4364-a402-4ecb26ee49de tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:44.161328 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4c95b8fc-77a5-4364-a402-4ecb26ee49de tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:44.161757 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-4c95b8fc-77a5-4364-a402-4ecb26ee49de tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:44.285798 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-4c95b8fc-77a5-4364-a402-4ecb26ee49de tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4de3d6437246eaad32b4c8ea1992c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3012e3c014548df9b30d08c9deb4dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:44.293980 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-4c95b8fc-77a5-4364-a402-4ecb26ee49de tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491" status: 200 len: 1756 microversion: 2.1 time: 0.144410 Oct 29 01:50:44.294569 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1177/2525] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:50:44 2021] GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491 => generated 1756 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:50:45.312019 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-00b17de0-5c5a-4950-a2fe-ff6347ba17c3 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:45.312577 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-00b17de0-5c5a-4950-a2fe-ff6347ba17c3 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:50:45.319043 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-00b17de0-5c5a-4950-a2fe-ff6347ba17c3 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:45.319483 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-00b17de0-5c5a-4950-a2fe-ff6347ba17c3 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:45.320228 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-00b17de0-5c5a-4950-a2fe-ff6347ba17c3 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:45.320651 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-00b17de0-5c5a-4950-a2fe-ff6347ba17c3 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:45.439277 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-00b17de0-5c5a-4950-a2fe-ff6347ba17c3 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4de3d6437246eaad32b4c8ea1992c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3012e3c014548df9b30d08c9deb4dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:45.447650 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-00b17de0-5c5a-4950-a2fe-ff6347ba17c3 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491" status: 200 len: 1756 microversion: 2.1 time: 0.139536 Oct 29 01:50:45.448199 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1349/2526] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:50:45 2021] GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491 => generated 1756 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:50:46.464836 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-6e026a90-26a7-411b-907f-8fd0a06db011 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:46.465445 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-6e026a90-26a7-411b-907f-8fd0a06db011 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:50:46.471508 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6e026a90-26a7-411b-907f-8fd0a06db011 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:46.471952 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6e026a90-26a7-411b-907f-8fd0a06db011 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:46.472768 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6e026a90-26a7-411b-907f-8fd0a06db011 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:46.473254 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6e026a90-26a7-411b-907f-8fd0a06db011 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:46.595884 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-6e026a90-26a7-411b-907f-8fd0a06db011 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4de3d6437246eaad32b4c8ea1992c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3012e3c014548df9b30d08c9deb4dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:46.603558 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-6e026a90-26a7-411b-907f-8fd0a06db011 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491" status: 200 len: 1756 microversion: 2.1 time: 0.142353 Oct 29 01:50:46.604124 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1178/2527] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:50:46 2021] GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491 => generated 1756 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:50:47.621073 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-c74cf769-ffa8-429f-b5cf-5cb80882097c tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:47.621677 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-c74cf769-ffa8-429f-b5cf-5cb80882097c tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:50:47.629212 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c74cf769-ffa8-429f-b5cf-5cb80882097c tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:47.629664 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c74cf769-ffa8-429f-b5cf-5cb80882097c tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:47.630470 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c74cf769-ffa8-429f-b5cf-5cb80882097c tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:47.630938 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-c74cf769-ffa8-429f-b5cf-5cb80882097c tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:47.756477 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-c74cf769-ffa8-429f-b5cf-5cb80882097c tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4de3d6437246eaad32b4c8ea1992c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3012e3c014548df9b30d08c9deb4dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:47.764119 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-c74cf769-ffa8-429f-b5cf-5cb80882097c tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491" status: 200 len: 1756 microversion: 2.1 time: 0.147418 Oct 29 01:50:47.764673 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1350/2528] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:50:47 2021] GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491 => generated 1756 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:50:48.780797 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-bf66ea95-f097-4a4c-9e4b-65c92ab302ef tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:48.781380 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-bf66ea95-f097-4a4c-9e4b-65c92ab302ef tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:50:48.787609 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bf66ea95-f097-4a4c-9e4b-65c92ab302ef tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:48.788060 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bf66ea95-f097-4a4c-9e4b-65c92ab302ef tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:48.788824 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bf66ea95-f097-4a4c-9e4b-65c92ab302ef tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:48.789265 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-bf66ea95-f097-4a4c-9e4b-65c92ab302ef tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:48.909457 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-bf66ea95-f097-4a4c-9e4b-65c92ab302ef tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4de3d6437246eaad32b4c8ea1992c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3012e3c014548df9b30d08c9deb4dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:48.917167 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-bf66ea95-f097-4a4c-9e4b-65c92ab302ef tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491" status: 200 len: 1756 microversion: 2.1 time: 0.140093 Oct 29 01:50:48.917731 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1179/2529] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:50:48 2021] GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491 => generated 1756 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:50:49.934081 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-49612ffc-29e5-40db-b4f2-0b6404a6e0f6 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:49.934714 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-49612ffc-29e5-40db-b4f2-0b6404a6e0f6 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:50:49.940968 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-49612ffc-29e5-40db-b4f2-0b6404a6e0f6 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:49.941416 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-49612ffc-29e5-40db-b4f2-0b6404a6e0f6 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:49.942176 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-49612ffc-29e5-40db-b4f2-0b6404a6e0f6 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:50:49.942645 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-49612ffc-29e5-40db-b4f2-0b6404a6e0f6 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:50:50.070005 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-49612ffc-29e5-40db-b4f2-0b6404a6e0f6 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4de3d6437246eaad32b4c8ea1992c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3012e3c014548df9b30d08c9deb4dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:50.077960 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-49612ffc-29e5-40db-b4f2-0b6404a6e0f6 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491" status: 200 len: 1759 microversion: 2.1 time: 0.147575 Oct 29 01:50:50.078548 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1351/2530] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:50:49 2021] GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491 => generated 1759 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:51:03.168898 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:51:03.169572 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: Fri Oct 29 01:51:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 29 01:51:22.973679 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-6131891b-b5fd-4075-b925-916a0c87906e tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1150083593"}} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:51:22.975120 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-6131891b-b5fd-4075-b925-916a0c87906e tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:51:22.981401 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6131891b-b5fd-4075-b925-916a0c87906e tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:51:22.981983 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6131891b-b5fd-4075-b925-916a0c87906e tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:51:22.982873 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6131891b-b5fd-4075-b925-916a0c87906e tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:51:22.983380 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-6131891b-b5fd-4075-b925-916a0c87906e tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:51:23.103016 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.network.security_group_api [None req-6131891b-b5fd-4075-b925-916a0c87906e tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Removing security group 39bc6696-48d2-489f-a7a0-c8c4aec366ef from port 69a2fb36-b158-4efc-b306-832f2972d25f Oct 29 01:51:23.435419 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-6131891b-b5fd-4075-b925-916a0c87906e tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "POST /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491/action" status: 202 len: 0 microversion: 2.1 time: 0.465416 Oct 29 01:51:23.436573 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1180/2531] 10.222.0.90 () {60 vars in 1277 bytes} [Fri Oct 29 01:51:22 2021] POST /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491/action => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:51:23.537448 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [req-8c96964d-0843-45f8-a7f9-385a09d6a1da req-007d073f-3c69-484c-be5a-c5b94ac5c371 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "086997a1-a486-4628-ac24-0d6f31459491", "tag": "69a2fb36-b158-4efc-b306-832f2972d25f"}]} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:51:23.539786 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:51:23.539786 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: warnings.warn(msg) Oct 29 01:51:23.552090 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-8c96964d-0843-45f8-a7f9-385a09d6a1da req-007d073f-3c69-484c-be5a-c5b94ac5c371 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:51:23.554073 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-8c96964d-0843-45f8-a7f9-385a09d6a1da req-007d073f-3c69-484c-be5a-c5b94ac5c371 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:51:23.572091 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.compute.server_external_events [req-8c96964d-0843-45f8-a7f9-385a09d6a1da req-007d073f-3c69-484c-be5a-c5b94ac5c371 service nova] Creating event network-changed:69a2fb36-b158-4efc-b306-832f2972d25f for instance 086997a1-a486-4628-ac24-0d6f31459491 on hv-cinder-81558 Oct 29 01:51:23.584865 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [req-8c96964d-0843-45f8-a7f9-385a09d6a1da req-007d073f-3c69-484c-be5a-c5b94ac5c371 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144109 Oct 29 01:51:23.586348 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1352/2532] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:51:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:51:24.548829 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-9562ca75-911c-408d-a121-1b96e377c839 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:24.549556 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-9562ca75-911c-408d-a121-1b96e377c839 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:51:24.555689 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9562ca75-911c-408d-a121-1b96e377c839 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:51:24.556131 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9562ca75-911c-408d-a121-1b96e377c839 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:51:24.556878 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9562ca75-911c-408d-a121-1b96e377c839 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:51:24.557314 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9562ca75-911c-408d-a121-1b96e377c839 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:51:24.639465 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.objects.instance [None req-9562ca75-911c-408d-a121-1b96e377c839 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lazy-loading 'services' on Instance uuid 086997a1-a486-4628-ac24-0d6f31459491 {{(pid=115748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:51:24.707973 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-9562ca75-911c-408d-a121-1b96e377c839 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "DELETE /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491/os-volume_attachments/a5545590-4549-42dc-a651-f30f8d450b3a" status: 202 len: 0 microversion: 2.1 time: 0.163084 Oct 29 01:51:24.709015 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1181/2533] 10.222.0.90 () {58 vars in 1415 bytes} [Fri Oct 29 01:51:24 2021] DELETE /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491/os-volume_attachments/a5545590-4549-42dc-a651-f30f8d450b3a => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:51:24.717890 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-503a0530-b0d6-4e19-8481-e2cf44e872ac tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:24.718997 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-503a0530-b0d6-4e19-8481-e2cf44e872ac tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:51:24.726703 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-503a0530-b0d6-4e19-8481-e2cf44e872ac tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:51:24.727508 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-503a0530-b0d6-4e19-8481-e2cf44e872ac tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:51:24.728568 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-503a0530-b0d6-4e19-8481-e2cf44e872ac tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:51:24.729062 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-503a0530-b0d6-4e19-8481-e2cf44e872ac tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:51:24.758969 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-503a0530-b0d6-4e19-8481-e2cf44e872ac tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045291 Oct 29 01:51:24.759821 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1353/2534] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:51:24 2021] GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:51:25.615015 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [req-c5c61898-d79a-453f-beea-0309f7cd72e6 req-eccd0b86-a65b-40e0-9fb7-94b7af4c569f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "086997a1-a486-4628-ac24-0d6f31459491", "tag": "69a2fb36-b158-4efc-b306-832f2972d25f"}]} {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:51:25.618063 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:51:25.618063 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: warnings.warn(msg) Oct 29 01:51:25.640940 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-c5c61898-d79a-453f-beea-0309f7cd72e6 req-eccd0b86-a65b-40e0-9fb7-94b7af4c569f service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:51:25.641718 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [req-c5c61898-d79a-453f-beea-0309f7cd72e6 req-eccd0b86-a65b-40e0-9fb7-94b7af4c569f service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:51:25.657048 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.compute.server_external_events [req-c5c61898-d79a-453f-beea-0309f7cd72e6 req-eccd0b86-a65b-40e0-9fb7-94b7af4c569f service nova] Creating event network-changed:69a2fb36-b158-4efc-b306-832f2972d25f for instance 086997a1-a486-4628-ac24-0d6f31459491 on hv-cinder-81558 Oct 29 01:51:25.661924 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [req-c5c61898-d79a-453f-beea-0309f7cd72e6 req-eccd0b86-a65b-40e0-9fb7-94b7af4c569f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054033 Oct 29 01:51:25.662583 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1182/2535] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:51:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:51:25.770589 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-3c5733da-fc4b-480a-84d3-e7338fd85ed7 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:25.772139 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-3c5733da-fc4b-480a-84d3-e7338fd85ed7 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:51:25.778211 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3c5733da-fc4b-480a-84d3-e7338fd85ed7 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:51:25.778673 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3c5733da-fc4b-480a-84d3-e7338fd85ed7 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:51:25.779440 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3c5733da-fc4b-480a-84d3-e7338fd85ed7 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:51:25.779865 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-3c5733da-fc4b-480a-84d3-e7338fd85ed7 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:51:25.808198 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-3c5733da-fc4b-480a-84d3-e7338fd85ed7 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041217 Oct 29 01:51:25.808754 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1354/2536] 10.222.0.90 () {58 vars in 1301 bytes} [Fri Oct 29 01:51:25 2021] GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:51:25.819634 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-9477cc24-0af2-4710-b34e-1edd3e92f4c6 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:25.820247 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-9477cc24-0af2-4710-b34e-1edd3e92f4c6 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:51:25.826486 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9477cc24-0af2-4710-b34e-1edd3e92f4c6 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:51:25.826934 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9477cc24-0af2-4710-b34e-1edd3e92f4c6 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:51:25.827694 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9477cc24-0af2-4710-b34e-1edd3e92f4c6 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:51:25.828122 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-9477cc24-0af2-4710-b34e-1edd3e92f4c6 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:51:25.899159 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.wsgi [None req-9477cc24-0af2-4710-b34e-1edd3e92f4c6 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] HTTP exception thrown: Instance 086997a1-a486-4628-ac24-0d6f31459491 is not attached to volume a5545590-4549-42dc-a651-f30f8d450b3a Oct 29 01:51:25.899754 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-9477cc24-0af2-4710-b34e-1edd3e92f4c6 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Returning 404 to user: Instance 086997a1-a486-4628-ac24-0d6f31459491 is not attached to volume a5545590-4549-42dc-a651-f30f8d450b3a {{(pid=115748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:51:25.900583 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-9477cc24-0af2-4710-b34e-1edd3e92f4c6 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "DELETE /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491/os-volume_attachments/a5545590-4549-42dc-a651-f30f8d450b3a" status: 404 len: 154 microversion: 2.1 time: 0.085912 Oct 29 01:51:25.901123 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1183/2537] 10.222.0.90 () {58 vars in 1415 bytes} [Fri Oct 29 01:51:25 2021] DELETE /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491/os-volume_attachments/a5545590-4549-42dc-a651-f30f8d450b3a => generated 154 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:51:27.038144 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-2f3860d5-191f-438f-b784-0cba20744b3f tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:27.038688 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-2f3860d5-191f-438f-b784-0cba20744b3f tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:51:27.044804 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2f3860d5-191f-438f-b784-0cba20744b3f tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:51:27.045250 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2f3860d5-191f-438f-b784-0cba20744b3f tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:51:27.046006 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2f3860d5-191f-438f-b784-0cba20744b3f tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:51:27.046470 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-2f3860d5-191f-438f-b784-0cba20744b3f tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:51:27.070844 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-2f3860d5-191f-438f-b784-0cba20744b3f tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Going to try to terminate instance {{(pid=115747) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 01:51:27.143087 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-2f3860d5-191f-438f-b784-0cba20744b3f tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "DELETE /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491" status: 204 len: 0 microversion: 2.1 time: 0.108805 Oct 29 01:51:27.143786 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1355/2538] 10.222.0.90 () {58 vars in 1238 bytes} [Fri Oct 29 01:51:27 2021] DELETE /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:51:27.152037 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-532ae89b-35d7-447a-98eb-6c95e0ad569f tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:27.152647 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-532ae89b-35d7-447a-98eb-6c95e0ad569f tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:51:27.158844 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-532ae89b-35d7-447a-98eb-6c95e0ad569f tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:51:27.159289 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-532ae89b-35d7-447a-98eb-6c95e0ad569f tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:51:27.160045 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-532ae89b-35d7-447a-98eb-6c95e0ad569f tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:51:27.160470 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-532ae89b-35d7-447a-98eb-6c95e0ad569f tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:51:27.283520 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-532ae89b-35d7-447a-98eb-6c95e0ad569f tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4de3d6437246eaad32b4c8ea1992c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3012e3c014548df9b30d08c9deb4dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:51:27.291236 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-532ae89b-35d7-447a-98eb-6c95e0ad569f tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491" status: 200 len: 1553 microversion: 2.1 time: 0.142958 Oct 29 01:51:27.291791 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1184/2539] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:51:27 2021] GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491 => generated 1553 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:51:28.308948 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-dd2efe41-4610-419a-8d6d-0c7760e6329a tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Calling method '>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:28.309644 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.compute.api [None req-dd2efe41-4610-419a-8d6d-0c7760e6329a tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Fetching instance by UUID {{(pid=115747) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:51:28.315736 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dd2efe41-4610-419a-8d6d-0c7760e6329a tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:51:28.316173 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dd2efe41-4610-419a-8d6d-0c7760e6329a tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:51:28.316919 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dd2efe41-4610-419a-8d6d-0c7760e6329a tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:51:28.317345 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [None req-dd2efe41-4610-419a-8d6d-0c7760e6329a tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:51:28.436991 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.policy [None req-dd2efe41-4610-419a-8d6d-0c7760e6329a tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4de3d6437246eaad32b4c8ea1992c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3012e3c014548df9b30d08c9deb4dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:51:28.444137 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-dd2efe41-4610-419a-8d6d-0c7760e6329a tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491" status: 200 len: 1553 microversion: 2.1 time: 0.139254 Oct 29 01:51:28.444695 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1356/2540] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:51:28 2021] GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491 => generated 1553 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:51:29.462172 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-39e11d6b-fae4-4281-883e-391dbc85ff4e tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:29.462811 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-39e11d6b-fae4-4281-883e-391dbc85ff4e tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:51:29.468485 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-39e11d6b-fae4-4281-883e-391dbc85ff4e tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:51:29.468934 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-39e11d6b-fae4-4281-883e-391dbc85ff4e tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:51:29.469692 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-39e11d6b-fae4-4281-883e-391dbc85ff4e tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:51:29.470123 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-39e11d6b-fae4-4281-883e-391dbc85ff4e tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:51:29.591024 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.policy [None req-39e11d6b-fae4-4281-883e-391dbc85ff4e tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4de3d6437246eaad32b4c8ea1992c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3012e3c014548df9b30d08c9deb4dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:51:29.598355 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-39e11d6b-fae4-4281-883e-391dbc85ff4e tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491" status: 200 len: 1553 microversion: 2.1 time: 0.141024 Oct 29 01:51:29.598974 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1185/2541] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:51:29 2021] GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491 => generated 1553 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:51:29.670512 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [req-cf1ef51f-eabc-49a4-a2b5-12b6d0528c6d req-cdc4c1fb-7764-493c-81ed-bd8ce507a946 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "086997a1-a486-4628-ac24-0d6f31459491", "name": "network-vif-deleted", "tag": "69a2fb36-b158-4efc-b306-832f2972d25f"}]} {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:51:29.672603 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:51:29.672603 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: warnings.warn(msg) Oct 29 01:51:29.682275 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-cf1ef51f-eabc-49a4-a2b5-12b6d0528c6d req-cdc4c1fb-7764-493c-81ed-bd8ce507a946 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:51:29.682738 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG oslo_concurrency.lockutils [req-cf1ef51f-eabc-49a4-a2b5-12b6d0528c6d req-cdc4c1fb-7764-493c-81ed-bd8ce507a946 service nova] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:51:29.695746 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.compute.server_external_events [req-cf1ef51f-eabc-49a4-a2b5-12b6d0528c6d req-cdc4c1fb-7764-493c-81ed-bd8ce507a946 service nova] Creating event network-vif-deleted:69a2fb36-b158-4efc-b306-832f2972d25f for instance 086997a1-a486-4628-ac24-0d6f31459491 on hv-cinder-81558 Oct 29 01:51:29.702821 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [req-cf1ef51f-eabc-49a4-a2b5-12b6d0528c6d req-cdc4c1fb-7764-493c-81ed-bd8ce507a946 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035135 Oct 29 01:51:29.703419 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1357/2542] 10.222.0.90 () {64 vars in 1317 bytes} [Fri Oct 29 01:51:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:51:30.616044 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-5b1f7573-ced3-4452-95da-2cf98690eb3d tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Calling method '>' {{(pid=115748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:30.616661 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.compute.api [None req-5b1f7573-ced3-4452-95da-2cf98690eb3d tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] [instance: 086997a1-a486-4628-ac24-0d6f31459491] Fetching instance by UUID {{(pid=115748) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:51:30.623057 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5b1f7573-ced3-4452-95da-2cf98690eb3d tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:51:30.623510 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5b1f7573-ced3-4452-95da-2cf98690eb3d tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:51:30.624271 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5b1f7573-ced3-4452-95da-2cf98690eb3d tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:51:30.624703 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG oslo_concurrency.lockutils [None req-5b1f7573-ced3-4452-95da-2cf98690eb3d tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Lock "fc3e9feb-e9f8-4a3e-be74-29e7b655c9e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:51:30.638483 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.wsgi [None req-5b1f7573-ced3-4452-95da-2cf98690eb3d tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] HTTP exception thrown: Instance 086997a1-a486-4628-ac24-0d6f31459491 could not be found. Oct 29 01:51:30.639120 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: DEBUG nova.api.openstack.wsgi [None req-5b1f7573-ced3-4452-95da-2cf98690eb3d tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Returning 404 to user: Instance 086997a1-a486-4628-ac24-0d6f31459491 could not be found. {{(pid=115748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:51:30.639932 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO nova.api.openstack.requestlog [None req-5b1f7573-ced3-4452-95da-2cf98690eb3d tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491" status: 404 len: 111 microversion: 2.1 time: 0.028259 Oct 29 01:51:30.640457 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: [pid: 115748|app: 0|req: 1186/2543] 10.222.0.90 () {58 vars in 1235 bytes} [Fri Oct 29 01:51:30 2021] GET /compute/v2.1/servers/086997a1-a486-4628-ac24-0d6f31459491 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:51:30.648886 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: DEBUG nova.api.openstack.wsgi [None req-2dbb2419-0d3a-4395-acb2-87049d561189 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] Calling method '.version_select at 0x7f6029de7820>' {{(pid=115747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:30.666938 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO nova.api.openstack.requestlog [None req-2dbb2419-0d3a-4395-acb2-87049d561189 tempest-TestMinimumBasicScenario-1602491297 tempest-TestMinimumBasicScenario-1602491297-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-200730336" status: 202 len: 0 microversion: 2.1 time: 0.021972 Oct 29 01:51:30.667481 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: [pid: 115747|app: 0|req: 1358/2544] 10.222.0.90 () {58 vars in 1268 bytes} [Fri Oct 29 01:51:30 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-200730336 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:52:40.862851 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:52:40.863565 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: Fri Oct 29 01:52:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 29 01:52:41.006308 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:52:41.007397 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: Fri Oct 29 01:52:41 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 29 01:54:07.884439 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:54:07.885011 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: Fri Oct 29 01:54:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 29 01:54:23.186650 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:54:23.187254 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: Fri Oct 29 01:54:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 29 01:54:36.375005 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:54:36.375645 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: Fri Oct 29 01:54:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 29 01:56:00.880460 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:56:00.881402 dv-cinder-815582-5-iscsi devstack@n-api.service[115747]: Fri Oct 29 01:56:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 29 01:56:01.023773 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:56:01.024394 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: Fri Oct 29 01:56:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 29 01:56:42.361991 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:56:42.362734 dv-cinder-815582-5-iscsi devstack@n-api.service[115748]: Fri Oct 29 01:56:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!